 |
Robots.txt, An Online Marketers Friend Or Foe?
robots.txt is possibly the most miss understood file that a website can contain.
Many people think that by using a robots.txt file on their website they are protecting pages and folders from thieves and hackers. In fact it is totally the opposite! robots.txt opens up an enormous security hole that hackers and theives will use to easily gain access to the parts of your website that you don't want them to.
What is robots.txt?
robots.txt is a file that you create and upload to your websites root directory that is used by search engine spiders to determine which parts of your website they should index and which folders/pages that you, the website owner, don't want listed in search engine indexes.
Why would not want pages indexed?
There are many reasons why you might not want search engines to index pages on your website, such as private membership pages or exclusive training pages and such like.
If you are an Internet Marketer selling your own ebook or other digital product, you wouldn't want your thank you pages indexed either!
And this is where the misunderstanding comes to the fore, and robots.txt becomes your foe.
Many online marketers who provide ebooks or other digital products for instant download will list their download thank you pages in the robots.txt file because they obviously don't want those pages indexed in search engines.
By using robots.txt this way though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file works.
robots.txt is easily readable by any human that opens a browser and types in http://www.yourdomain.com/robots.txt and if you have listed your thank you pages, all they have to do is go to that url and take your product(s)!
It's that easy!
And I'm living proof that this works, as this is exactly what happened to me. I had listed my thank you pages in robots.txt and thought that they were safe from hackers and thieves, then one day I was checking my web site stats and BAM, someone had been to every single thank you page, and taken everything.
The moral is, don't list any URL in robots.txt that you don't want humans to have free access to. Use robots.txt with great caution and secure your thank you pages using dedicated software.
Tim Spencer is the owner of http://www.create-an-income.com providing easy-to-use Internet Marketing tools to small and home business entrepreneurs. Protect your thank you pages with this easy-to-use expiring link generator - http://www.create-an-income.com/tools/downloadwarrior
|
 |
Domain Portfolio for Sale
Aktien & Börse Info
DSL 6000
eLearning for Business
race & rally
residencestore
World of Warcraft
Vermögensbildung
4 Steps to a Robot's Tea Party
Creating a new website is only the first stage in what is a long, arduous process to internet success. Millions of new websites, many of them intended to be commercial, are created every year and then.
Tactile Pressure Sensors for Future Robotics
Scientists and Robotic Researchers are attempting to design human type personal assistance robots. As they work to develop algorithms, which most resemble the thought processes of the human brain others are attempting to make them more life like thru human behavioral techniques of mirroring and facial features.
Robot Vacuum Cleaners ? The Future Is Now
Many fans of science fiction can remember reading how we were all supposed to all be flying around on jet packs by the year 2001. Well we haven?t quite achieved that ? yet. But we?re getting closer every day. One example is in the area of cleaning. The Roomba vacuum cleaner, which is made by iRobot, uses robot technology to clean your house. While it?s not quite like ?The Jetsons? it uses many of the same principles.
Death by Robot
In the automotive business there is a saying; "parts is parts" in other words any delay is due to parts not getting their in time and the cost is generally higher because of the cost of the parts and not the repair itself. Now then when does a human die and become a machine? In the future humans will get extra parts to stay alive, but when does the human become a machine? And if the machine parts are better, faster and stronger.
Custom Wallpaper Murals by Gamma Imaging Help Turn Panasonic's New Robotics Headquarters into High-Tech Showplace
Chicago based Gamma Imaging, a leading provider of digital imaging services, was tapped recently to supply stunning digital wallpaper murals, vinyl wallcoverings and backlit displays for Panasonic Factory Solutions' new industrial robotics headquarters in Buffalo Grove, Illinois. As part of a comprehensive branding program developed for Panasonic by Comply Enterprises, Gamma produced and installed over 4,000 square feet of custom vinyl wallcoverings throughout the facility.
Forex Robot Software Taking It To The Next Level
Forex robot software is bringing currency traders to the next level. Gone are the days of pencil and paper trades. Those who are not armed with the latest trading technology are often left in the dust. Today's best forex software includes the ability to help formulate and execute your trade. Software also imparts discipline to traders helping to avoid common trading mishaps.
New Generation ASIMO, Honda's Humanoid Robot, Makes U.S. Debut at Consumer Electronics Show, Performances Produced by Martin Brinkerhoff Associat
Martin Brinkerhoff Associates, Inc. (MBA), one of the West Coast's leading producers of live multi-media events, has developed the presentation for a new generation ASIMO, Honda's advanced humanoid robot. The debut takes place at the Las Vegas Consumer Electronics Show (CES). Performances run several times daily, January 8-11 at the Las Vegas Convention Center North Hall, Booth 4006.
|
