May
13
2008
Sitemap awareness from Robots.txt
Posted by Russell Brown at 2:03 PM
0 comments - Categories: ColdFusion | Mango Blog
In writig a plugin for Mango Blog, I found out that the big leaguers for search engines have gotten together and decided that sitemap awareness from robots.txt was a good idea. This was news to me despite that this has been out there for more than a year now.
To add your sitemaps to your robots.txt simply add this line:
Sitemap: http://www.YourWebsite.com/sitemap.xml
In my case i used:
Sitemap: http://www.empiregpservices.com/blog/sitemap.xml
Further information:
http://www.sitemaps.org
http://en.wikipedia.org/wiki/Robots.txt
http://www.ysearchblog.com/archives/000437.html