Robots.txt File Analyzer

Robots.txt File for  sitemaps

SEO Tips for Robots.txt

Analyzer Messages

It's recomended to every websites have a Robots.txt File. This file indicate the manner of Search Engines. Infact it's guide for Search Engines not a law so spam engines ignore this file. Anyhow this is very important for part for famous Search Engines.

One the sections of Robots.txt file is Sitemap URLs. In the Robots.txt you can indicate the URLs of your website XML Sitemaps.

Analyzer Raise Error There were no Sitemap URL in robots.txt


Tip: This analyzer add found sitemap to download queue.

 

HTML Author Meta Tag References:

Sitemap Organization

Robots txt Organization

┬ęCopyright Hamed J.I 2010. Hosted on SourceForge