Robots.txt Generator

Search Engine Optimization

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

With this tool you can generate 100% free WordPress robots.txt file! If you are webmaster working with WordPress site or blog you should to use robots.txt for search engines. WordPress site owners use the /robots.txt file to give instructions about their site to web robots.

In the first step you should to select default allowed options for search engines then select crawl delay time and add your sitemap file. After these steps please select with search robots to add to your robots.txt file.You want to restricted directories or folders from robots.txt file? ofcourse, you can add 6 folders or less in this form. Click "create robots.txt" button and save it to your computer. Connect with FTP software to your website hosting and upload your own Website robots.txt file to the public_html folder.