How to generate robot txt?

[ikcontrols]

Hi,
I have a new website. but I don't know to create robot.txt so pls tell me any solution.

[psharma]

Use robot.txt tool such as small seo tools

[pratikkale]

there are free robot txt generator available use them to generate file

[atocloud]

There are number of sites available, you can use any of them. Some I mentioned below

smallseotools
seobook
seoptimer

[bhavesh11]

Create robots txt file with help of our free online Robots.txt Generator tool

[rahul26]

Use Robot.txt file generator tool.

[tuanvn88]

This is an example of a robots.txt file on my site: bán laptop cũ giá rẻ tphcm

Code: Select all

User-agent: *

Disallow: /tag/
Disallow: /wp-admin/
Disallow: /wishlist/
Allow: /wp-admin/admin-ajax.php

[kunshtech]

Robots.txt files help to ensure Google and other search engines for crawling and indexing your site URLs properly. There are various online tools, by using them you can generate sitemap for your website.

But according me I personnaly use: http://tools.seobook.com/robots-txt/generator/

Whereas in wordpress you don't need to generate sitemap it is automatically generated using Yoast SEO Plugin. It is one stop for all on page SEO

[jay11]

There is tool in google know as robot.txt file generator which helps to generate robot.txt files