Page 1 of 1
How to generate robot txt?
Posted: Tue Jun 25, 2019 3:31 am
by ikcontrols
Hi,
I have a new website. but I don't know to create robot.txt so pls tell me any solution.
Re: How to generate robot txt?
Posted: Wed Jun 26, 2019 4:40 am
by psharma
Use robot.txt tool such as small seo tools
Re: How to generate robot txt?
Posted: Thu Jun 27, 2019 5:07 am
by pratikkale
there are free robot txt generator available use them to generate file
Re: How to generate robot txt?
Posted: Thu Jun 27, 2019 10:46 pm
by atocloud
There are number of sites available, you can use any of them. Some I mentioned below
smallseotools
seobook
seoptimer
Re: How to generate robot txt?
Posted: Tue Jul 02, 2019 3:17 am
by bhavesh11
Create robots txt file with help of our free online Robots.txt Generator tool
Re: How to generate robot txt?
Posted: Tue Jul 02, 2019 10:01 pm
by rahul26
Use Robot.txt file generator tool.
Re: How to generate robot txt?
Posted: Thu Jul 04, 2019 8:43 am
by tuanvn88
This is an example of a robots.txt file on my site:
bán laptop cũ giá rẻ tphcm
Code: Select all
User-agent: *
Disallow: /tag/
Disallow: /wp-admin/
Disallow: /wishlist/
Allow: /wp-admin/admin-ajax.php
Re: How to generate robot txt?
Posted: Fri Jul 05, 2019 5:55 am
by kunshtech
Robots.txt files help to ensure Google and other search engines for crawling and indexing your site URLs properly. There are various online tools, by using them you can generate sitemap for your website.
But according me I personnaly use:
http://tools.seobook.com/robots-txt/generator/
Whereas in wordpress you don't need to generate sitemap it is automatically generated using Yoast SEO Plugin. It is one stop for all on page SEO
Re: How to generate robot txt?
Posted: Sat Jul 06, 2019 1:47 am
by jay11
There is tool in google know as robot.txt file generator which helps to generate robot.txt files