Robot question
-
agrahlma
- Posts: 7
- Joined: Thu Mar 09, 2006 5:28 pm
- Contact:
Robot question
By adding the following meta tag, does this prevent internal links from being followed too?
<META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">
<META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">
-
mdev
-
zidit
- Posts: 23
- Joined: Wed Apr 15, 2009 8:36 am
- Contact:
-
VladTepes
- Posts: 1463
- Joined: Sat Dec 16, 2006 9:42 am
- Contact:
Re: Robot question
Yes, all links on this page will never be followed but the page will be open for indexing with any SE bots.agrahlma wrote:By adding the following meta tag, does this prevent internal links from being followed too?
<META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">
Learn more here:
http://www.robotstxt.org/meta.html
Pet Beds - Quality, style and comfort plus healing and soothing warm effects for cold winter season.
-
flake66
- Posts: 2
- Joined: Thu Jul 02, 2009 11:27 am
- Contact:
-
rayter
- Posts: 923
- Joined: Mon Mar 02, 2009 5:04 pm
- Location: United States
- Contact:
-
KrazyG
- Posts: 272
- Joined: Tue Apr 07, 2009 11:25 pm
- Contact:
-
sikceo
- Posts: 4
- Joined: Thu Jul 09, 2009 6:39 am
- Contact:
-
roshandark
- Posts: 28
- Joined: Sun Jul 05, 2009 9:31 pm
- Contact:
-
Bernie01
- Posts: 40
- Joined: Fri Jul 10, 2009 6:27 am
- Location: Phil
- Contact:
-
avoid-debt
- Posts: 85
- Joined: Wed Jul 08, 2009 8:08 am
- Contact:
Re: Hi again
thanks for this info...mdev wrote:If you want that web robots don't index certain pages or directories just use a robots.txt file and place it in your root directory.
Add the folling into the file:
User-agent: *
Disallow: mywebpage.html
Disallow: /my_directoy/
Regards,
[url=http://www.avoid-debt.com/]Avoid Debt Problems[/url]
Who is online
Users browsing this forum: No registered users and 16 guests