asp.net - is it possible to stop search engines indexing pages with certain querystring parameter -
asp.net - is it possible to stop search engines indexing pages with certain querystring parameter -
i using asp.net datapager , noticed search engines wouldn't able crawl links created, added querystring parameter , see crawl links.
the problem have eventially end multiple urls same page.
is possible stop search engines indexing pages query string parameter such as:
?pg=
so search engine follow these links not index:
http://domain.co.uk/news/07-04-2011/bank-of-england-base-rate?pg=3 http://domain.co.uk/news/11-03-2011/client-feedback-from-employee-relocation?pg=6
but index:
http://domain.co.uk/news/07-04-2011/bank-of-england-base-rate http://domain.co.uk/news/11-03-2011/client-feedback-from-employee-relocation
thanks help
j.
i'm pretty sure can accomplish robots.txt
with google can specify parameters want exclude webmaster tools.
you trap useragent , crash page when it's bot ...
asp.net vb.net indexing robots.txt datapager
Comments
Post a Comment