Welcome to the Question2Answer Q&A. There's also a demo if you just want to try it out.

Should i block tag and tags pages using robot.txt ?

0 votes
asked Feb 5 in Q2A Core by Zeeshan

Disallow: /tag*
Disallow: /tags*

LIke this? or keeping it unblock more better for seo ?

Q2A version: 1.8 beta2

1 Answer

0 votes
answered Feb 10 by Scott
I don’t think there is any reason to block the pages. The tags pages allow filtering by category so if someone was searching for that category it could be in search results.

Google is pretty smart and as far as I know doesn’t consider filtering pages as duplicate content.
commented Feb 10 by Zeeshan
But see the robots.txt of StackOverflow they have blocked tags
commented Mar 5 by Scott
Actually they only block the tag pages with "+" in them, as that's used for combining multiple tags. Individual tag pages still show up in Google, eg: https://www.google.co.uk/search?q=stack+overflow+tagged+php