Does anyone know the best way to set meta noindex or nofollow values for bots, Googlbot on select pages? Of course I want questions pages to be indexed, but I don't want search bots to index tags, login pages, register, and some others too. I could try via robots.txt file, but using META value seems like the best approach. Perhaps a PHP "if, then" URL conditional statement might work dynamically in the head? If url contains "login, register, tags", then meta value for bot=noindex
Any ideas? Thanks!