Read How to use robots.txt, meta robots, and canonical tags correctly 

Guide to robots.txt, meta robots, & canonical tags
SEO practitioners sometimes encounter scenarios where their carefully planned optimization efforts backfired: pages mysteriously...