robots.txt

If you are a blogging enthusiast or a beginner, you might know that robots.txt plays a critical role in indexing or de-indexing the site's every post and page. But are…