2 years ago

Harnessing the Power of Robots.txt abc

Sometimes, we might want search engines to not index certain elements of the site, and on occasion even ban other SE in the site altogether.

This really is where a simple, little 2 line text file called robots.txt is available in.
<