2 years ago
Harnessing the Power of Robots.txt abc
Sometimes, we might want search engines to not index certain elements of the site, and on occasion even ban other SE in the site altogether.
This really is where a simple, little 2 line text file called robots.txt is available in.
< read more...