What Is Robots.txt File

What Is Robots.Txt File and What It Will Help You In SEO..?

At First a Robots Txt File is To Give Instructions to Web Robots as We Call it Bot!

It's Works Like This

A Robot Want to Visit a Website Url...

e.g http://ringtonesfree.in/site_bollywood_mp3_ringtones.xhtml

Before A Robot Visit This Page, Its First Check Robots.Txt File

e.g http://ringtonesfree.in/robots.txt

To Include All Robots of Web

Use User-agent: *

To Allow a Single Robot of Web

Use User-agent: Example Bot

To Exclude All Files Except One

Use Disallow: /-my/content



Readers Feedback is Important for Us! So please Leave a Comment here!

Regards,
Ash Paul