How to Create Robot.txt File
How to Create Robot.txt to allow all search engine robots to access your website / blog
You may create a robot.txt file in a notepad as follow:
1. Click Notepad from your computer
2. Write the following:
User-agent: *
Disallow:
3. Save it.
4. Upload it to the root directory. For example, if you blog is website.com, the file should be uploaded in public_html/–upload here–
5. Done.
Another format of robot.txt is as follow:
User-agent: *
Allow: /
Note: You cannot create Robot.txt file in a Blogspot or WordPress.com blog as you don’t have access to the root level directory. It can be done in a self-hosted blog only.
7 Comments
Post a comment
Perbedaan format follow dan not follow, apa ya? Kalo untuk blog no dofollow mungkin sya agak tahu..
Mas, kalo untuk wordpress self-hosted yang paling bagus itu yang kita setting disallow apa saja yah? mohon pencerahannya.
lihat di sini -> http://www.fatihsyuhud.com/seo-robots-txt-file-for-wordpress/
Knapa dofollow jarang dipake ya mas??
mang kerugiannya apan to,mohon bantuannya
Karena kalo blog kita ketahuan google ngasih link dofollow pada situs jelek kita bisa kena imbasnya
It simple version of robot.txt…
If I do not make robot.txt, does it influence my blog’s performance or at least you can explain the advantages in details..