If you use the wordpress.org platform Blog, robots.txt file can create yourself via file manager in cpanel, but if you are blogspot user then there are steps that need to be before activating robots.txt (disabled by default).
1. Login to your Blogger account and go to your blog dashboard
2. Click on Settings >> Search preferences
User-agent: Mediapartners-Google
Allow:/
User-agent: Googlebot
Disallow: /?m=1
Disallow: /?m=0
Disallow: /*?m=1
Disallow: /*?m=0
User-agent: *
Disallow: /search?*
User-agent: Twitterbot
Allow:/
User-agent: *
Disallow: /search
Disallow: /p/*
Disallow: /view/*
Allow: /
Sitemap: http://beautifulbeta.blogspot.com/feeds/post/default?orderby=UPDATED
Note: red letters replace with your own blog
5. Save your jobs
For websites with multiple subdomains, each subdomain must have its own robots.txt file. If example.com had a robots.txt file but sub.example.com not, the rule which would apply for example.com would not apply to a.example.com
malam gan, blog ini dijual ga?
ReplyDeleteklo ya, hubungi ane di email ini ya gan: achoox@gmail.com
salam,
Hay, áp dụng vào blog liền. Thanks
ReplyDeletehttp://dulichgiare.abstravel.asia/
http://dulichonline.info/
by default it is disable means it is not indexed by search engines by changing
ReplyDeleteit allows search robots to index all posts. please explain clearly to hotdesishot@gmail.com
your method is good but i think my method is easy to implement check out here chillofyblogging.blogspot.in/2013/06/how-to-setup-custom-robotstxt-in.html
ReplyDeletewhat exactly robot.txt used for ??? i think this not so important to use ???
ReplyDeleteHotel MUrah di Bandung
Hi
ReplyDeleteUser-agent: *
Why do you add this line twice?
Disallow: /p/*
Why disallowing static pages?
thanks, hope you answer quick :D
Robots is software of google which crowling any website activity in search engine which do for promoting any website in search engine .
ReplyDeleteFor more visit : http://www.coolseolist.com
thank you brother. nice knowledge
ReplyDeleteThis is helpfully post for new and advanced blogger.
ReplyDeletehttp://photos-ofstars.blogspot.com
Robots.txt serves to prevent web crawlers work with web robots from accessing all or part of a website if it is publicly viewable. Essentially a robots.txt file on a web site will serve as a request that specified robots ignore specified files or directories when crawling a site.
ReplyDeletescarf suppliers , ladies wraps and shawls , wholesale shawl suppliers , velvet shawl , new york wholesale , elegant shawl , kashmiri shawls wholesalers , red shawl
Did you know there's a 12 word sentence you can communicate to your man... that will induce deep feelings of love and impulsive attractiveness for you deep inside his chest?
ReplyDeleteThat's because hidden in these 12 words is a "secret signal" that triggers a man's instinct to love, idolize and look after you with all his heart...
12 Words That Trigger A Man's Love Response
This instinct is so hardwired into a man's brain that it will drive him to try harder than before to take care of you.
As a matter of fact, triggering this powerful instinct is so essential to achieving the best possible relationship with your man that as soon as you send your man a "Secret Signal"...
...You will immediately find him open his mind and soul to you in a way he's never expressed before and he'll distinguish you as the only woman in the world who has ever truly tempted him.
If you are stuck with your management assignment then in this case you can opt for our Doctoral Dissertation Help. we provide the bestassignment help.We also provide Dissertation consulting help for students across the globe. for more information contact us +16692714848.
ReplyDelete
ReplyDeleteHi! I really like your content. Your post is really informative. I have learned a lot from your article and I’m looking forward to apply it.
ignou assignment 2018
ignou solved assignment free
google 4124
ReplyDeletegoogle 4125
google 4126
google 4127
google 4128