WEBFI-WordPress-How to Optimize Your WordPress Robots txt for SEO
Do you want to improve your robots.txt file? This is important for SEO but can be confusing for users. In this video, we will show you how to optimize your WordPress robots.txt for seo.
If you liked this video, then please Like and consider subscribing to our channel for more WordPress videos.
Text version of this tutorial:
http://www.wpbeginner.com/wp-tutorials/how-to-optimize-your-wordpress-robots-txt-for-seo/
Check us out on Facebook:
https://www.facebook.com/wpbeginner
Follow us on Twitter:
http://twitter.com/wpbeginner
Join our circle on Google+:
https://plus.google.com/+wpbeginner/
Checkout our website for more WordPress Tutorials
http://www.wpbeginner.com/
Summary of this Tutorial:
The robots.txt file is normally located in the root folder for your site and you can get to it either by using a FTP client or through your cpanel’s file manger.
You can decide which locations can be indexed from bots using this file.
As well as what to index to help with SEO.
source
What is SEO please?
I would like a video on how to reference your website to have more view.
Thanks!
Hi, i have a new domain and when i enter it in webmaster's sitemap i am getting error "URL restricted by robots.txt". Firstly i don't have robots file in root folder, but as webmaster asked i created 1 for this. but still getting same error.. Can you please tell me why?? i am using Google XML Sitemaps v3 for qTranslate plugin for generating sitemap.
I figure out a issue.. when i install seo plugin it cause error and when i remove seo plugin its working fine.. Confused 🙁