Welcome to the Treehouse Community
Want to collaborate on code errors? Have bugs you need feedback on? Looking for an extra set of eyes on your latest project? Get support with fellow developers, designers, and programmers of all backgrounds and skill levels here with the Treehouse Community! While you're at it, check out some resources Treehouse students have shared here.
Looking to learn something new?
Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and join thousands of Treehouse students and alumni in the community today.
Start your free trial
David Klotz
19,659 PointsSitemap contains urls which are blocked by robots.txt.
I have a site www.classicalacupunctureherbs.com that Im having an issue with the sitemap and robots.txt. In a google search for the site, there is no description with the result and it says "A description for this result is not available because of this site's robots.txt". I checked in search console and it says that robots.txt is blocking my url. It lists the following is being blocked:
Value: http://www.classicalacupunctureherbs.com/category-sitemap.xml Value: http://www.classicalacupunctureherbs.com/page-sitemap.xml Value: http://www.classicalacupunctureherbs.com/post-sitemap.xml
I've used the robots.txt tester and it shows no errors and says everything is allowed. I've tried deleting robots.txt and creating a new one through Yoast SEO, and tried the Google XML sitemaps plugin as well and got the same results.
My robots.txt file currently says: User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php
Does anyone know why this is occuring or how to fix it?