sheilds.org
robots.txt

Robots Exclusion Standard data for sheilds.org

Resource Scan

Scan Details

Site Domain sheilds.org
Base Domain sheilds.org
Scan Status Ok
Last Scan2024-09-02T14:21:01+00:00
Next Scan 2024-10-02T14:21:01+00:00

Last Scan

Scanned2024-09-02T14:21:01+00:00
URL https://sheilds.org/robots.txt
Redirect https://www.sheilds.org/robots.txt
Redirect Domain www.sheilds.org
Redirect Base sheilds.org
Domain IPs 192.124.249.12
Redirect IPs 192.124.249.12
Response IP 192.124.249.12
Found Yes
Hash f3f3eeabe512936d415a468ebadb6dd837683c7e6b780ea338084829e76d806b
SimHash 105c998067f1

Groups

googlebot

Rule Path
Allow /
Allow /robots.txt
Disallow /wp-admin/*
Disallow /refer/
Disallow /courses/*
Disallow /eb_courses/*
Disallow /eb_category/*
Disallow /basket/*
Disallow /checkout/*
Disallow /single/*
Disallow /qualifications/book-exam/*
Disallow /qualifications/extensions/*
Disallow /qualifications/uncategorised/*

*

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /wp-admin/*
Disallow /refer/
Disallow /courses/*
Disallow /eb_courses/*
Disallow /eb_category/*
Disallow /basket/*
Disallow /checkout/*
Disallow /single/*
Disallow /qualifications/book-exam/*
Disallow /qualifications/extensions/*
Disallow /qualifications/uncategorised/*

screaming frog seo spider
siteauditbot

Rule Path
Allow /
Disallow /wp-admin/*
Disallow /refer/
Disallow /courses/*
Disallow /eb_courses/*
Disallow /eb_category/*
Disallow /basket/*
Disallow /checkout/*
Disallow /single/*
Disallow /qualifications/book-exam/*
Disallow /qualifications/extensions/*
Disallow /qualifications/uncategorised/*

Other Records

Field Value
sitemap https://www.sheilds.org/sitemap_index.xml
sitemap https://www.sheilds.org/page-sitemap.xml
sitemap https://www.sheilds.org/post-sitemap.xml
sitemap https://www.sheilds.org/product-sitemap.xml

Comments

  • Google crawlers
  • All Search bots
  • Change below to Allow when going live
  • Uncomment when going live
  • Exceptions