teachersupplysource.com
robots.txt

Robots Exclusion Standard data for teachersupplysource.com

Resource Scan

Scan Details

Site Domain teachersupplysource.com
Base Domain teachersupplysource.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-17T18:31:21+00:00
Next Scan 2024-07-16T18:31:21+00:00

Last Successful Scan

Scanned2024-02-25T18:27:07+00:00
URL https://teachersupplysource.com/robots.txt
Redirect https://www.teachersupplysource.com/robots.txt
Redirect Domain www.teachersupplysource.com
Redirect Base teachersupplysource.com
Domain IPs 104.21.6.121, 172.67.134.213, 2606:4700:3031::6815:679, 2606:4700:3037::ac43:86d5
Redirect IPs 104.21.6.121, 172.67.134.213, 2606:4700:3031::6815:679, 2606:4700:3037::ac43:86d5
Response IP 172.67.134.213
Found Yes
Hash ad1fe30acf57f15e658280e7dcafe387efd8095609d71b4dd8cc4bea04e8a9e0
SimHash 45b91a51e711

Groups

googlebot

Rule Path
Disallow /admin/
Disallow /api/
Disallow /provider/
Disallow /verificator/
Disallow /cgi-bin/
Disallow /cart.php
Disallow /cart/
Disallow /checkout/
Disallow /payment/
Disallow /help.php
Disallow /giftcert.php
Disallow /orders.php
Disallow /register.php
Disallow /search.php
Disallow /*_openstat
Disallow /cdn-cgi/
Disallow /shop_closed.html
Disallow /retrieve_orders.php
Allow /api/account/get-site-data
Allow /api/account/get-product-info
Allow /api/category/

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /provider/
Disallow /verificator/
Disallow /cgi-bin/
Disallow /cart.php
Disallow /cart/
Disallow /checkout/
Disallow /payment/
Disallow /help.php
Disallow /giftcert.php
Disallow /orders.php
Disallow /register.php
Disallow /search.php
Disallow /*_openstat
Disallow /cdn-cgi/
Disallow /shop_closed.html
Disallow /retrieve_orders.php
Allow /api/account/get-site-data
Allow /api/account/get-product-info

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap http://www.teachersupplysource.com/sitemap.xml
sitemap https://www.teachersupplysource.com/sitemap.xml

Warnings

  • `host` is not a known field.