teachersupplysource.com
robots.txt
Robots Exclusion Standard data for teachersupplysource.com
Resource Scan
Scan Details
Site Domain | teachersupplysource.com |
Base Domain | teachersupplysource.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-16T18:31:34+00:00 |
Next Scan | 2024-10-14T18:31:34+00:00 |
Last Successful Scan
Scanned | 2024-02-25T18:27:07+00:00 |
URL | https://teachersupplysource.com/robots.txt |
Redirect | https://www.teachersupplysource.com/robots.txt |
Redirect Domain | www.teachersupplysource.com |
Redirect Base | teachersupplysource.com |
Domain IPs | 104.21.6.121, 172.67.134.213, 2606:4700:3031::6815:679, 2606:4700:3037::ac43:86d5 |
Redirect IPs | 104.21.6.121, 172.67.134.213, 2606:4700:3031::6815:679, 2606:4700:3037::ac43:86d5 |
Response IP | 172.67.134.213 |
Found | Yes |
Hash | ad1fe30acf57f15e658280e7dcafe387efd8095609d71b4dd8cc4bea04e8a9e0 |
SimHash | 45b91a51e711 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /provider/ |
Disallow | /verificator/ |
Disallow | /cgi-bin/ |
Disallow | /cart.php |
Disallow | /cart/ |
Disallow | /checkout/ |
Disallow | /payment/ |
Disallow | /help.php |
Disallow | /giftcert.php |
Disallow | /orders.php |
Disallow | /register.php |
Disallow | /search.php |
Disallow | /*_openstat |
Disallow | /cdn-cgi/ |
Disallow | /shop_closed.html |
Disallow | /retrieve_orders.php |
Allow | /api/account/get-site-data |
Allow | /api/account/get-product-info |
Allow | /api/category/ |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /provider/ |
Disallow | /verificator/ |
Disallow | /cgi-bin/ |
Disallow | /cart.php |
Disallow | /cart/ |
Disallow | /checkout/ |
Disallow | /payment/ |
Disallow | /help.php |
Disallow | /giftcert.php |
Disallow | /orders.php |
Disallow | /register.php |
Disallow | /search.php |
Disallow | /*_openstat |
Disallow | /cdn-cgi/ |
Disallow | /shop_closed.html |
Disallow | /retrieve_orders.php |
Allow | /api/account/get-site-data |
Allow | /api/account/get-product-info |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
Other Records
Field | Value |
---|---|
sitemap | http://www.teachersupplysource.com/sitemap.xml |
sitemap | https://www.teachersupplysource.com/sitemap.xml |
Warnings
- `host` is not a known field.