goskills.com
robots.txt
Robots Exclusion Standard data for goskills.com
Resource Scan
Scan Details
Site Domain | goskills.com |
Base Domain | goskills.com |
Scan Status | Ok |
Last Scan | 2024-09-19T01:17:34+00:00 |
Next Scan | 2024-10-03T01:17:34+00:00 |
Last Scan
Scanned | 2024-09-19T01:17:34+00:00 |
URL | https://goskills.com/robots.txt |
Redirect | https://www.goskills.com/robots.txt |
Redirect Domain | www.goskills.com |
Redirect Base | goskills.com |
Domain IPs | 40.112.243.49 |
Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | 9ed6f77564b7088e460c3eacd080d52b735cb0dc55cc36060d0b471a9fa643fb |
SimHash | edd658947790 |
Groups
domain re-animator bot (http://domainreanimator.com) - support@domainreanimator.com
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /Account/ExternalLogin |
Disallow | /Account/ExternalLoginCallback |
Disallow | /Reset |
Disallow | /Go/ |
Disallow | /Share/ |
Disallow | /Email/ |
Disallow | /Cart/Add/ |
Disallow | /Cron/ |
Disallow | /External/ |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Other Records
Field | Value |
---|---|
sitemap | https://www.goskills.com/sitemap.xml |