sgclassic.com
robots.txt
Robots Exclusion Standard data for sgclassic.com
Resource Scan
Scan Details
Site Domain | sgclassic.com |
Base Domain | sgclassic.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-30T15:02:19+00:00 |
Next Scan | 2024-07-29T15:02:19+00:00 |
Last Successful Scan
Scanned | 2023-04-07T10:19:06+00:00 |
URL | https://sgclassic.com/robots.txt |
Domain IPs | 104.21.4.21, 172.67.131.142, 2606:4700:3030::ac43:838e, 2606:4700:3034::6815:415 |
Response IP | 104.21.4.21 |
Found | Yes |
Hash | c8f55228ee31bc9705c7174ebc95fd1a33e14a7f125c7b7b4857487e823caea6 |
SimHash | 6b54a0506733 |
Other Records
Field | Value | Comment |
---|---|---|
sitemap | https://sgclassic.com/sitemap.xml | - |
sitemap | https://sgclassic.com/sitemap_1.xmlDisallow: /db_backup.1680862747/ | Old DB crash data |