ivans.com
robots.txt
Robots Exclusion Standard data for ivans.com
Resource Scan
Scan Details
Site Domain | ivans.com |
Base Domain | ivans.com |
Scan Status | Ok |
Last Scan | 2025-05-23T10:59:11+00:00 |
Next Scan | 2025-06-22T10:59:11+00:00 |
Last Scan
Scanned | 2025-05-23T10:59:11+00:00 |
URL | https://ivans.com/robots.txt |
Redirect | https://www.ivans.com/robots.txt |
Redirect Domain | www.ivans.com |
Redirect Base | ivans.com |
Domain IPs | 217.163.76.7, 217.163.76.8 |
Redirect IPs | 104.18.42.132, 172.64.145.124, 2606:4700:4400::6812:2a84, 2606:4700:4400::ac40:917c |
Response IP | 172.64.145.124 |
Found | Yes |
Hash | 7eee1cd9b67f05e1648eeeaddf9c5da1ff2900b0e46e96f6a4bb1e9b18405587 |
SimHash | 2945db528313 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /archive |
Disallow | /audit-sitemap |
Disallow | /link |
Disallow | /website-archive |
Disallow | /*.gif$ |
Disallow | /*.xls$ |
Disallow | /*.xlsx$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.ivans.com/sitemap/ |