crashreview1.ru
robots.txt
Robots Exclusion Standard data for crashreview1.ru
Resource Scan
Scan Details
Site Domain | crashreview1.ru |
Base Domain | crashreview1.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-19T15:42:58+00:00 |
Next Scan | 2024-06-18T15:42:58+00:00 |
Last Successful Scan
Scanned | 2024-04-20T14:13:05+00:00 |
URL | https://www.crashreview1.ru/robots.txt |
Redirect | https://crashreview20.ru/robots.txt |
Redirect Domain | crashreview20.ru |
Redirect Base | crashreview20.ru |
Domain IPs | 104.21.3.82, 172.67.130.126, 2606:4700:3033::6815:352, 2606:4700:3034::ac43:827e |
Redirect IPs | 104.21.89.147, 172.67.160.224, 2606:4700:3031::ac43:a0e0, 2606:4700:3032::6815:5993 |
Response IP | 172.67.160.224 |
Found | Yes |
Hash | b29a4b75f690d67fd79df798e30be27fc789a22161575dddef01d59f4a3470e3 |
SimHash | a84848c0a49b |
Other Records
Field | Value |
---|---|
sitemap | http://crashreview20.ru/sitemap_index.xml |
Comments