crictracker.com
robots.txt
Robots Exclusion Standard data for crictracker.com
Resource Scan
Scan Details
Site Domain | crictracker.com |
Base Domain | crictracker.com |
Scan Status | Ok |
Last Scan | 2024-05-19T13:42:40+00:00 |
Next Scan | 2024-05-26T13:42:40+00:00 |
Last Scan
Scanned | 2024-05-19T13:42:40+00:00 |
URL | https://crictracker.com/robots.txt |
Redirect | https://www.crictracker.com:443/robots.txt |
Redirect Domain | www.crictracker.com |
Redirect Base | crictracker.com |
Domain IPs | 52.66.171.246, 65.2.0.21 |
Redirect IPs | 104.26.14.31, 104.26.15.31, 172.67.71.184, 2606:4700:20::681a:e1f, 2606:4700:20::681a:f1f, 2606:4700:20::ac43:47b8 |
Response IP | 172.67.71.184 |
Found | Yes |
Hash | b4d5b84250c89485c2a08b4af1d1966c8c0249a2a80385f0cd7934fd4ac46003 |
SimHash | 010c9a60ca13 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /.well-known/amphtml/apikey.pub |
Other Records
Field | Value |
---|---|
sitemap | https://www.crictracker.com/sitemap.xml |
sitemap | https://www.crictracker.com/news-sitemap.xml |