local.yahoo.com
robots.txt
Robots Exclusion Standard data for local.yahoo.com
Resource Scan
Scan Details
Site Domain | local.yahoo.com |
Base Domain | yahoo.com |
Scan Status | Ok |
Last Scan | 2024-11-14T04:01:51+00:00 |
Next Scan | 2024-12-14T04:01:51+00:00 |
Last Scan
Scanned | 2024-11-14T04:01:51+00:00 |
URL | https://local.yahoo.com/robots.txt |
Domain IPs | 106.10.218.137, 2406:2000:e4:1404::3000 |
Response IP | 106.10.218.137 |
Found | Yes |
Hash | 2cda20bb212150ee16e2de139e655e7f444ad77cf8b5bc33286c645d21acccb8 |
SimHash | 74057b52c280 |
Groups
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /bin |
Disallow | /language |
Disallow | /yhs |
Disallow | /aol |
Disallow | /reviews |
Disallow | /click |