home.neustar
robots.txt
Robots Exclusion Standard data for home.neustar
Resource Scan
Scan Details
Site Domain | home.neustar |
Base Domain | home.neustar |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-15T02:56:52+00:00 |
Next Scan | 2025-11-13T02:56:52+00:00 |
Last Successful Scan
Scanned | 2023-10-02T19:22:23+00:00 |
URL | https://home.neustar/robots.txt |
Domain IPs | 104.18.36.201, 172.64.151.55 |
Response IP | 104.18.36.201 |
Found | Yes |
Hash | 71a46717513c24b454f595757952246273dc223253d196d791e8d88a599f32cc |
SimHash | 6901e844cb10 |
Groups
*
Rule | Path |
---|---|
Disallow | /taxonomy |
Disallow | /taxonomy/ |
Disallow | /*?* |
Disallow | /buy/ |
Disallow | /blog/authors |