ncpc.gov
robots.txt
Robots Exclusion Standard data for ncpc.gov
Resource Scan
Scan Details
Site Domain | ncpc.gov |
Base Domain | ncpc.gov |
Scan Status | Ok |
Last Scan | 2024-11-19T16:08:46+00:00 |
Next Scan | 2024-12-19T16:08:46+00:00 |
Last Scan
Scanned | 2024-11-19T16:08:46+00:00 |
URL | https://ncpc.gov/robots.txt |
Redirect | https://www.ncpc.gov//robots.txt |
Redirect Domain | www.ncpc.gov |
Redirect Base | ncpc.gov |
Domain IPs | 66.228.35.108 |
Redirect IPs | 66.228.35.108 |
Response IP | 66.228.35.108 |
Found | Yes |
Hash | d8437c2464fb7ad674b22f54374353c55ba505ed5b86c8949c849ca1a9fed5ef |
SimHash | 5706d3fbefb9 |
Groups
*
Rule | Path |
---|---|
Disallow | /web2.0/ |
Disallow | /json/ |
Disallow | /fcip/ |
Disallow | /app/ |
Disallow | /go/ |
Disallow | /combox/ |
Disallow | /code/ |
Disallow | /db/ |
Disallow | /rsvp/ |
Disallow | /review/archive/ |
Comments