ncoa.org
robots.txt
Robots Exclusion Standard data for ncoa.org
Resource Scan
Scan Details
Site Domain | ncoa.org |
Base Domain | ncoa.org |
Scan Status | Ok |
Last Scan | 2024-04-19T06:32:50+00:00 |
Next Scan | 2024-05-19T06:32:50+00:00 |
Last Scan
Scanned | 2024-04-19T06:32:50+00:00 |
URL | https://ncoa.org/robots.txt |
Redirect | https://www.ncoa.org:443/robots.txt |
Redirect Domain | www.ncoa.org |
Redirect Base | ncoa.org |
Domain IPs | 3.230.124.7, 54.221.36.242 |
Redirect IPs | 13.225.4.111, 13.225.4.40, 13.225.4.68, 13.225.4.99, 2600:9000:21b4:2600:6:c8c3:d440:93a1, 2600:9000:21b4:5000:6:c8c3:d440:93a1, 2600:9000:21b4:7400:6:c8c3:d440:93a1, 2600:9000:21b4:9200:6:c8c3:d440:93a1, 2600:9000:21b4:ae00:6:c8c3:d440:93a1, 2600:9000:21b4:d800:6:c8c3:d440:93a1, 2600:9000:21b4:da00:6:c8c3:d440:93a1, 2600:9000:21b4:ee00:6:c8c3:d440:93a1 |
Response IP | 13.225.4.99 |
Found | Yes |
Hash | d118965369899446971b5eebd05b01178a84879f072729e13a5d033d76807e3c |
SimHash | 6d5d5875c7d3 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /cgi-bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.ncoa.org/sitemap.xml |