ncdsv.org
robots.txt

Robots Exclusion Standard data for ncdsv.org

Resource Scan

Scan Details

Site Domain ncdsv.org
Base Domain ncdsv.org
Scan Status Ok
Last Scan2025-02-15T16:34:18+00:00
Next Scan 2025-03-17T16:34:18+00:00

Last Scan

Scanned2025-02-15T16:34:18+00:00
URL https://ncdsv.org/robots.txt
Redirect https://www.ncdsv.org/robots.txt
Redirect Domain www.ncdsv.org
Redirect Base ncdsv.org
Domain IPs 199.34.228.76
Redirect IPs 199.34.228.76
Response IP 199.34.228.76
Found Yes
Hash 6e8d0c2804d18ead549102e44500f3e77dee473176789519e4e7755f1b10148a
SimHash 5a57d4c2edb2

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//www.ncdsv.org/sitemap.html
Disallow /http%3A//ncdsv.org/sitemap.html
Disallow /http%3A//www.ncdsv.org/sitemap.html
Disallow /http%3A//www.ncdsv.org/sitemap.html
Disallow /jobs-backup.html
Disallow /home-830-backup.html
Disallow /internet-and-computer-safety-830-backup.html
Disallow /links-backup-1122024.html
Disallow /battering-intervention-backup-292024.html
Disallow /links-backup-292024.html
Disallow /support-us-backup-2192024.html
Disallow /donate-backup-1192024.html
Disallow /libraries-and-collections-22624.html
Disallow /libraries-and-collections-22724.html
Disallow /libraries-and-collections-22724-2.html
Disallow /board-president-414-backup.html
Disallow /upcoming-trainings-backup-6102024.html
Disallow /upcoming-trainings-backup-6112024.html
Disallow /publications-backup-6132024.html
Disallow /prosecution-backup-6132024.html
Disallow /publications-9162024.html
Disallow /923-backup-violence-against-women-act-vawa-30th-anniversary-september-2023.html
Disallow /publications-92524.html
Disallow /violence-against-women-act-vawa-30th-anniversary-september-2024-backup-9282024.html
Disallow /links-backup-121824.html
Disallow /guns--gun-violence-1625.html
Disallow /board-of-directors-backup-11225.html
Disallow /publications-11325.html
Disallow /board-of-directors-11320251.html

Other Records

Field Value
sitemap https://www.ncdsv.org/sitemap.xml