districtdatalabs.com
robots.txt

Robots Exclusion Standard data for districtdatalabs.com

Resource Scan

Scan Details

Site Domain districtdatalabs.com
Base Domain districtdatalabs.com
Scan Status Ok
Last Scan2026-03-08T23:59:34+00:00
Next Scan 2026-04-07T23:59:34+00:00

Last Scan

Scanned2026-03-08T23:59:34+00:00
URL https://districtdatalabs.com/robots.txt
Redirect https://www.districtdatalabs.com/robots.txt
Redirect Domain www.districtdatalabs.com
Redirect Base districtdatalabs.com
Domain IPs 104.21.55.99, 172.67.147.115, 2606:4700:3030::ac43:9373, 2606:4700:3033::6815:3763
Redirect IPs 104.21.55.99, 172.67.147.115, 2606:4700:3030::ac43:9373, 2606:4700:3033::6815:3763
Response IP 172.67.147.115
Found Yes
Hash 5f3bd1eb8ea5b688f9e3dd40c5c488e3f484067911cfc6cc7c900fbb987de2a4
SimHash 4e14fa30ee73

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /login
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.districtdatalabs.com/sitemap.xml