sdadata.org
robots.txt

Robots Exclusion Standard data for sdadata.org

Resource Scan

Scan Details

Site Domain sdadata.org
Base Domain sdadata.org
Scan Status Ok
Last Scan2025-11-04T14:56:35+00:00
Next Scan 2025-12-04T14:56:35+00:00

Last Scan

Scanned2025-11-04T14:56:35+00:00
URL https://sdadata.org/robots.txt
Redirect https://www.sdadata.org/robots.txt
Redirect Domain www.sdadata.org
Redirect Base sdadata.org
Domain IPs 199.34.228.146
Redirect IPs 199.34.228.146
Response IP 199.34.228.146
Found Yes
Hash dea7da6567d4888ee5bde1ba5246df254f838afa79d64b9d4f5e828846492f5d
SimHash 3a44dcfe2793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /working-from-home-883004.html
Disallow /covid-19-submenu.html
Disallow /resources.html

Other Records

Field Value
sitemap https://www.sdadata.org/sitemap.xml