data-bniajfi.opendata.arcgis.com
robots.txt

Robots Exclusion Standard data for data-bniajfi.opendata.arcgis.com

Resource Scan

Scan Details

Site Domain data-bniajfi.opendata.arcgis.com
Base Domain arcgis.com
Scan Status Ok
Last Scan2025-08-25T20:46:49+00:00
Next Scan 2025-09-24T20:46:49+00:00

Last Scan

Scanned2025-08-25T20:46:49+00:00
URL https://data-bniajfi.opendata.arcgis.com/robots.txt
Domain IPs 184.72.158.166, 3.215.20.206, 34.225.249.205
Response IP 3.215.20.206
Found Yes
Hash 49db9f9e81f7dbe2c330d51c4407c806fb6007527345af71ce59f07a4de833d6
SimHash 29199e81c0b3

Groups

*

Rule Path
Disallow /sites/
Disallow /admin/
Disallow /sessions/
Disallow /groups/
Disallow /people/
Disallow /workspace/

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://data-bniajfi.opendata.arcgis.com/sitemap.xml