brettonwoodsproject.org
robots.txt

Robots Exclusion Standard data for brettonwoodsproject.org

Resource Scan

Scan Details

Site Domain brettonwoodsproject.org
Base Domain brettonwoodsproject.org
Scan Status Ok
Last Scan2024-06-13T09:19:20+00:00
Next Scan 2024-07-13T09:19:20+00:00

Last Scan

Scanned2024-06-13T09:19:20+00:00
URL https://brettonwoodsproject.org/robots.txt
Redirect https://www.brettonwoodsproject.org/robots.txt
Redirect Domain www.brettonwoodsproject.org
Redirect Base brettonwoodsproject.org
Domain IPs 193.37.35.248
Redirect IPs 193.37.35.248
Response IP 193.37.35.248
Found Yes
Hash 82bc292a51bd94829d2caef3ec3340cd7dd03cbf3ace9a9279dae9e786b875cf
SimHash 1810dd226ed0

Groups

*

Rule Path
Disallow /author/

Other Records

Field Value
crawl-delay 2

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /