stateparks.oregon.gov
robots.txt

Robots Exclusion Standard data for stateparks.oregon.gov

Resource Scan

Scan Details

Site Domain stateparks.oregon.gov
Base Domain oregon.gov
Scan Status Ok
Last Scan2024-10-28T01:47:20+00:00
Next Scan 2024-11-27T01:47:20+00:00

Last Scan

Scanned2024-10-28T01:47:20+00:00
URL https://stateparks.oregon.gov/robots.txt
Domain IPs 159.121.119.204
Response IP 159.121.119.204
Found Yes
Hash 984b9790ad5da7c459c0a651142c3cf014aa3e5eef8589a29817c290874f8994
SimHash f84f832a7751

Groups

*

Rule Path
Disallow /cfcs/
Disallow /controller/
Disallow /files/
Disallow /images/
Disallow /layouts/
Disallow /mobile/
Disallow /data/
Disallow /mobile/
Disallow /ckFiles/
Disallow /statusUpdates/
Disallow /interview/
Disallow /training/
Disallow /index.cfm?do=parkPage.dsp_parkPage&parkId=61

appcodescrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gwm-gsa-crawler

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

fatbot 2.0

Rule Path
Disallow /

ahc/1.0

Rule Path
Disallow /

ahc/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

bluechipbacklinks

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /