runroanoke.com
robots.txt

Robots Exclusion Standard data for runroanoke.com

Resource Scan

Scan Details

Site Domain runroanoke.com
Base Domain runroanoke.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-03T00:49:26+00:00
Next Scan 2025-11-02T00:49:26+00:00

Last Successful Scan

Scanned2025-07-05T09:25:42+00:00
URL https://runroanoke.com/robots.txt
Domain IPs 104.21.39.11, 172.67.142.26, 2606:4700:3032::6815:270b, 2606:4700:3036::ac43:8e1a
Response IP 104.21.39.11
Found Yes
Hash b2c48d5fd744ba4eed5285a17f46a75e374ee8f05479a3a4a7e9ad2ecfdcb8f9
SimHash 1008d942f4a4

Groups

*

Rule Path
Disallow /account/
Disallow /bin/
Disallow /Code/
Disallow /Components/
Disallow /config/
Disallow /Content/
Disallow /Controls/
Disallow /css/
Disallow /EventFiles/
Disallow /EventResultFiles/
Disallow /fonts/
Disallow /images/
Disallow /js/
Disallow /Manage/
Disallow /Scripts/
Disallow /Styles/

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bw/1.1

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dalvik/2.1.0

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dubbotbot

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

isscyberriskcrawler

Rule Path
Disallow /

java

Rule Path
Disallow /

lyticsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mozlila

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

powermapper

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

swiftbot

Rule Path
Disallow /

wp_is_mobile

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

image2dataset

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Comments

  • Block ALL bots from specific directories
  • Block bots
  • Block AI bots