rundisney.com
robots.txt

Robots Exclusion Standard data for rundisney.com

Resource Scan

Scan Details

Site Domain rundisney.com
Base Domain rundisney.com
Scan Status Ok
Last Scan2024-08-29T23:57:52+00:00
Next Scan 2024-09-28T23:57:52+00:00

Last Scan

Scanned2024-08-29T23:57:52+00:00
URL https://rundisney.com/robots.txt
Redirect https://www.rundisney.com/robots.txt
Redirect Domain www.rundisney.com
Redirect Base rundisney.com
Domain IPs 18.155.68.54, 18.155.68.63, 18.155.68.77, 18.155.68.98
Redirect IPs 125.252.218.252
Response IP 125.252.218.252
Found Yes
Hash 6744abf4521f3979db60b76c5e8fc111f412ad3fc467de330a69ba446d47fcf3
SimHash 42084840c830

Groups

*

Rule Path
Allow /
Disallow /login*
Disallow /healthcheck*
Disallow /debug*
Disallow /dashboard/
Disallow /documents/
Disallow /*?CMP
Disallow /*?s_kwcid
Disallow /*?keyword_id
Disallow /*?f
Disallow /*?t
Disallow /*?ReturnURL
Disallow /*?aspxerrorpath
Disallow /*?collectionID
Disallow /*?index
Disallow /*?faq
Disallow /*?q

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rundisney.com/sitemap.xml

Comments

  • Excludes
  • Disallow directives for AI web crawlers
  • Announce Sitemap Locations