Log In Sign Up

disneysprings.com
robots.txt

Robots Exclusion Standard data for disneysprings.com

Resource Scan

Scan Details

Site Domain disneysprings.com
Base Domain disneysprings.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-09T03:04:24+00:00
Next Scan 2024-11-08T03:04:24+00:00

Last Successful Scan

Scanned2024-06-19T01:12:41+00:00
URL https://disneysprings.com/robots.txt
Redirect https://www.disneysprings.com/robots.txt
Redirect Domain www.disneysprings.com
Redirect Base disneysprings.com
Domain IPs 13.224.163.100, 13.224.163.106, 13.224.163.108, 13.224.163.67
Redirect IPs 23.77.27.245
Response IP 23.210.107.228
Found Yes
Hash c911101df1ffadaab1adce5f0684d1599500d44f9383124f346b424d8b7a5571
SimHash 50108942e833

Groups

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.disneysprings.com/sitemap.xml
sitemap https://www.disneysprings.com/es-us/sitemap.xml
Back to top

Comments

  • Disallow directives for AI web crawlers
  • Announce Sitemap Locations
Back to top