disney.com
robots.txt

Robots Exclusion Standard data for disney.com

Resource Scan

Scan Details

Site Domain disney.com
Base Domain disney.com
Scan Status Ok
Last Scan2024-06-28T16:25:39+00:00
Next Scan 2024-07-05T16:25:39+00:00

Last Scan

Scanned2024-06-28T16:25:39+00:00
URL https://disney.com/robots.txt
Redirect https://www.disney.com/robots.txt
Redirect Domain www.disney.com
Redirect Base disney.com
Domain IPs 130.211.198.204
Redirect IPs 23.209.46.74, 23.209.46.83, 2600:1417:5e::1731:3c87, 2600:1417:5e::1731:3caf
Response IP 42.99.140.219
Found Yes
Hash bf6442bb3718d47624c9bd8b2b0fe6eb1f9f40a6eba0696b23758b5012360850
SimHash 7d10f610e662

Groups

*

Rule Path
Disallow /wp-content/plugins/
Disallow /embed/
Disallow /admin/
Disallow /*?
Disallow /forgot-password*
Disallow /faq-participantLogin*
Disallow /es-419/
Disallow /pt-BR/
Disallow /comments/
Disallow /feed/
Disallow /his/
Disallow /uploads/
Disallow /captions/
Disallow /wp-content/
Disallow /media/
Disallow /nl/
Disallow /disid/
Disallow /blog/
Disallow /programs/
Disallow /index.php/
Disallow /ajax/
Disallow /jserrors/

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.disney.com/sitemap.xml

Comments

  • Robots.txt for www.disney.com

Warnings

  • 49 invalid lines.