enchantedlearning.com
robots.txt

Robots Exclusion Standard data for enchantedlearning.com

Resource Scan

Scan Details

Site Domain enchantedlearning.com
Base Domain enchantedlearning.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-26T00:44:35+00:00
Next Scan 2024-06-25T00:44:35+00:00

Last Successful Scan

Scanned2024-04-27T00:43:31+00:00
URL https://enchantedlearning.com/robots.txt
Redirect https://www.enchantedlearning.com/robots.txt
Redirect Domain www.enchantedlearning.com
Redirect Base enchantedlearning.com
Domain IPs 104.26.6.41, 104.26.7.41, 172.67.69.108, 2606:4700:20::681a:629, 2606:4700:20::681a:729, 2606:4700:20::ac43:456c
Redirect IPs 104.26.6.41, 104.26.7.41, 172.67.69.108, 2606:4700:20::681a:629, 2606:4700:20::681a:729, 2606:4700:20::ac43:456c
Response IP 104.26.7.41
Found Yes
Hash 7aa18a9f31fd483a48a1014121a3061fb6980250db3353396a91330970caf766
SimHash 51cad2e44fbb

Groups

webcopier
dotbot
rogerbot
aspiegelbot
mj12bot
mail.ru_bot
adscanner

Rule Path
Disallow /

*

Rule Path
Disallow /store/gifs/
Disallow /Awardgifs/
Disallow /languages/frenchgifs/
Disallow /languages/spanishgifs/
Disallow /languages/languagegifs/
Disallow /sounds/
Disallow /store/gifs/
Disallow /Mitchell.html
Disallow /search/*?*query=
Disallow /*/ssi.shtml
Disallow /*/ssi/*
Disallow /subscribe?*
Disallow /subscribe/?*
Disallow /subscribe/index.shtml?*

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.EnchantedLearning.com/www-sitemap-index.xml

Comments

  • Bots blocked
  • Disallow: /agifs/ /bgifs/ /cgifs/ /dgifs/ /egifs/ /fgifs/ /ggifs/
  • Disallow: /hgifs/ /igifs/ /jgifs/ /kgifs/ /lgifs/ /mgifs/ /ngifs/
  • Disallow: /ogifs/ /pgifs/ /qgifs/ /rgifs/ /sgifs/ /tgifs/ /ugifs/
  • Disallow: /vgifs/ /wgifs/ /xgifs/ /ygifs/ /zgifs/
  • Disallow: /crafts/gifs/
  • Disallow: /jewel/gifs/