allaboutnature.com
robots.txt
Robots Exclusion Standard data for allaboutnature.com
Resource Scan
Scan Details
Site Domain | allaboutnature.com |
Base Domain | allaboutnature.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-22T04:44:07+00:00 |
Next Scan | 2024-11-20T04:44:07+00:00 |
Last Successful Scan
Scanned | 2024-04-02T04:42:37+00:00 |
URL | http://allaboutnature.com/robots.txt |
Redirect | https://www.enchantedlearning.com/robots.txt |
Redirect Domain | www.enchantedlearning.com |
Redirect Base | enchantedlearning.com |
Domain IPs | 192.41.222.81 |
Redirect IPs | 104.26.6.41, 104.26.7.41, 172.67.69.108, 2606:4700:20::681a:629, 2606:4700:20::681a:729, 2606:4700:20::ac43:456c |
Response IP | 104.26.6.41 |
Found | Yes |
Hash | 7aa18a9f31fd483a48a1014121a3061fb6980250db3353396a91330970caf766 |
SimHash | 51cad2e44fbb |
Groups
*
Rule | Path |
---|---|
Disallow | /store/gifs/ |
Disallow | /Awardgifs/ |
Disallow | /languages/frenchgifs/ |
Disallow | /languages/spanishgifs/ |
Disallow | /languages/languagegifs/ |
Disallow | /sounds/ |
Disallow | /store/gifs/ |
Disallow | /Mitchell.html |
Disallow | /search/*?*query= |
Disallow | /*/ssi.shtml |
Disallow | /*/ssi/* |
Disallow | /subscribe?* |
Disallow | /subscribe/?* |
Disallow | /subscribe/index.shtml?* |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Other Records
Field | Value |
---|---|
sitemap | https://www.EnchantedLearning.com/www-sitemap-index.xml |
Comments