ecosia.org
robots.txt

Robots Exclusion Standard data for ecosia.org

Resource Scan

Scan Details

Site Domain ecosia.org
Base Domain ecosia.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-20T00:48:14+00:00
Next Scan 2024-08-18T00:48:14+00:00

Last Successful Scan

Scanned2024-01-14T20:58:56+00:00
URL https://ecosia.org/robots.txt
Redirect https://www.ecosia.org/robots.txt
Redirect Domain www.ecosia.org
Redirect Base ecosia.org
Domain IPs 15.157.139.102, 15.157.85.207, 35.183.216.24
Redirect IPs 104.18.37.185, 172.64.150.71, 2606:4700:4400::6812:25b9, 2606:4700:4400::ac40:9647
Response IP 104.18.37.185
Found Yes
Hash dea20d4acce21af439373d0a5f458ef7632ab97b2d81bf2460cc4fd9dd77b60c
SimHash 0030d03277c4

Groups

*

Rule Path
Disallow /search
Disallow /videos
Disallow /images
Disallow /news
Disallow /map
Disallow /maps
Disallow /google
Disallow /settings
Disallow /firstrun
Disallow /uninstall
Disallow /account/*
Disallow /shopping

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /

twitterbot

Rule Path
Allow /search?*&cpr=*
Allow /search?cpr=*