como-llegar.org
robots.txt

Robots Exclusion Standard data for como-llegar.org

Resource Scan

Scan Details

Site Domain como-llegar.org
Base Domain como-llegar.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-03-10T23:48:04+00:00
Next Scan 2026-03-24T23:48:04+00:00

Last Successful Scan

Scanned2026-02-23T12:38:57+00:00
URL https://como-llegar.org/robots.txt
Domain IPs 104.21.27.10, 172.67.140.75, 2606:4700:3031::ac43:8c4b, 2606:4700:3036::6815:1b0a
Response IP 172.67.140.75
Found Yes
Hash 27c18740ee8465b9fcd24159da7c1ecce86b177e0bcfc6fa20aeadf3acdb7836
SimHash 421d9c61b61a

Groups

*

Rule Path
Allow /
Disallow /share/
Disallow /api/beacon
Disallow /api/kylmaepihlaja
Disallow /api/events
Disallow /api/relandersgrund

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /api/

Other Records

Field Value
crawl-delay 10

meta-webindexer

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml