ypsilon.ee
robots.txt

Robots Exclusion Standard data for ypsilon.ee

Resource Scan

Scan Details

Site Domain ypsilon.ee
Base Domain ypsilon.ee
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-28T10:45:04+00:00
Next Scan 2024-11-27T10:45:04+00:00

Last Successful Scan

Scanned2024-07-31T10:44:17+00:00
URL https://ypsilon.ee/robots.txt
Domain IPs 185.154.221.183, 185.154.221.184
Response IP 185.154.221.184
Found Yes
Hash e063e39b93bd339229540a7dad173aa901fa195eafb7ff9547fd7c7aa8924394
SimHash 0b0f46604ba1

Groups

*

Rule Path
Disallow /search*
Disallow /latest/*
Disallow /*/print/*
Disallow /print/*
Disallow /*/com/*
Disallow /mobile/*
Disallow /rest/*
Disallow /feed/*
Disallow /weather/*
Disallow /?schedule=*
Disallow /author/*

bingbot
msnbot
msnbot-media
yandexbot
ahrefsbot
seekportbot

Rule Path
Disallow /search*
Disallow /latest/*
Disallow /*/print/*
Disallow /print/*
Disallow /*/com/*
Disallow /mobile/*
Disallow /?schedule=*
Disallow /rest/*
Disallow /feed/*
Disallow /weather/*
Disallow /author/*

Other Records

Field Value
crawl-delay 60

mediapartners-google

Rule Path
Disallow

discobot
dotbot
yacybot
petalbot
semrushbot
grapeshot
barkrowler

Rule Path
Disallow *

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

femtosearchbot

Rule Path
Disallow *

Other Records

Field Value
sitemap https://ypsilon.ee/sitemap