ypsilon.ee
robots.txt
Robots Exclusion Standard data for ypsilon.ee
Resource Scan
Scan Details
Site Domain | ypsilon.ee |
Base Domain | ypsilon.ee |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't establish SSL connection. |
Last Scan | 2024-09-28T10:45:04+00:00 |
Next Scan | 2024-11-27T10:45:04+00:00 |
Last Successful Scan
Scanned | 2024-07-31T10:44:17+00:00 |
URL | https://ypsilon.ee/robots.txt |
Domain IPs | 185.154.221.183, 185.154.221.184 |
Response IP | 185.154.221.184 |
Found | Yes |
Hash | e063e39b93bd339229540a7dad173aa901fa195eafb7ff9547fd7c7aa8924394 |
SimHash | 0b0f46604ba1 |
Groups
*
Rule | Path |
---|---|
Disallow | /search* |
Disallow | /latest/* |
Disallow | /*/print/* |
Disallow | /print/* |
Disallow | /*/com/* |
Disallow | /mobile/* |
Disallow | /rest/* |
Disallow | /feed/* |
Disallow | /weather/* |
Disallow | /?schedule=* |
Disallow | /author/* |
bingbot
msnbot
msnbot-media
yandexbot
ahrefsbot
seekportbot
Rule | Path |
---|---|
Disallow | /search* |
Disallow | /latest/* |
Disallow | /*/print/* |
Disallow | /print/* |
Disallow | /*/com/* |
Disallow | /mobile/* |
Disallow | /?schedule=* |
Disallow | /rest/* |
Disallow | /feed/* |
Disallow | /weather/* |
Disallow | /author/* |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://ypsilon.ee/sitemap |