vimeo.com
robots.txt
Robots Exclusion Standard data for vimeo.com
Resource Scan
Scan Details
| Site Domain | vimeo.com |
| Base Domain | vimeo.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T01:51:29+00:00 |
| Next Scan | 2024-11-22T01:51:29+00:00 |
Last Scan
| Scanned | 2024-11-15T01:51:29+00:00 |
| URL | https://vimeo.com/robots.txt |
| Domain IPs | 162.159.128.61, 162.159.138.60 |
| Response IP | 162.159.138.60 |
| Found | Yes |
| Hash | 31e14d3729f587d5d8a94aebc5af3607b86ee4092ecde2628a2f11b24e177dc9 |
| SimHash | 4e62d370f2b4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */format%3Athumbnail |
| Disallow | /download/ |
| Disallow | /*/download? |
| Disallow | /couchmode/ |
| Disallow | /groups/*/forum/* |
| Disallow | /musicstore/preview |
| Disallow | /musicstore/download |
| Disallow | /forgot_password |
| Disallow | /help/forgot_login |
| Disallow | /help/verify_email |
| Disallow | /help/zendesk_sso |
| Disallow | /help/sso |
| Disallow | /user/verify |
| Disallow | /search |
| Disallow | /_* |
| Allow | /_rv/viewer |
| Allow | /_next/viewer |
| Allow | /_rv/gtm |
| Allow | /_next/gtm |
| Allow | /_global_notifications |
| Allow | /_rv/jwt |
| Allow | /_next/jwt |
| Allow | /_rv/title |
| Allow | /_next/title |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
seznambot
| Rule | Path |
|---|---|
| Disallow | */format%3Athumbnail |
| Disallow | /download/ |
| Disallow | /*/download? |
| Disallow | /couchmode/ |
| Disallow | /musicstore/preview |
| Disallow | /musicstore/download |
| Disallow | /forgot_password |
| Disallow | /help/forgot_login |
| Disallow | /help/verify_email |
| Disallow | /help/zendesk_sso |
| Disallow | /help/sso |
| Disallow | /api/ |
| Disallow | /user/verify |
| Disallow | /search/ |
| Disallow | /search? |
| Disallow | /search%5C? |
| Disallow | /_* |
Warnings
- `request-rate` is not a known field.
Comments