developer.vimeo.com
robots.txt

Robots Exclusion Standard data for developer.vimeo.com

Resource Scan

Scan Details

Site Domain developer.vimeo.com
Base Domain vimeo.com
Scan Status Ok
Last Scan2024-11-17T16:05:27+00:00
Next Scan 2024-12-01T16:05:27+00:00

Last Scan

Scanned2024-11-17T16:05:27+00:00
URL https://developer.vimeo.com/robots.txt
Domain IPs 162.159.128.61, 162.159.138.60
Response IP 162.159.138.60
Found Yes
Hash 9312efa51daed11c23646aad0cfc0a7de0ad6844a17942255f738ee4c16ab531
SimHash 7e1152444077

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

seznambot

Rule Path
Disallow

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

adidxbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

bingpreview

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://developer.vimeo.com/sitemap.xml

Comments

  • You know, for robots
  • robots@developer.vimeo.com

Warnings

  • `request-rate` is not a known field.