vercel.com
robots.txt
Robots Exclusion Standard data for vercel.com
Resource Scan
Scan Details
| Site Domain | vercel.com |
| Base Domain | vercel.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T22:24:11+00:00 |
| Next Scan | 2024-11-17T22:24:11+00:00 |
Last Scan
| Scanned | 2024-11-03T22:24:11+00:00 |
| URL | https://vercel.com/robots.txt |
| Domain IPs | 76.76.21.164, 76.76.21.9 |
| Response IP | 76.76.21.9 |
| Found | Yes |
| Hash | 170393616f3f174265d86277d71a7c7544128eff0f68e4ec95aee66fce2cde69 |
| SimHash | 25154714d5b3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /api/og/* |
| Allow | /api/templates/og* |
| Allow | /api/dynamic-og* |
| Allow | /api/www/avatar/* |
| Disallow | |
| Disallow | /api/ |
| Disallow | /oauth |
| Disallow | /confirm |
| Disallow | /notifications |
| Disallow | /old-browser.html |
| Disallow | /docs/concepts/payments-and-billing/usage-based-pro-plan |
| Disallow | /docs/concepts/projects/sensitive-environment-variables |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vercel.com/sitemap.xml |
Comments