vercel.dev
robots.txt
Robots Exclusion Standard data for vercel.dev
Resource Scan
Scan Details
| Site Domain | vercel.dev |
| Base Domain | vercel.dev |
| Scan Status | Ok |
| Last Scan | 2024-11-15T16:39:01+00:00 |
| Next Scan | 2024-11-29T16:39:01+00:00 |
Last Scan
| Scanned | 2024-11-15T16:39:01+00:00 |
| URL | https://vercel.dev/robots.txt |
| Redirect | https://vercel.com/robots.txt |
| Redirect Domain | vercel.com |
| Redirect Base | vercel.com |
| Domain IPs | 76.76.21.93, 76.76.21.98 |
| Redirect IPs | 76.76.21.9, 76.76.21.93 |
| Response IP | 76.76.21.61 |
| Found | Yes |
| Hash | 170393616f3f174265d86277d71a7c7544128eff0f68e4ec95aee66fce2cde69 |
| SimHash | 25154714d5b3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /api/og/* |
| Allow | /api/templates/og* |
| Allow | /api/dynamic-og* |
| Allow | /api/www/avatar/* |
| Disallow | |
| Disallow | /api/ |
| Disallow | /oauth |
| Disallow | /confirm |
| Disallow | /notifications |
| Disallow | /old-browser.html |
| Disallow | /docs/concepts/payments-and-billing/usage-based-pro-plan |
| Disallow | /docs/concepts/projects/sensitive-environment-variables |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vercel.com/sitemap.xml |
Comments