vercel.dev
robots.txt
Robots Exclusion Standard data for vercel.dev
Resource Scan
Scan Details
| Site Domain | vercel.dev |
| Base Domain | vercel.dev |
| Scan Status | Ok |
| Last Scan | 2024-06-28T01:49:58+00:00 |
| Next Scan | 2024-07-12T01:49:58+00:00 |
Last Scan
| Scanned | 2024-06-28T01:49:58+00:00 |
| URL | https://vercel.dev/robots.txt |
| Redirect | https://vercel.com/robots.txt |
| Redirect Domain | vercel.com |
| Redirect Base | vercel.com |
| Domain IPs | 76.76.21.61, 76.76.21.98 |
| Redirect IPs | 76.76.21.93, 76.76.21.98 |
| Response IP | 76.76.21.241 |
| Found | Yes |
| Hash | d0f667960cacc013e6e05501741b5a4438fe38542695da9d977a527d705fe5b5 |
| SimHash | 2c15479cf7b3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /api/og/* |
| Allow | /api/dynamic-og* |
| Allow | /api/www/avatar/* |
| Disallow | |
| Disallow | /api/ |
| Disallow | /oauth |
| Disallow | /confirm |
| Disallow | /notifications |
| Disallow | /old-browser.html |
| Disallow | /docs/concepts/payments-and-billing/usage-based-pro-plan |
| Disallow | /docs/concepts/projects/sensitive-environment-variables |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vercel.com/sitemap.xml |
Comments