vanityfair.com
robots.txt
Robots Exclusion Standard data for vanityfair.com
Resource Scan
Scan Details
| Site Domain | vanityfair.com |
| Base Domain | vanityfair.com |
| Scan Status | Ok |
| Last Scan | 2024-11-01T15:01:03+00:00 |
| Next Scan | 2024-11-08T15:01:03+00:00 |
Last Scan
| Scanned | 2024-11-01T15:01:03+00:00 |
| URL | https://vanityfair.com/robots.txt |
| Redirect | https://www.vanityfair.com/robots.txt |
| Redirect Domain | www.vanityfair.com |
| Redirect Base | vanityfair.com |
| Domain IPs | 151.101.0.239, 151.101.128.239, 151.101.192.239, 151.101.64.239 |
| Redirect IPs | 13.35.210.123, 13.35.210.25, 13.35.210.57, 13.35.210.8, 2600:9000:2078:4800:f:ad27:1740:93a1, 2600:9000:2078:5800:f:ad27:1740:93a1, 2600:9000:2078:5c00:f:ad27:1740:93a1, 2600:9000:2078:9000:f:ad27:1740:93a1, 2600:9000:2078:9a00:f:ad27:1740:93a1, 2600:9000:2078:b000:f:ad27:1740:93a1, 2600:9000:2078:ce00:f:ad27:1740:93a1, 2600:9000:2078:fc00:f:ad27:1740:93a1 |
| Response IP | 13.35.210.123 |
| Found | Yes |
| Hash | ac411faa3de5354614b7de4da9cd730afb9a7c71cac27fd32dadf5f3a8820d7e |
| SimHash | 441ac153f682 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/amp |
| Disallow | /api/ |
| Disallow | /data/ |
| Disallow | /user/ |
| Disallow | /ontheweb/blogs/delineator |
| Disallow | /preview/ |
| Disallow | /search? |
| Disallow | /search/ |
| Disallow | /video/right_rail* |
| Disallow | /*?redirectURL= |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /product/ |
| Disallow | /journey/compiler/amp/iframe.html |
| Disallow | /api/search?page= |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
| Disallow | /com.condenast/yv8* |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | /branded/ |
| Allow | /*/amp |
| Disallow | /search? |
| Disallow | /search/ |
| Disallow | /*?redirectURL= |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /product/ |
| Disallow | /journey/compiler/amp/iframe.html |
| Disallow | /api/search?page= |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
googlebot
| Rule | Path |
|---|---|
| Allow | /*/amp |
| Disallow | /search? |
| Disallow | /search/ |
| Disallow | /*?redirectURL= |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /product/ |
| Disallow | /journey/compiler/amp/iframe.html |
| Disallow | /api/search?page= |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
| Disallow | /preview/ |
bingbot
| Rule | Path |
|---|---|
| Allow | /*/amp |
| Disallow | /*?redirectURL= |
| Disallow | /search? |
| Disallow | /search/ |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /product/ |
| Disallow | /journey/compiler/amp/iframe.html |
| Disallow | /api/search?page= |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vanityfair.com/sitemap.xml |
| sitemap | https://www.vanityfair.com/branded-sitemap.xml |
| sitemap | https://www.vanityfair.com/sitemap/people.xml |
| sitemap | https://www.vanityfair.com/feed/google-latest-news/sitemap-google-news |
| sitemap | https://www.vanityfair.com/categories-sitemap.xml |
| sitemap | https://www.vanityfair.com/contributors-sitemap.xml |
| sitemap | https://www.vanityfair.com/bundles-sitemap.xml |
| sitemap | https://www.vanityfair.com/sitemap-archive-1.xml |