vegas.com
robots.txt
Robots Exclusion Standard data for vegas.com
Resource Scan
Scan Details
| Site Domain | vegas.com |
| Base Domain | vegas.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T21:39:28+00:00 |
| Next Scan | 2024-11-22T21:39:28+00:00 |
Last Scan
| Scanned | 2024-11-15T21:39:28+00:00 |
| URL | https://vegas.com/robots.txt |
| Redirect | https://www.vegas.com/robots.txt |
| Redirect Domain | www.vegas.com |
| Redirect Base | vegas.com |
| Domain IPs | 96.17.96.17, 96.17.96.8 |
| Redirect IPs | 23.32.29.16, 96.17.180.45 |
| Response IP | 96.17.180.45 |
| Found | Yes |
| Hash | 2ed5a69246c386be689dcddde6f63aed4afcfcc8f3e3b4d6c53c247359181de3 |
| SimHash | b8313a340513 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | /mb/app/PackageSearch | - |
| Allow | /iv2/static/*.js | - |
| Disallow | /cgi-bin/AT | old search engine |
| Disallow | /users | the users' home pages |
| Disallow | /test | - |
| Disallow | /Architext | - |
| Disallow | /sunbin | - |
| Disallow | /myaccount | - |
| Disallow | /mytrip/app | - |
| Disallow | /mb/app | - |
| Disallow | /incl | - |
| Disallow | /event.ng | - |
| Disallow | /mq | - |
| Disallow | /cgi-bin | - |
| Disallow | /baweb/op_index.html | - |
| Disallow | /searchagent/event/ViewShowOpts.do | - |
| Disallow | /searchagent/event/SearchShowOpts.do | - |
| Disallow | /searchagent/event/SearchShows.do | - |
| Disallow | /searchagent/event/SearchResultView.do | - |
| Disallow | /searchagent/event/NewSearch.do | - |
| Disallow | /searchagent/restaurant/SearchRestaurants.do | - |
| Disallow | /google/hotel_ads | - |
| Disallow | /lounge/centennial/crimemoments.html | - |
| Disallow | /slideshows | - |
| Disallow | /about/executivebios.html | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
mediapartners-google
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin/AT | old search engine |
| Disallow | /users | the users' home pages |
| Disallow | /test | - |
| Disallow | /Architext | - |
| Disallow | /sunbin | - |
| Disallow | /myaccount | - |
| Disallow | /incl | - |
| Disallow | /event.ng | - |
| Disallow | /mq | - |
| Disallow | /cgi-bin | - |
| Disallow | /baweb/op_index.html | - |
| Disallow | /searchagent/event/ViewShowOpts.do | - |
| Disallow | /searchagent/event/SearchShowOpts.do | - |
| Disallow | /searchagent/event/SearchShows.do | - |
| Disallow | /searchagent/event/SearchResultView.do | - |
| Disallow | /searchagent/event/NewSearch.do | - |
| Disallow | /google/hotel_ads | - |
| Disallow | /slideshows | - |
| Disallow | /about/executivebios.html | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vegas.com/sitemap_https.xml |
Comments