city-discovery.com
robots.txt
Robots Exclusion Standard data for city-discovery.com
Resource Scan
Scan Details
Site Domain | city-discovery.com |
Base Domain | city-discovery.com |
Scan Status | Ok |
Last Scan | 2024-06-06T05:09:49+00:00 |
Next Scan | 2024-06-13T05:09:49+00:00 |
Last Scan
Scanned | 2024-06-06T05:09:49+00:00 |
URL | https://www.city-discovery.com/robots.txt |
Redirect | https://www.veltra.com/robots.txt |
Redirect Domain | www.veltra.com |
Redirect Base | veltra.com |
Domain IPs | 46.51.227.40, 52.196.39.24, 54.92.45.239 |
Redirect IPs | 54.192.18.111, 54.192.18.14, 54.192.18.58, 54.192.18.84 |
Response IP | 52.84.229.119 |
Found | Yes |
Hash | 141e63400c29073afc22df93400025b2b443b8af9bec20fde5e19597fdc2355b |
SimHash | 0d545bb14119 |
Groups
googlebot
Rule | Path |
---|---|
Allow | /*.html |
Disallow | /vtr/ |
Disallow | /ptr/ |
Disallow | /jp/booking/ |
Disallow | /en/booking/ |
Disallow | /tw/booking/ |
Disallow | /cn/booking/ |
Disallow | /jp/member_reviews/ |
Disallow | /en/member_reviews/ |
Disallow | /jp/search |
Disallow | /en/search |
Disallow | */search?kw= |
Disallow | */reviews/page |
Disallow | */st%3A |
Disallow | *utm_source%3D |
Disallow | *utm_medium%3D |
Disallow | *sid%3D |
Disallow | /*aggregate |
Disallow | /*jserrors |
Disallow | /*session_trace |
Disallow | /*metrics |
Disallow | /*ajax |
Disallow | *?AccessType=pc |
Disallow | /*.html/ |
Disallow | */spot-*/?* |
slurp
Rule | Path |
---|---|
Disallow | /vtr/ |
Disallow | /ptr/ |
Disallow | /jp/search |
Disallow | /en/search |
Disallow | */search?kw= |
Disallow | /jp/booking/ |
Disallow | /en/booking/ |
Disallow | /tw/booking/ |
Disallow | /cn/booking/ |
Disallow | *?AccessType=pc |
Disallow | */spot-*/?* |
msnbot
Rule | Path |
---|---|
Disallow | /vtr/ |
Disallow | /ptr/ |
Disallow | /jp/search |
Disallow | /en/search |
Disallow | */search?kw= |
Disallow | /jp/booking/ |
Disallow | /en/booking/ |
Disallow | /tw/booking/ |
Disallow | /cn/booking/ |
Disallow | *?AccessType=pc |
Disallow | */spot-*/?* |
*
Rule | Path |
---|---|
Disallow | /jp/member_reviews/ |
Disallow | /en/member_reviews/ |
Disallow | /vtr/ |
Disallow | /ptr/ |
Disallow | /jp/search |
Disallow | /en/search |
Disallow | */search?kw= |
Disallow | /jp/booking/ |
Disallow | /en/booking/ |
Disallow | /tw/booking/ |
Disallow | /cn/booking/ |
Disallow | *?AccessType=pc |
Disallow | */spot-*/?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.veltra.com/sitemap.xml |