newyorkomg.com
robots.txt
Robots Exclusion Standard data for newyorkomg.com
Resource Scan
Scan Details
| Site Domain | newyorkomg.com |
| Base Domain | newyorkomg.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-12T14:54:05+00:00 |
| Next Scan | 2024-07-11T14:54:05+00:00 |
Last Successful Scan
| Scanned | 2023-05-26T08:03:07+00:00 |
| URL | http://newyorkomg.com/robots.txt |
| Redirect | http://www.bookingbuddy.com/robots.txt |
| Redirect Domain | www.bookingbuddy.com |
| Redirect Base | bookingbuddy.com |
| Domain IPs | 34.224.54.119 |
| Redirect IPs | 23.215.7.14, 23.215.7.29 |
| Response IP | 23.33.92.140 |
| Found | Yes |
| Hash | 10f94641d52e449ab63d30a16aafd3cd609fd50250e3dcfce6770ed824a11c0e |
| SimHash | e14ccf64d7f5 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ads |
| Disallow | /adservice/ |
| Disallow | /akamai-sureroute-test-object.htm |
| Disallow | /api |
| Disallow | /admin |
| Disallow | /c/ |
| Disallow | /destinations/ |
| Disallow | /destinations.php |
| Disallow | /edgecast-route-object.html |
| Disallow | /fares/ |
| Disallow | /hotel_listings.php |
| Disallow | /hotel_specific.php |
| Disallow | /metapartnerlist |
| Disallow | /partnerlistapi |
| Disallow | /r/ |
| Disallow | /search.php |
| Disallow | /t/ |
| Disallow | /top-travel-deals-2/ |
| Disallow | /top-travel-deals-3/ |
| Disallow | /top-travel-deals-4/ |
| Disallow | /top-travel-deals-5/ |
| Disallow | /travel-deals/ |
| Disallow | /travel_deals |
| Disallow | /travel-guides/ |
| Disallow | /widgets/ |