holidaytravel.co
robots.txt
Robots Exclusion Standard data for holidaytravel.co
Resource Scan
Scan Details
Site Domain | holidaytravel.co |
Base Domain | holidaytravel.co |
Scan Status | Ok |
Last Scan | 2024-10-28T12:58:42+00:00 |
Next Scan | 2024-11-04T12:58:42+00:00 |
Last Scan
Scanned | 2024-10-28T12:58:42+00:00 |
URL | https://www.holidaytravel.co/robots.txt |
Domain IPs | 108.156.133.118, 108.156.133.32, 108.156.133.51, 108.156.133.67, 2600:9000:2755:3200:14:29a:8a40:93a1, 2600:9000:2755:600:14:29a:8a40:93a1, 2600:9000:2755:6800:14:29a:8a40:93a1, 2600:9000:2755:8e00:14:29a:8a40:93a1, 2600:9000:2755:9e00:14:29a:8a40:93a1, 2600:9000:2755:bc00:14:29a:8a40:93a1, 2600:9000:2755:f800:14:29a:8a40:93a1, 2600:9000:2755:fe00:14:29a:8a40:93a1 |
Response IP | 108.156.133.118 |
Found | Yes |
Hash | a5044c4c26e958c5b7849f1bf985f1b2d70cc67278635483e7ed9ced14ae5bed |
SimHash | 6ba8768f8283 |
Groups
*
Rule | Path |
---|---|
Disallow | /sitepanel |
Disallow | /affadmin |
Disallow | /php_paypal |
Disallow | /payu |
Disallow | /data-trace |
Disallow | /SpryAssets |
Disallow | /Library |
Disallow | /article-dtl-shimla_manali_call_girl_escort_service_an_investigative_report-41.htm |
Disallow | /destination-dtl/manali_cream_malana_cream.htm |
Disallow | /article-dtl-construction_status_in_ajman_emirates_city_uae-79.htm |
*
Rule | Path |
---|---|
Disallow | /*.php$ |
*
Rule | Path |
---|---|
Disallow | /*?$ |
*
Rule | Path |
---|---|
Disallow | /*tid$ |
*
Rule | Path |
---|---|
Disallow | /*pid$ |
*
Rule | Path |
---|---|
Disallow | /*hid$ |
*
Rule | Path |
---|---|
Disallow | /*loc_ids$ |
*
Rule | Path |
---|---|
Disallow | /*htmlName$ |
*
Rule | Path |
---|---|
Disallow | /*start$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.holidaytravel.co/sitemap.xml |
Warnings
- 2 invalid lines.