privatefly.com
robots.txt
Robots Exclusion Standard data for privatefly.com
Resource Scan
Scan Details
Site Domain | privatefly.com |
Base Domain | privatefly.com |
Scan Status | Ok |
Last Scan | 2024-06-19T05:48:38+00:00 |
Next Scan | 2024-07-19T05:48:38+00:00 |
Last Scan
Scanned | 2024-06-19T05:48:38+00:00 |
URL | https://privatefly.com/robots.txt |
Redirect | https://www.privatefly.com:443/robots.txt |
Redirect Domain | www.privatefly.com |
Redirect Base | privatefly.com |
Domain IPs | 52.17.123.240, 52.30.224.53 |
Redirect IPs | 108.156.133.25, 108.156.133.71, 108.156.133.73, 108.156.133.80 |
Response IP | 108.156.133.80 |
Found | Yes |
Hash | 379bcd261935b68d258ad13243a375ec1a5bf677ae57b587600d082af27b9079 |
SimHash | 1d1085229dc0 |
Groups
*
Rule | Path |
---|---|
Disallow | /opencms/* |
Disallow | /*OpenLogin%3D |
Disallow | /*?OpenLogin |
Disallow | /*?OpenNewLogin=true |
Disallow | /Home/home.html |
Disallow | /private-jet-charter/estimate-prices.html |
Disallow | /private-jet-charter/estimate-prices.html?* |
Disallow | /*?OpenLogin=true |
Disallow | /customer/* |
Disallow | /operator/* |
Disallow | /aviation/* |
Disallow | /test/* |
Disallow | /*%26sort%3D1 |
Disallow | /*%26selectSortOrder%3D1 |
Disallow | /?gclid=* |
Disallow | /operator-email/* |
Disallow | /.content/* |
Disallow | /page-data/* |
Disallow | /private-jet-charter/usa-domestic-flights* |
Disallow | /business-aviation/jet-card-fuel-surcharge* |
Disallow | /client-manual* |
Disallow | *?utm_ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments