flightrising.com
robots.txt
Robots Exclusion Standard data for flightrising.com
Resource Scan
Scan Details
Site Domain | flightrising.com |
Base Domain | flightrising.com |
Scan Status | Ok |
Last Scan | 2024-05-12T16:59:48+00:00 |
Next Scan | 2024-05-19T16:59:48+00:00 |
Last Scan
Scanned | 2024-05-12T16:59:48+00:00 |
URL | https://flightrising.com/robots.txt |
Domain IPs | 199.58.85.136 |
Response IP | 199.58.85.136 |
Found | Yes |
Hash | e0319fe73a7f3b6e4ed5f2432281f94021bf9b2ff288793d27b5164f68685a76 |
SimHash | a5da988a17c6 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /cgi-bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
Comments