smartfares.com
robots.txt
Robots Exclusion Standard data for smartfares.com
Resource Scan
Scan Details
Site Domain | smartfares.com |
Base Domain | smartfares.com |
Scan Status | Ok |
Last Scan | 2025-08-23T11:07:46+00:00 |
Next Scan | 2025-09-22T11:07:46+00:00 |
Last Scan
Scanned | 2025-08-23T11:07:46+00:00 |
URL | https://smartfares.com/robots.txt |
Redirect | https://www.smartfares.com/robots.txt |
Redirect Domain | www.smartfares.com |
Redirect Base | smartfares.com |
Domain IPs | 104.26.0.31, 104.26.1.31, 172.67.75.107 |
Redirect IPs | 104.26.0.31, 104.26.1.31, 172.67.75.107 |
Response IP | 104.26.1.31 |
Found | Yes |
Hash | bf0e34f15fc4c3e559b9a42c9e7c918f1ac80e862705aa209a1216c76ff10ac0 |
SimHash | 2845c414e9d4 |
Groups
*
Rule | Path |
---|---|
Disallow | /WebResource.axd |
Disallow | /ScriptResource.axd |
Disallow | /airlines/jetblue.html |