flightsfrom.com
robots.txt
Robots Exclusion Standard data for flightsfrom.com
Resource Scan
Scan Details
Site Domain | flightsfrom.com |
Base Domain | flightsfrom.com |
Scan Status | Ok |
Last Scan | 2024-11-09T21:14:05+00:00 |
Next Scan | 2024-11-16T21:14:05+00:00 |
Last Scan
Scanned | 2024-11-09T21:14:05+00:00 |
URL | https://flightsfrom.com/robots.txt |
Redirect | https://www.flightsfrom.com/robots.txt |
Redirect Domain | www.flightsfrom.com |
Redirect Base | flightsfrom.com |
Domain IPs | 172.66.40.202, 172.66.43.54, 2606:4700:3108::ac42:28ca, 2606:4700:3108::ac42:2b36 |
Redirect IPs | 172.66.40.202, 172.66.43.54, 2606:4700:3108::ac42:28ca, 2606:4700:3108::ac42:2b36 |
Response IP | 172.66.43.54 |
Found | Yes |
Hash | f57dd096fb30b4145aedaa9dd74f85fbf2e3e6a591d08c305011930463ace385 |
SimHash | 6015e0606697 |
Groups
*
Rule | Path |
---|---|
Disallow | /outbound/* |
Disallow | /outbound* |
Disallow | /explorer/* |
Disallow | /classic/* |
Disallow | /ads/* |
Disallow | /book* |
Disallow | /content/* |
Disallow | /r/* |
Disallow | /fr/* |
Disallow | /api/* |
Disallow | /api/airport/* |