flight-fare.com
robots.txt

Robots Exclusion Standard data for flight-fare.com

Resource Scan

Scan Details

Site Domain flight-fare.com
Base Domain flight-fare.com
Scan Status Ok
Last Scan2024-10-07T04:57:44+00:00
Next Scan 2024-10-14T04:57:44+00:00

Last Scan

Scanned2024-10-07T04:57:44+00:00
URL https://flight-fare.com/robots.txt
Redirect https://www.flight-fare.com:443/robots.txt
Redirect Domain www.flight-fare.com
Redirect Base flight-fare.com
Domain IPs 23.21.114.70, 3.231.124.225, 35.168.253.47, 44.219.157.184, 52.0.86.65, 54.82.254.49
Redirect IPs 23.21.114.70, 3.231.124.225, 35.168.253.47, 44.219.157.184, 52.0.86.65, 54.82.254.49
Response IP 52.0.86.65
Found Yes
Hash 436293c2df500628f40ca14f369cc556d6a8ba1dc84007834bbb8438b960c762
SimHash ac5ccbace213

Groups

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /components/

Comments

  • Baiduspider