cdn-www.airliners.net
robots.txt

Robots Exclusion Standard data for cdn-www.airliners.net

Resource Scan

Scan Details

Site Domain cdn-www.airliners.net
Base Domain airliners.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-07T22:12:05+00:00
Next Scan 2025-05-06T22:12:05+00:00

Last Successful Scan

Scanned2023-06-24T15:37:34+00:00
URL http://cdn-www.airliners.net/robots.txt
Redirect https://www.airliners.net/robots.txt
Redirect Domain www.airliners.net
Redirect Base airliners.net
Domain IPs 23.209.46.11, 23.209.46.4
Redirect IPs 104.18.0.82, 104.18.1.82, 2606:4700::6812:152, 2606:4700::6812:52
Response IP 104.18.1.82
Found Yes
Hash d642d2483802042c42dfbf6fa99b7bc5456736e2c7835e3d2b3ee58f1005bbe7
SimHash e90498606f92

Groups

*

Rule Path
Disallow /search
Disallow /photo-details-carousel

Other Records

Field Value
sitemap https://www.airliners.net/sitemap/index.xml