airliners.de
robots.txt
Robots Exclusion Standard data for airliners.de
Resource Scan
Scan Details
Site Domain | airliners.de |
Base Domain | airliners.de |
Scan Status | Ok |
Last Scan | 2024-05-23T20:10:38+00:00 |
Next Scan | 2024-05-30T20:10:38+00:00 |
Last Scan
Scanned | 2024-05-23T20:10:38+00:00 |
URL | https://airliners.de/robots.txt |
Redirect | https://www.airliners.de/robots.txt |
Redirect Domain | www.airliners.de |
Redirect Base | airliners.de |
Domain IPs | 134.119.0.225, 2a00:1158:5:e1:: |
Redirect IPs | 134.119.0.225, 2a00:1158:5:e1:: |
Response IP | 134.119.0.225 |
Found | Yes |
Hash | f762aecab9081f7948701a34d04568359e08aa2df06025895276e2860cb0fa1b |
SimHash | 4836c0d240a0 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /karriere/r/ |
Disallow | /nova/ |
Disallow | /admin/ |
Disallow | /backend/ |
Disallow | /vendor/ |
Disallow | /settings/* |
Disallow | /page-cache/* |
Disallow | /firmen/*/visit/* |
Disallow | /*?*refinementList |
Disallow | /suche |