airlineforums.com
robots.txt

Robots Exclusion Standard data for airlineforums.com

Resource Scan

Scan Details

Site Domain airlineforums.com
Base Domain airlineforums.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-31T02:54:37+00:00
Next Scan 2024-11-30T02:54:37+00:00

Last Successful Scan

Scanned2024-10-02T02:44:20+00:00
URL https://airlineforums.com/robots.txt
Redirect https://www.airlineforums.com/robots.txt
Redirect Domain www.airlineforums.com
Redirect Base airlineforums.com
Domain IPs 104.21.51.83, 172.67.177.148, 2606:4700:3032::6815:3353, 2606:4700:3037::ac43:b194
Redirect IPs 104.21.51.83, 172.67.177.148, 2606:4700:3032::6815:3353, 2606:4700:3037::ac43:b194
Response IP 104.21.51.83
Found Yes
Hash 9821516a5eb84d755b79714fefd4b0048247af7b7912d04c113bdc11bf670de2
SimHash 003ec4c3af03

Groups

petalbot
aspiegelbot
ahrefsbot
semrushbot
semrush
dotbot
mauibot
mj12bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /threads/*/reply

*

Rule Path
Disallow /whats-new/
Disallow /account/
Disallow /members/
Disallow /attachments/
Disallow /goto/
Disallow /help/
Disallow /posts/
Disallow /login/
Disallow /search/
Disallow /admin.php
Allow /

Other Records

Field Value
sitemap https://www.airlineforums.com/sitemap.xml