Log In Sign Up

aviation.direct
robots.txt

Robots Exclusion Standard data for aviation.direct

Resource Scan

Scan Details

Site Domain aviation.direct
Base Domain aviation.direct
Scan Status Ok
Last Scan2024-10-01T14:33:09+00:00
Next Scan 2024-10-08T14:33:09+00:00

Last Scan

Scanned2024-10-01T14:33:09+00:00
URL https://aviation.direct/robots.txt
Domain IPs 104.21.60.2, 172.67.186.161, 2606:4700:3031::6815:3c02, 2606:4700:3034::ac43:baa1
Response IP 104.21.60.2
Found Yes
Hash d469b4b5fca0f59aea7573ae3503a4aa3eb3be91d9a2399c76833042be5146d4
SimHash 12dc4e607628

Groups

suggybot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

kraken

Rule Path
Disallow /

genieo

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

r6_feedfetcher

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

yeti

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seobility

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

ssearch crawler

Rule Path
Disallow /

publiclibraryarchive

Rule Path
Disallow /

publiclibraryarchive.org

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

wesee

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

netlyzer fastprobe

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /
Back to top