planeflighttracker.com
robots.txt

Robots Exclusion Standard data for planeflighttracker.com

Resource Scan

Scan Details

Site Domain planeflighttracker.com
Base Domain planeflighttracker.com
Scan Status Ok
Last Scan2025-12-30T20:12:04+00:00
Next Scan 2026-01-06T20:12:04+00:00

Last Scan

Scanned2025-12-30T20:12:04+00:00
URL https://planeflighttracker.com/robots.txt
Redirect https://www.planeflighttracker.com/robots.txt
Redirect Domain www.planeflighttracker.com
Redirect Base planeflighttracker.com
Domain IPs 104.21.51.112, 172.67.179.129, 2606:4700:3030::ac43:b381, 2606:4700:3031::6815:3370
Redirect IPs 104.21.51.112, 172.67.179.129, 2606:4700:3030::ac43:b381, 2606:4700:3031::6815:3370
Response IP 104.21.51.112
Found Yes
Hash dc9f8f1d6291fe74da4750f6a747c0b5a61ca9b215961434c7205402dbb19e1e
SimHash 685ad900e294

Groups

*

Rule Path
Disallow

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

seekr

Rule Path
Disallow /

Comments

  • Block Open AI
  • Block Google (Gemini)
  • Block Claude
  • Block CommonCrawl
  • Block Diffbot
  • Block Meta (Facebook)
  • Block ByteDance
  • Block Webz.io
  • Block ImagesiftBot
  • Block Meltwater
  • Block Seekr