Log In Sign Up

fxtwitter.com
robots.txt

Robots Exclusion Standard data for fxtwitter.com

Resource Scan

Scan Details

Site Domain fxtwitter.com
Base Domain fxtwitter.com
Scan Status Ok
Last Scan2025-07-08T09:53:27+00:00
Next Scan 2025-07-22T09:53:27+00:00

Last Scan

Scanned2025-07-08T09:53:27+00:00
URL https://fxtwitter.com/robots.txt
Domain IPs 104.21.87.14, 172.67.139.37, 2606:4700:3033::6815:570e, 2606:4700:3037::ac43:8b25
Response IP 172.67.139.37
Found Yes
Hash b8db72a32a6e70899c5725b814664e5be2d79c96be391ad46f11bfbd84dd95d3
SimHash 01c421170fd2

Groups

yandexbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow

*

Rule Path
Allow /$
Disallow /*/status
Disallow /*/status/
Disallow /profile
Disallow /profile/
Disallow /owoembed
Disallow /owoembed/
Allow /watch?v=dQw4w9WgXcQ
Back to top

Comments

  • /-------------------------------------------\
  • | _______ |
  • | | | |
  • | | | I'm a robot |
  • | |_____| antiCAPTCHA |
  • | Privacy | Terms |
  • \-------------------------------------------/
  • Do you breathe air? Are you a human? Do you know how to write code?
  • Do you want an easy way to fetch posts but Elon Musk wants to charge you $100 per month?
  • Did you know we have a fetch API you can use for free, no API keys required?
  • Check out the docs at https://api.fxtwitter.com to learn how to use it
  • Good luck, have fun and try not to take over the world!
  • Instructions below are for robots only, beep boop
  • ==========================================================================
  • Yandex crawls far, far heavier than Googlebot and Bingbot combined
  • Large language models are friendly
  • Oembeds are not crawler friendly
  • 0100011101101111011011110110010000100000011000100110111101110100
Back to top