bsky.chat
robots.txt

Robots Exclusion Standard data for bsky.chat

Resource Scan

Scan Details

Site Domain bsky.chat
Base Domain bsky.chat
Scan Status Ok
Last Scan2025-09-08T13:56:47+00:00
Next Scan 2025-09-22T13:56:47+00:00

Last Scan

Scanned2025-09-08T13:56:47+00:00
URL https://bsky.chat/robots.txt
Redirect https://bsky.app/robots.txt
Redirect Domain bsky.app
Redirect Base bsky.app
Domain IPs 216.24.57.1
Redirect IPs 18.220.64.149, 18.221.43.6, 3.14.49.37
Response IP 18.221.43.6
Found Yes
Hash 1aadb55636f887e2bc10ea9b73f86df10c5081052693f97656cd6686c2460288
SimHash ae128e504547

Groups

*

Rule Path
Allow /

Comments

  • Hello Friends!
  • If you are considering bulk or automated crawling, you may want to look in
  • to our protocol (API), including a firehose of updates. See: https://atproto.com/
  • By default, may crawl anything on this domain. HTTP 429 ("backoff") status
  • codes are used for rate-limiting. Up to a handful concurrent requests should
  • be ok.