Log In Sign Up

bebop.app
robots.txt

Robots Exclusion Standard data for bebop.app

Resource Scan

Scan Details

Site Domain bebop.app
Base Domain bebop.app
Scan Status Ok
Last Scan2026-03-03T05:52:21+00:00
Next Scan 2026-03-10T05:52:21+00:00

Last Scan

Scanned2026-03-03T05:52:21+00:00
URL https://bebop.app/robots.txt
Domain IPs 2a01:4f8:1c19:f1e5::1, 46.225.99.147
Response IP 46.225.99.147
Found Yes
Hash ec14006e0ad7b2b67134b7881569fc8a61c81dc6db238b498f43972937ff2479
SimHash 6e1c1d97a7a5

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /admin_users/
Disallow /admin/jobs
Disallow /admin/firebase/
Disallow /admin/firebase
Disallow /mollie_webhook/
Disallow /rails/
Disallow /*.json$
Disallow /*?*sort=
Disallow /*?*page=
Disallow /*?*filter=
Disallow /*?*ref=
Disallow /*?*utm_
Disallow /*?*fbclid=
Allow /assets/
Allow /images/
Allow /static/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://bebop.app/sitemap.xml
Back to top

Comments

  • Bebop Website - robots.txt
  • Allow all bots to crawl public content
  • Disallow admin and internal areas
  • Disallow Firebase internal dashboard
  • Disallow webhook endpoints
  • Disallow Rails internal paths
  • Disallow file downloads and duplicate content
  • Allow specific public resources
  • Crawl delay and request rate
  • Sitemap location
Back to top