Log In Sign Up

funi.ai
robots.txt

Robots Exclusion Standard data for funi.ai

Resource Scan

Scan Details

Site Domain funi.ai
Base Domain funi.ai
Scan Status Ok
Last Scan2025-06-19T04:02:13+00:00
Next Scan 2025-07-03T04:02:13+00:00

Last Scan

Scanned2025-06-19T04:02:13+00:00
URL https://funi.ai/robots.txt
Domain IPs 104.18.10.111, 104.18.11.111, 2606:4700::6812:a6f, 2606:4700::6812:b6f
Response IP 104.18.10.111
Found Yes
Hash 9dcdb6657eb183ee879d7bf7a91b6852369f8f258a815e9681ea02621226ec4c
SimHash 6108c8d187f4

Groups

*

Rule Path
Allow /
Disallow /auth/
Disallow /settings/
Disallow /listing/
Disallow /coming-soon/
Disallow /payment/
Disallow /error
Disallow /500
Disallow /404

googlebot

Rule Path
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.ico

bingbot

Rule Path
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.ico
Back to top

Other Records

Field Value
sitemap https://funi.ai/sitemap.xml
Back to top

Comments

  • Global rules
  • Sitemaps
  • Disallow private and utility pages
  • Crawl-delay: 10
  • Specific rules for major bots
Back to top