Log In Sign Up

sunbonoo.com
robots.txt

Robots Exclusion Standard data for sunbonoo.com

Resource Scan

Scan Details

Site Domain sunbonoo.com
Base Domain sunbonoo.com
Scan Status Ok
Last Scan2025-10-04T08:05:46+00:00
Next Scan 2025-10-11T08:05:46+00:00

Last Scan

Scanned2025-10-04T08:05:46+00:00
URL https://sunbonoo.com/robots.txt
Domain IPs 192.124.249.61
Response IP 192.124.249.61
Found Yes
Hash 60115ebd981b2207bee7005780ddc2bade5b3702420b9e7fab06f92515fbc57b
SimHash 742499d2cfb3

Groups

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /verwaltung/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /RELEASE_NOTES.txt
Disallow /excludefromga.html
Disallow /backofficecookie.html
Disallow /catalogsearch/
Disallow /ca/catalogsearch/
Disallow /de/catalogsearch/
Disallow /en/catalogsearch/
Disallow /es/catalogsearch/
Disallow /fr/catalogsearch/
Disallow /it/catalogsearch/
Disallow /nl/catalogsearch/
Disallow /pl/catalogsearch/
Disallow /pt/catalogsearch/
Disallow /sv/catalogsearch/
Disallow /da/catalogsearch/
Disallow /nb/catalogsearch/
Disallow /fi/catalogsearch/
Disallow /ro/catalogsearch/
Disallow /el/catalogsearch/
Disallow /cs/catalogsearch/
Disallow /hu/catalogsearch/

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • indicates that rules are defined for all bots
  • should not wait too long for a page to load
  • Now come the rules: restrict robots from indexing the following pages:
  • prevent crawling search pages - especially important for Amazonbot which does not respect noindex and nofollow
Back to top