Log In Sign Up

bonobology.com
robots.txt

Robots Exclusion Standard data for bonobology.com

Resource Scan

Scan Details

Site Domain bonobology.com
Base Domain bonobology.com
Scan Status Ok
Last Scan2024-10-06T21:02:34+00:00
Next Scan 2024-10-13T21:02:34+00:00

Last Scan

Scanned2024-10-06T21:02:34+00:00
URL https://bonobology.com/robots.txt
Domain IPs 23.235.214.122
Response IP 23.235.214.122
Found Yes
Hash f141c69057aaffb1b9f70f067fb6a04b69f512d7414d34cade86aacaf331a84b
SimHash c508941146e3

Groups

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole
Disallow /subscriber/
Disallow /wp-admin/
Disallow /slow-resource/
Allow /

Other Records

Field Value
crawl-delay 30

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 10 Adjust this value based on your server capacity and needs

googlebot
*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/
Back to top

Other Records

Field Value
sitemap https://www.bonobology.com/sitemap_index.xml
sitemap https://www.bonobology.com/sitemap-news.xml
sitemap https://www.bonobology.com/language_sitemap.xml
Back to top

Comments

  • Googlebot does not officially support Crawl-delay.
  • To manage Googlebot's crawl rate, consider using Google Search Console's crawl rate settings.
  • WP Import Export Rule
Back to top