Log In Sign Up

bonobology.com
robots.txt

Robots Exclusion Standard data for bonobology.com

Resource Scan

Scan Details

Site Domain bonobology.com
Base Domain bonobology.com
Scan Status Ok
Last Scan2024-11-11T09:38:09+00:00
Next Scan 2024-11-18T09:38:09+00:00

Last Scan

Scanned2024-11-11T09:38:09+00:00
URL https://bonobology.com/robots.txt
Domain IPs 23.235.214.122
Response IP 23.235.214.122
Found Yes
Hash 99e2dede4df915dd4685da9a8e14d34304584437c5361ccba31f22348306b988
SimHash e528941146e3

Groups

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole
Disallow /subscriber/
Disallow /wp-admin/
Disallow /slow-resource/
Allow /

Other Records

Field Value
crawl-delay 30

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 10 Adjust this value based on your server capacity and needs

googlebot
*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/
Back to top

Other Records

Field Value
sitemap https://www.bonobology.com/sitemap_index.xml
sitemap https://www.bonobology.com/sitemap-news.xml
sitemap https://www.bonobology.com/sitemap_language.xml
Back to top

Comments

  • Googlebot does not officially support Crawl-delay.
  • To manage Googlebot's crawl rate, consider using Google Search Console's crawl rate settings.
  • WP Import Export Rule
Back to top