bottomlessbrunch.com
robots.txt

Robots Exclusion Standard data for bottomlessbrunch.com

Resource Scan

Scan Details

Site Domain bottomlessbrunch.com
Base Domain bottomlessbrunch.com
Scan Status Ok
Last Scan2025-12-01T07:11:48+00:00
Next Scan 2025-12-31T07:11:48+00:00

Last Scan

Scanned2025-12-01T07:11:48+00:00
URL https://bottomlessbrunch.com/robots.txt
Domain IPs 65.108.104.232, 65.109.39.175
Response IP 65.109.39.175
Found Yes
Hash 7a785fa01b108e83f57ce574974d940ef358e40a1392be0dd47f217757297b23
SimHash 9e3dd902c05b

Groups

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?s=
Disallow /checkout/
Disallow /account/
Disallow /cart/
Disallow /wishlist/

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow /wp-admin/
Disallow /wp-json/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /account/
Disallow /wishlist/
Disallow /search/
Disallow /?s=
Disallow /add-to-cart%3D
Disallow /?add-to-cart=
Disallow /?add_to_wishlist=
Disallow /?wc-ajax=*
Disallow /feed/
Disallow /?orderby=
Disallow /?rating=
Disallow /?min_price=
Disallow /?max_price=
Disallow /?filter_
Disallow /?attribute_
Disallow /?pa_
Disallow /?color=
Disallow /?size=
Disallow /?paged=
Disallow /?utm_*
Disallow /?gclid=*
Disallow /?fbclid=*
Disallow /?redirect_to=*
Disallow /?replytocom=*

Other Records

Field Value
sitemap https://bottomlessbrunch.com/sitemap_index.xml

Comments

  • Darren Edit - Added a blackhole to block bots that ignore this:
  • Darren Edit - All bots
  • Darren Edit - Google Bot