borrowedbites.com
robots.txt

Robots Exclusion Standard data for borrowedbites.com

Resource Scan

Scan Details

Site Domain borrowedbites.com
Base Domain borrowedbites.com
Scan Status Ok
Last Scan2025-10-29T12:00:46+00:00
Next Scan 2025-11-05T12:00:46+00:00

Last Scan

Scanned2025-10-29T12:00:46+00:00
URL https://borrowedbites.com/robots.txt
Domain IPs 104.21.57.102, 172.67.162.241, 2606:4700:3033::6815:3966, 2606:4700:3036::ac43:a2f1
Response IP 104.21.57.102
Found Yes
Hash 822f1f4e5eab861192e4f2e1bd82d625b4638c063268b2367230d5e908bb5570
SimHash 0000d840a1b6

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /recommends/

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /