bobbylpeek.com
robots.txt

Robots Exclusion Standard data for bobbylpeek.com

Resource Scan

Scan Details

Site Domain bobbylpeek.com
Base Domain bobbylpeek.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-15T07:55:41+00:00
Next Scan 2025-10-13T07:55:41+00:00

Last Successful Scan

Scanned2024-03-30T10:30:31+00:00
URL https://bobbylpeek.com/robots.txt
Redirect https://earthfoodus.com/robots.txt
Redirect Domain earthfoodus.com
Redirect Base earthfoodus.com
Domain IPs 192.0.78.129, 192.0.78.199
Redirect IPs 192.0.78.146, 192.0.78.210
Response IP 192.0.78.210
Found Yes
Hash 6bad4c6e1cf1cf69ba4e9618b63295ca85bdfb8daff8b94d5dc4f1b68543cb26
SimHash 6a1c48c0a016

Groups

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://earthfoodus.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK