gbpearland.com
robots.txt

Robots Exclusion Standard data for gbpearland.com

Resource Scan

Scan Details

Site Domain gbpearland.com
Base Domain gbpearland.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-02T10:10:59+00:00
Next Scan 2025-09-01T10:10:59+00:00

Last Successful Scan

Scanned2025-06-11T01:34:59+00:00
URL https://gbpearland.com/robots.txt
Domain IPs 179.61.189.5, 2a02:4780:16:6fce:ca1a:ec72:4ec:ec78
Response IP 93.127.196.190
Found Yes
Hash cb7e6fe242833b4214a4edf4dac72afc47adc02d66519191c8965a378e73c8a3
SimHash 619070d5cc93

Groups

*

Rule Path
Allow /

googlebot
bingbot

Rule Path
Allow /

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://gbpearland.com/sitemap_index.xml

Comments

  • Allow traditional search indexing
  • Allow AI search and agent use