ofbusiness.com
robots.txt

Robots Exclusion Standard data for ofbusiness.com

Resource Scan

Scan Details

Site Domain ofbusiness.com
Base Domain ofbusiness.com
Scan Status Ok
Last Scan2026-02-10T19:54:20+00:00
Next Scan 2026-02-24T19:54:20+00:00

Last Scan

Scanned2026-02-10T19:54:20+00:00
URL https://ofbusiness.com/robots.txt
Redirect https://www.ofbusiness.com/robots.txt
Redirect Domain www.ofbusiness.com
Redirect Base ofbusiness.com
Domain IPs 34.36.170.21
Redirect IPs 13.202.38.60, 13.232.175.112, 2406:da1a:b6a:7c00:78f4:fb55:44fa:c7cf, 2406:da1a:b6a:7c01:4d:cc00:3702:661f
Response IP 13.232.175.112
Found Yes
Hash 654dd097ea37c0dbc920fab8c2ff9b20ba2c0ceecbaf72c03da48cb6382adb2a
SimHash 5c94bf42ac53

Groups

*

Rule Path
Allow *
Disallow /login
Disallow /buyerOrganisation
Disallow /organisation
Disallow /supplier-price
Disallow /favourite
Disallow /updates
Disallow /.well-known/
Disallow /*?*

gptbot

Rule Path
Allow /prices/
Allow /news/
Allow /category/

chatgpt-user

Rule Path
Allow /prices/
Allow /news/
Allow /category/

google-extended

Rule Path
Allow /prices/
Allow /news/
Allow /category/

perplexitybot

Rule Path
Allow /prices/
Allow /news/
Allow /category/

claudebot

Rule Path
Allow /prices/
Allow /news/
Allow /category/

cohere-ai

Rule Path
Allow /prices/
Allow /news/
Allow /category/

anthropic-ai

Rule Path
Allow /prices/
Allow /news/
Allow /category/

Other Records

Field Value
sitemap https://www.ofbusiness.com/sitemap_index.xml

Comments

  • AI Crawlers - Explicitly allowed for GEO (Generative Engine Optimization)
  • Sitemaps
  • LLM Information File (GEO)
  • LLMs-txt: https://www.ofbusiness.com/llms.txt