Log In Sign Up

brickclay.com
robots.txt

Robots Exclusion Standard data for brickclay.com

Resource Scan

Scan Details

Site Domain brickclay.com
Base Domain brickclay.com
Scan Status Ok
Last Scan2026-01-04T03:13:29+00:00
Next Scan 2026-02-03T03:13:29+00:00

Last Scan

Scanned2026-01-04T03:13:29+00:00
URL https://brickclay.com/robots.txt
Redirect https://www.brickclay.com/robots.txt
Redirect Domain www.brickclay.com
Redirect Base brickclay.com
Domain IPs 2607:f1c0:100f:f000::200, 74.208.236.109
Redirect IPs 2607:f1c0:100f:f000::200, 74.208.236.109
Response IP 74.208.236.109
Found Yes
Hash cb06188762ef9966d9a50396e5b83935291a3e0ee496bbbe319e840393889920
SimHash 693d9f042515

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandex

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

*

Rule Path
Allow /
Disallow */cache/ionos-performance/
Back to top

Other Records

Field Value
sitemap https://www.brickclay.com/sitemap_index.xml
sitemap https://brickclay.com/llms-sitemap.xml
Back to top

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
  • --- Search Engine Crawlers ---
  • --- AI / LLM Crawlers ---
  • --- All Others ---
  • --- Blocked Folders ---
  • --- Sitemaps ---
Back to top