chipmanrelo.com
robots.txt

Robots Exclusion Standard data for chipmanrelo.com

Resource Scan

Scan Details

Site Domain chipmanrelo.com
Base Domain chipmanrelo.com
Scan Status Ok
Last Scan2025-07-06T17:26:45+00:00
Next Scan 2025-08-05T17:26:45+00:00

Last Scan

Scanned2025-07-06T17:26:45+00:00
URL https://chipmanrelo.com/robots.txt
Redirect https://www.chipmanrelo.com/robots.txt
Redirect Domain www.chipmanrelo.com
Redirect Base chipmanrelo.com
Domain IPs 104.19.233.38
Redirect IPs 104.19.233.38
Response IP 104.19.233.38
Found Yes
Hash f81e5a44e1ed8c37f9f85d1cecf83cae7af0fbdf78f038e71a9beeb90be51aae
SimHash 515a59e4aa13

Groups

*

Rule Path
Allow *******************.js
Allow *******************.css
Disallow /manager/
Disallow /connectors/
Disallow /core/
Disallow /search-results/
Disallow *?ref=*
Disallow /search-results/
Disallow /token/

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.chipmanrelo.com/sitemap.xml

Comments

  • anthropic-ai is Anthropic's web crawler
  • Claude-Web is Claude’s web crawler
  • For sitemap.xml autodiscovery. Uncomment if you have one: