Log In Sign Up

compusoft.com
robots.txt

Robots Exclusion Standard data for compusoft.com

Resource Scan

Scan Details

Site Domain compusoft.com
Base Domain compusoft.com
Scan Status Ok
Last Scan2025-10-01T13:26:24+00:00
Next Scan 2025-10-31T13:26:24+00:00

Last Scan

Scanned2025-10-01T13:26:24+00:00
URL https://compusoft.com/robots.txt
Redirect https://www.compusoft.com/robots.txt
Redirect Domain www.compusoft.com
Redirect Base compusoft.com
Domain IPs 80.166.12.100
Redirect IPs 104.21.88.252, 172.67.155.49, 2606:4700:3037::6815:58fc, 2606:4700:3037::ac43:9b31
Response IP 172.67.155.49
Found Yes
Hash 43baa8ee978de16dc81fe8f843c0b098f37223086f73ae7cac65d115c882724b
SimHash 4ccc98434532

Groups

crisp

Rule Path
Allow /

crispbot

Rule Path
Allow /

crisp im

Rule Path
Allow /

crisp webbot

Rule Path
Allow /

crisp-snippetcrawler

Rule Path
Allow /

crisp-snippetcrawler/1.0

Rule Path
Allow /

crisp-websitebot

Rule Path
Allow /

crisp-domainprocessing

Rule Path
Allow /

crisp-linkpreview

Rule Path
Allow /

crisp-proxy

Rule Path
Allow /

crisp-hooksdeliver

Rule Path
Allow /

*

Rule Path
Disallow /download
Disallow /webkalender/arrild/kalender.htm
Back to top

Other Records

Field Value
sitemap https://www.compusoft.com/sitemap
Back to top

Comments

  • Whitelist Crisp user-agents
  • General rules for all others
Back to top