compusoft.dk
robots.txt

Robots Exclusion Standard data for compusoft.dk

Resource Scan

Scan Details

Site Domain compusoft.dk
Base Domain compusoft.dk
Scan Status Ok
Last Scan2025-10-01T17:47:36+00:00
Next Scan 2025-10-31T17:47:36+00:00

Last Scan

Scanned2025-10-01T17:47:36+00:00
URL https://compusoft.dk/robots.txt
Redirect https://www.compusoft.com/robots.txt
Redirect Domain www.compusoft.com
Redirect Base compusoft.com
Domain IPs 104.26.12.243, 104.26.13.243, 172.67.75.26, 2606:4700:20::681a:cf3, 2606:4700:20::681a:df3, 2606:4700:20::ac43:4b1a
Redirect IPs 104.21.88.252, 172.67.155.49, 2606:4700:3037::6815:58fc, 2606:4700:3037::ac43:9b31
Response IP 104.21.88.252
Found Yes
Hash 43baa8ee978de16dc81fe8f843c0b098f37223086f73ae7cac65d115c882724b
SimHash 4ccc98434532

Groups

crisp

Rule Path
Allow /

crispbot

Rule Path
Allow /

crisp im

Rule Path
Allow /

crisp webbot

Rule Path
Allow /

crisp-snippetcrawler

Rule Path
Allow /

crisp-snippetcrawler/1.0

Rule Path
Allow /

crisp-websitebot

Rule Path
Allow /

crisp-domainprocessing

Rule Path
Allow /

crisp-linkpreview

Rule Path
Allow /

crisp-proxy

Rule Path
Allow /

crisp-hooksdeliver

Rule Path
Allow /

*

Rule Path
Disallow /download
Disallow /webkalender/arrild/kalender.htm

Other Records

Field Value
sitemap https://www.compusoft.com/sitemap

Comments

  • Whitelist Crisp user-agents
  • General rules for all others