crisp.im
robots.txt
Robots Exclusion Standard data for crisp.im
Resource Scan
Scan Details
Site Domain | crisp.im |
Base Domain | crisp.im |
Scan Status | Ok |
Last Scan | 2025-05-29T00:38:55+00:00 |
Next Scan | 2025-06-28T00:38:55+00:00 |
Last Scan
Scanned | 2025-05-29T00:38:55+00:00 |
URL | https://crisp.im/robots.txt |
Redirect | https://crisp.chat/robots.txt |
Redirect Domain | crisp.chat |
Redirect Base | crisp.chat |
Domain IPs | 104.21.87.89, 172.67.169.47, 2606:4700:3033::ac43:a92f, 2606:4700:3036::6815:5759 |
Redirect IPs | 104.18.28.104, 104.18.29.104, 2606:4700::6812:1c68, 2606:4700::6812:1d68 |
Response IP | 104.18.29.104 |
Found | Yes |
Hash | 25be06603ec237d0d6b98699ad6efafcda688765f2b4aaff78990b198b68c980 |
SimHash | 2211d2a263a2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /de/unleash/ |
Disallow | /es/unleash/ |
Disallow | /fi/unleash/ |
Disallow | /fr/unleash/ |
Disallow | /nl/unleash/ |
Disallow | /pl/unleash/ |
Disallow | /pt/unleash/ |
Disallow | /tr/unleash/ |
Disallow | /ja/unleash/ |
Disallow | /de/unleash/*/ |
Disallow | /es/unleash/*/ |
Disallow | /fi/unleash/*/ |
Disallow | /fr/unleash/*/ |
Disallow | /nl/unleash/*/ |
Disallow | /pl/unleash/*/ |
Disallow | /pt/unleash/*/ |
Disallow | /tr/unleash/*/ |
Disallow | /ja/unleash/*/ |
Other Records
Field | Value |
---|---|
sitemap | https://crisp.chat/sitemap.xml |