crushon.ai
robots.txt

Robots Exclusion Standard data for crushon.ai

Resource Scan

Scan Details

Site Domain crushon.ai
Base Domain crushon.ai
Scan Status Ok
Last Scan2024-09-19T23:23:29+00:00
Next Scan 2024-09-26T23:23:29+00:00

Last Scan

Scanned2024-09-19T23:23:29+00:00
URL https://crushon.ai/robots.txt
Domain IPs 104.18.4.191, 104.18.5.191, 2606:4700::6812:4bf, 2606:4700::6812:5bf
Response IP 104.18.5.191
Found Yes
Hash 3a1afd029c6e57adc46cc012445cb7bdc4de8fa6d721ea098e3e2e95c5fbb5c0
SimHash 4010d222c753

Groups

*

Rule Path
Allow /
Disallow /account