crepe.cm
robots.txt

Robots Exclusion Standard data for crepe.cm

Resource Scan

Scan Details

Site Domain crepe.cm
Base Domain crepe.cm
Scan Status Ok
Last Scan2024-11-16T02:54:27+00:00
Next Scan 2024-11-23T02:54:27+00:00

Last Scan

Scanned2024-11-16T02:54:27+00:00
URL https://crepe.cm/robots.txt
Domain IPs 18.155.68.11, 18.155.68.12, 18.155.68.125, 18.155.68.33, 2600:9000:23d2:5000:16:2cef:e680:93a1, 2600:9000:23d2:6200:16:2cef:e680:93a1, 2600:9000:23d2:6a00:16:2cef:e680:93a1, 2600:9000:23d2:7800:16:2cef:e680:93a1, 2600:9000:23d2:7e00:16:2cef:e680:93a1, 2600:9000:23d2:a000:16:2cef:e680:93a1, 2600:9000:23d2:be00:16:2cef:e680:93a1, 2600:9000:23d2:d400:16:2cef:e680:93a1
Response IP 18.155.68.12
Found Yes
Hash ba40c4047a4c9cc54cf812b632cad59bbf5a40b9352a135f0f09be424054c619
SimHash 40168b00c1b1

Groups

bytespider
gptbot
claudebot
imagesiftbot
ccbot
chatgpt-user
omgili
diffbot
claude-web
perplexitybot
google-extended

Rule Path
Disallow /

*

Rule Path
Allow /$
Disallow /
Allow /%40
Allow /icons/icon.svg