curiositymedia.com
robots.txt

Robots Exclusion Standard data for curiositymedia.com

Resource Scan

Scan Details

Site Domain curiositymedia.com
Base Domain curiositymedia.com
Scan Status Ok
Last Scan2024-11-02T20:59:02+00:00
Next Scan 2024-12-02T20:59:02+00:00

Last Scan

Scanned2024-11-02T20:59:02+00:00
URL https://www.curiositymedia.com/robots.txt
Domain IPs 13.200.123.229, 13.234.100.116, 65.0.79.182
Response IP 54.178.223.218
Found Yes
Hash 921fad3b000b164561dc7f7a24e2d6d059fe78e6dbc856c526e523625d5064d0
SimHash 9915d910c152

Groups

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /