skymem.info
robots.txt

Robots Exclusion Standard data for skymem.info

Resource Scan

Scan Details

Site Domain skymem.info
Base Domain skymem.info
Scan Status Ok
Last Scan2025-11-26T13:42:59+00:00
Next Scan 2025-12-03T13:42:59+00:00

Last Scan

Scanned2025-11-26T13:42:59+00:00
URL https://www.skymem.info/robots.txt
Domain IPs 116.202.130.39
Response IP 116.202.130.39
Found Yes
Hash b2fbe2d9236a887b0acad107c378ea893136905563515c198d033a2a0cade3a3
SimHash 58145900e1f3

Groups

facebookexternalhit

Rule Path
Disallow /

facebot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

*

Rule Path
Disallow