sleepworldintl.com
robots.txt

Robots Exclusion Standard data for sleepworldintl.com

Resource Scan

Scan Details

Site Domain sleepworldintl.com
Base Domain sleepworldintl.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-04T22:12:18+00:00
Next Scan 2025-11-03T22:12:18+00:00

Last Successful Scan

Scanned2025-06-30T00:22:38+00:00
URL https://www.sleepworldintl.com/robots.txt
Domain IPs 104.21.8.50, 172.67.156.217, 2606:4700:3034::6815:832, 2606:4700:3036::ac43:9cd9
Response IP 172.67.156.217
Found Yes
Hash f09d5852995e540e21d5e28014021bca642400ca140332556ea9a9860030a1eb
SimHash 329e48c2f4e6

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Comments

  • Cloudflare Managed Robots.txt to block AI related bots - START
  • Cloudflare Managed Robots.txt to block AI related bots - END