Log In Sign Up

sugarbook.me
robots.txt

Robots Exclusion Standard data for sugarbook.me

Resource Scan

Scan Details

Site Domain sugarbook.me
Base Domain sugarbook.me
Scan Status Ok
Last Scan2025-08-20T20:31:10+00:00
Next Scan 2025-08-27T20:31:10+00:00

Last Scan

Scanned2025-08-20T20:31:10+00:00
URL https://sugarbook.me/robots.txt
Redirect https://sugarbook.com/robots.txt
Redirect Domain sugarbook.com
Redirect Base sugarbook.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.26.14.196, 104.26.15.196, 172.67.74.70, 2606:4700:20::681a:ec4, 2606:4700:20::681a:fc4, 2606:4700:20::ac43:4a46
Response IP 172.67.74.70
Found Yes
Hash 9b7973b6c69a2d7121016e3c44517201cd0ddbaadae11e46b1d5538b6842cb60
SimHash 7b203d12e3d1

Groups

chatgpt-user

Rule Path
Disallow /
Allow /blog/

google-extended

Rule Path
Disallow /
Allow /blog/

perplexitybot

Rule Path
Disallow /
Allow /blog/

gptbot

Rule Path
Disallow /
Allow /blog/

ccbot

Rule Path
Disallow /
Allow /blog/

googleother

Rule Path
Disallow /
Allow /blog/

*

Rule Path
Disallow /browse/members
Disallow /images/
Disallow /*/top-streamers
Disallow /*/top-gifters
Disallow /*/private-room
Disallow /*/live-streaming
Allow /blog/wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://sugarbook.com/blog/sitemap.xml
Back to top

Comments

  • Allow AI bots to access /blog only
Back to top