shinebythree.com
robots.txt

Robots Exclusion Standard data for shinebythree.com

Resource Scan

Scan Details

Site Domain shinebythree.com
Base Domain shinebythree.com
Scan Status Ok
Last Scan6/2/2025, 7:45:31 AM
Next Scan 7/2/2025, 7:45:31 AM

Last Scan

Scanned6/2/2025, 7:45:31 AM
URL https://shinebythree.com/robots.txt
Domain IPs 104.21.56.165, 172.67.187.44, 2606:4700:3035::6815:38a5, 2606:4700:3037::ac43:bb2c
Response IP 104.21.56.165
Found Yes
Hash d87d521f0b7ff016e91799d427abd63eed44b5cee44b98e2ca7d94f6b834bedc
SimHash 695caa60a4d2

Groups

*

Rule Path
Disallow /search
Disallow /redirect/
Disallow /click/
Disallow /similar/

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Warnings

  • `host` is not a known field.