rgthree.com
robots.txt

Robots Exclusion Standard data for rgthree.com

Resource Scan

Scan Details

Site Domain rgthree.com
Base Domain rgthree.com
Scan Status Ok
Last Scan2025-10-07T11:58:11+00:00
Next Scan 2025-11-06T11:58:11+00:00

Last Scan

Scanned2025-10-07T11:58:11+00:00
URL https://rgthree.com/robots.txt
Domain IPs 104.21.63.242, 172.67.173.93, 2606:4700:3034::ac43:ad5d, 2606:4700:3036::6815:3ff2
Response IP 172.67.173.93
Found Yes
Hash 54a7b1546375f16d96a5d20e81532c00e23e18af3aec751887dd3ecd9243d985
SimHash 6c4aac31c6f3

Groups

*

Rule Path
Disallow /*
Allow /sitemap*
Allow /halloween*
Allow /$
Allow /?
Allow /horror_poster_nightmare
Allow /horror_poster_nightmare/
Allow /horror_poster_nightmare/*
Allow /hpn
Allow /hpn/
Allow /hpn/*
Allow /crypto
Allow /crypto/
Allow /crypto/*
Allow /posts
Allow /posts/
Allow /posts/*
Allow /gemini
Allow /binanceus
Allow /binancecom
Allow /kucoin
Allow /voyager
Allow /coinbase
Disallow /posts/drafts
Disallow /posts/drafts/
Disallow /posts/drafts/*

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /