cbttherapist.com
robots.txt

Robots Exclusion Standard data for cbttherapist.com

Resource Scan

Scan Details

Site Domain cbttherapist.com
Base Domain cbttherapist.com
Scan Status Ok
Last Scan2024-11-13T03:34:21+00:00
Next Scan 2024-11-20T03:34:21+00:00

Last Scan

Scanned2024-11-13T03:34:21+00:00
URL https://cbttherapist.com/robots.txt
Domain IPs 199.195.144.23
Response IP 199.195.144.23
Found Yes
Hash 0b37a1d9bdc48f98c67c8c89a08b357f0e5d5d9a66db1149221a9ecb7f23f055
SimHash 031430ab3350

Groups

*

Rule Path
Disallow /register/wp-admin
Disallow /register/feed/
Disallow /register/feed/rss/
Disallow /register/feed/rss2/
Disallow /register/feed/atom/
Disallow /register/trackback/
Disallow /register/?preview=
Disallow /register?preview=
Disallow /register?p=
Disallow /register/?p=
Disallow /register/wp-content/plugins
Disallow /register/rss/
Disallow /register/date/
Disallow /*.inc
Disallow /*?randomise

mediapartners-google

Rule Path
Disallow

abonti/0.8
accelobot
ahrefsbot
archive.org_bot
becomebot
discobot
ec2linkfinder
exabot/3.0
ia_archiver
httrack
httrack 3.0x
icc-crawler
mail.ru/1.0
mj12bot
mlbot
npbot
sbider
sitebot
sogou web spider/4.0
speedy
speedy spider
steeler
turnitinbot
turnitinbot/2.1
yeti/1.0

Rule Path
Disallow /

findestars
myonid
peekyou
pipl
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo

Rule Path
Disallow /

Warnings

  • 1 invalid line.