counsellingresource.com
robots.txt

Robots Exclusion Standard data for counsellingresource.com

Resource Scan

Scan Details

Site Domain counsellingresource.com
Base Domain counsellingresource.com
Scan Status Ok
Last Scan2024-11-13T03:06:20+00:00
Next Scan 2024-11-20T03:06:20+00:00

Last Scan

Scanned2024-11-13T03:06:20+00:00
URL https://counsellingresource.com/robots.txt
Domain IPs 199.195.144.23
Response IP 199.195.144.23
Found Yes
Hash 0160af98b3013c997db009b4f64c35c6faaa5b527761c724bf51b9ede5338ffe
SimHash 02b4282867d0

Groups

*

Rule Path
Disallow /avcache
Disallow /features/wp-admin
Disallow /lib/wp-admin
Disallow /features/?p=
Disallow /features?p=
Disallow /lib/?p=
Disallow /lib?p=

googlebot

Rule Path
Disallow /avcache
Disallow /*/feed/
Disallow /*/feed/rss/
Disallow /*/feed/rss2/
Disallow /*/feed/atom/
Disallow /*/trackback/
Disallow /*preview%3D
Disallow /*?p=
Disallow /*?replytocom=
Disallow /*/wp-admin
Disallow /*/wp-content/plugins
Disallow /*/rss/
Disallow /*/date/
Disallow /*/comments/
Disallow /*.inc

mediapartners-google

Rule Path
Disallow
Disallow /*?p=
Disallow /*preview%3D

abonti/0.8
accelobot
ahrefsbot
archive.org_bot
becomebot
daumoa
discobot
ec2linkfinder
exabot/3.0
ia_archiver
httrack
httrack 3.0x
icc-crawler
mail.ru/1.0
mj12bot
mlbot
npbot
sbider
sitebot
speedy
speedy spider
steeler
toscrawler
turnitinbot
turnitinbot/2.1
yeti/1.0

Rule Path
Disallow /

findestars
myonid
peekyou
pipl
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo

Rule Path
Disallow /

Warnings

  • 1 invalid line.