psychtap.com
robots.txt

Robots Exclusion Standard data for psychtap.com

Resource Scan

Scan Details

Site Domain psychtap.com
Base Domain psychtap.com
Scan Status Ok
Last Scan2024-11-13T20:08:44+00:00
Next Scan 2024-11-20T20:08:44+00:00

Last Scan

Scanned2024-11-13T20:08:44+00:00
URL https://psychtap.com/robots.txt
Domain IPs 199.195.144.23
Response IP 199.195.144.23
Found Yes
Hash 1b1decdfad666f8accef5b10c5464dbf5adc9205900db81601bd09d2d2c9f342
SimHash 131400283751

Groups

*

Rule Path
Disallow /*.inc
Disallow /*?randomise

abonti/0.8
accelobot
ahrefsbot
archive.org_bot
becomebot
discobot
ec2linkfinder
exabot/3.0
ia_archiver
httrack
httrack 3.0x
icc-crawler
mail.ru/1.0
mj12bot
mlbot
npbot
sbider
sitebot
sogou web spider/4.0
speedy
speedy spider
steeler
turnitinbot
turnitinbot/2.1
yeti/1.0

Rule Path
Disallow /

findestars
myonid
peekyou
pipl
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Warnings

  • 1 invalid line.