Log In Sign Up

adressesx.com
robots.txt

Robots Exclusion Standard data for adressesx.com

Resource Scan

Scan Details

Site Domain adressesx.com
Base Domain adressesx.com
Scan Status Ok
Last Scan2024-11-06T15:20:44+00:00
Next Scan 2024-12-06T15:20:44+00:00

Last Scan

Scanned2024-11-06T15:20:44+00:00
URL https://adressesx.com/robots.txt
Domain IPs 185.94.239.38
Response IP 185.94.239.38
Found Yes
Hash fcd9b2843a6e92de14830e97c5d228c73c95989814bc695e3bcb3aaac0656f32
SimHash 08745381db12

Groups

zanrancrawler/0.2

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

sheenbot/sheenbot-1.0.4

Rule Path
Disallow /

mj12bot/v1.3.2

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ina dlweb

Rule Path
Disallow /

lijit crawler

Rule Path
Disallow /

dtsearchspider

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

isense

Rule Path
Disallow /

isense bot v1.21

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

spbot/2.0.2

Rule Path
Disallow /

spbot

Rule Path
Disallow /

aggregator:spinn3r (spinn3r 3.1)

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

konqueror/3.5

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

psbot

Rule Path
Disallow /

beetween/nutch-1.0 (beetween crawler)

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

beetween/nutch-1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

tineye/1.1

Rule Path
Disallow /

speedy

Rule Path
Disallow /

callisionftbot/1.1

Rule Path
Disallow /

discobot/1.1

Rule Path
Disallow /

infoaxe./nutch-0.9

Rule Path
Disallow /

piplbot; http://pipl.com/bot/

Rule Path
Disallow /

camelhttpstream/1.0 evolution/2.26.1

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

archive-fr.com

Rule Path
Disallow /

webmeupbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

voilabot beta 1.2

Rule Path
Disallow /

linkedinbot/1.0

Rule Path
Disallow /

mlbot

Rule Path
Disallow /
Back to top