bio-marketing-t.com
robots.txt

Robots Exclusion Standard data for bio-marketing-t.com

Resource Scan

Scan Details

Site Domain bio-marketing-t.com
Base Domain bio-marketing-t.com
Scan Status Ok
Last Scan2024-09-17T20:27:52+00:00
Next Scan 2024-09-24T20:27:52+00:00

Last Scan

Scanned2024-09-17T20:27:52+00:00
URL https://bio-marketing-t.com/robots.txt
Domain IPs 212.179.58.114
Response IP 212.179.58.114
Found Yes
Hash 48216e7c23f892eee5f0fad3d1047280bcf197d50c981ce87575291dcc1afa53
SimHash 2015dc825513

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

asterias

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /Common/
Disallow /EDITOR/
Disallow /*.swf$
Disallow /*.xml$