analytics-media.com
robots.txt

Robots Exclusion Standard data for analytics-media.com

Resource Scan

Scan Details

Site Domain analytics-media.com
Base Domain analytics-media.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-25T09:15:32+00:00
Next Scan 2024-08-23T09:15:32+00:00

Last Successful Scan

Scanned2022-10-10T08:39:31+00:00
URL https://analytics-media.com/robots.txt
Response IP 172.66.40.248, 172.66.43.8
Found Yes
Hash 55897eb4265ef9d6131a0f69519812d5c5e049ceaee32f09b0bf97a2c3db7bc5
SimHash 0a1ec962d633

Groups

*

Rule Path
Allow /*.css
Allow /*.js

spbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu link sleuth/1.3.8

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

kingkevinbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /
Disallow /admin/