Log In Sign Up

emedias.co.uk
robots.txt

Robots Exclusion Standard data for emedias.co.uk

Resource Scan

Scan Details

Site Domain emedias.co.uk
Base Domain emedias.co.uk
Scan Status Ok
Last Scan2024-10-05T04:09:01+00:00
Next Scan 2024-11-04T04:09:01+00:00

Last Scan

Scanned2024-10-05T04:09:01+00:00
URL https://emedias.co.uk/robots.txt
Domain IPs 213.175.208.186
Response IP 213.175.208.186
Found Yes
Hash c42b7db942d19a3a362c127a7ec9da6c3784717e39ffae416fc8e60aa464cef9
SimHash 4a56c99322c1

Groups

domaincrawler/3.0

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

linguee

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Block
  • Robot Delay
Back to top