amarauna.euskadi.eus
robots.txt

Robots Exclusion Standard data for amarauna.euskadi.eus

Resource Scan

Scan Details

Site Domain amarauna.euskadi.eus
Base Domain euskadi.eus
Scan Status Ok
Last Scan2024-09-20T10:22:32+00:00
Next Scan 2024-10-20T10:22:32+00:00

Last Scan

Scanned2024-09-20T10:22:32+00:00
URL http://amarauna.euskadi.eus/robots.txt
Domain IPs 77.228.222.52
Response IP 77.228.222.52
Found Yes
Hash 6c7736996edf5da1aa4d9955caddd5958a9c7f299ad1e87a9595420730d1a192
SimHash 4a48dc407230

Groups

*

Rule Path
Disallow /*.axd$

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

linguee

Rule Path
Disallow /