diekaw.com
robots.txt

Robots Exclusion Standard data for diekaw.com

Resource Scan

Scan Details

Site Domain diekaw.com
Base Domain diekaw.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-03T21:39:32+00:00
Next Scan 2025-01-02T21:39:32+00:00

Last Successful Scan

Scanned2024-08-13T07:46:35+00:00
URL https://diekaw.com/robots.txt
Domain IPs 104.21.51.80, 172.67.177.100, 2606:4700:3033::6815:3350, 2606:4700:3036::ac43:b164
Response IP 104.21.51.80
Found Yes
Hash 84230c30b79fad16d33f2be577ef8a468cfb79d113a6b72887fcd1b7d91b4866
SimHash 7d5d49f0ff91

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

tkbot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

*

Rule Path
Disallow /include
Disallow /comment
Disallow /templets
Disallow /js
Disallow /search