doz.pl
robots.txt

Robots Exclusion Standard data for doz.pl

Resource Scan

Scan Details

Site Domain doz.pl
Base Domain doz.pl
Scan Status Ok
Last Scan2024-11-17T19:26:19+00:00
Next Scan 2024-12-01T19:26:19+00:00

Last Scan

Scanned2024-11-17T19:26:19+00:00
URL https://www.doz.pl/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 87b6eeb1675dc4175cbe54d6b92e8196387b2a4c358a1dadaf5249605dac2db7
SimHash b1cf79138d57

Groups

*

Rule Path
Disallow /api
Disallow /profil
Disallow /grafiki
Disallow /javascript
Disallow /apteka/a3
Disallow /apteka/a1
Disallow /apteka/o
Disallow /apteka/z
Disallow /apteka/w
Disallow /apteka/y
Disallow /apteka/l*
Disallow /apteka/c
Disallow /sklep/o
Disallow /sklep/z
Disallow /sklep/w
Disallow /sklep/y
Disallow /sklep/x
Disallow /czytelnia/k
Disallow /newsy/k
Disallow /rekred/
Disallow /sklep/
Disallow /attach/
Disallow /ajax/
Disallow /ajaxapteka/
Disallow /v2/javascript/
Disallow /v2/css/
Disallow /v2/layout/
Disallow /moje-konto
Disallow /logowanie
Disallow /rejestracja
Disallow /resetuj-haslo
Disallow /koszyk
Disallow /inkontynencja
Disallow /strona/s0
Disallow /e-recepta

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.doz.pl/sitemap/sitemaps.xml