medexpress.pl
robots.txt

Robots Exclusion Standard data for medexpress.pl

Resource Scan

Scan Details

Site Domain medexpress.pl
Base Domain medexpress.pl
Scan Status Ok
Last Scan2024-09-25T19:13:36+00:00
Next Scan 2024-10-02T19:13:36+00:00

Last Scan

Scanned2024-09-25T19:13:36+00:00
URL https://medexpress.pl/robots.txt
Redirect https://www.medexpress.pl/robots.txt
Redirect Domain www.medexpress.pl
Redirect Base medexpress.pl
Domain IPs 104.21.22.141, 172.67.205.31, 2606:4700:3030::ac43:cd1f, 2606:4700:3035::6815:168d
Redirect IPs 104.21.22.141, 172.67.205.31, 2606:4700:3030::ac43:cd1f, 2606:4700:3035::6815:168d
Response IP 104.21.22.141
Found Yes
Hash 923647f6960dec1605c27f291ac2868d217d2d96383cb5d941289cba14c0a85b
SimHash 191c4c44d61b

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

spbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

turnedup

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

*

Rule Path
Disallow /author/*
Disallow /tag/*
Disallow /wp-admin/*
Disallow /regulamin
Disallow /polityka-prywatnosci
Disallow /polityka-cookies
Disallow /*/pdf/

Other Records

Field Value
sitemap https://www.medexpress.pl/sitemap.xml