mp.pl
robots.txt

Robots Exclusion Standard data for mp.pl

Resource Scan

Scan Details

Site Domain mp.pl
Base Domain mp.pl
Scan Status Ok
Last Scan2024-06-23T08:52:24+00:00
Next Scan 2024-06-30T08:52:24+00:00

Last Scan

Scanned2024-06-23T08:52:24+00:00
URL https://mp.pl/robots.txt
Redirect https://www.mp.pl/robots.txt
Redirect Domain www.mp.pl
Redirect Base mp.pl
Domain IPs 104.22.76.238, 104.22.77.238, 172.67.6.244, 2606:4700:10::6816:4cee, 2606:4700:10::6816:4dee, 2606:4700:10::ac43:6f4
Redirect IPs 104.22.76.238, 104.22.77.238, 172.67.6.244, 2606:4700:10::6816:4cee, 2606:4700:10::6816:4dee, 2606:4700:10::ac43:6f4
Response IP 104.22.76.238
Found Yes
Hash 539fb51e63056fa6128683be1c586cdff5e377b62803223b0541e7c5373819e3
SimHash 500090470550

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow */mircim/confirm
Disallow */newsletter/confirm
Disallow */manualmibe/confirmar_email
Disallow */kurier/potwierdz_email
Disallow */aneks20040301
Disallow */artykuly/captcha.html
Disallow */demo
Disallow */dodatki
Disallow */dodatki/extrwindow.php
Disallow */download
Disallow */forum/
Disallow */koszyk.php
Disallow */kurier/specjalne
Disallow */kurierhtml
Disallow */msz_ua
Disallow */plugins/feedback.php
Disallow */poczta
Disallow */reklama
Disallow */user/login.html?*
Disallow */user/logout.html?*
Disallow */szukaj.html?q=
Disallow */szukaj?q=
Disallow */set_ad_swimbox.html
Disallow */artykuly/thumb/
Disallow */cdn-cgi/
Allow */home/szukaj?
Allow */home/szukaj.html?
Allow */ksiegarnia/szukaj?
Allow */lekarz/poczet/szukaj?
Allow */lekarz/poczet/szukaj.html?
Allow */lekarz/szukaj-lekarza/
Allow */lekarz/szukaj/
Allow */pacjent/leki/szukaj?
Allow */pacjent/leki/szukaj.html?