almamed.pl
robots.txt

Robots Exclusion Standard data for almamed.pl

Resource Scan

Scan Details

Site Domain almamed.pl
Base Domain almamed.pl
Scan Status Ok
Last Scan2024-09-21T05:42:04+00:00
Next Scan 2024-10-21T05:42:04+00:00

Last Scan

Scanned2024-09-21T05:42:04+00:00
URL https://almamed.pl/robots.txt
Domain IPs 46.248.167.142
Response IP 46.248.167.142
Found Yes
Hash 22a13673f6277edf04456530936e996e9f68a6ddb0e3b144e53fa186f2cdfc79
SimHash 4636d418ca70

Groups

*

Rule Path
Disallow /index.php/
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /null
Disallow /undefined
Disallow /api.php
Disallow /cron.php
Disallow /get.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /xmlrpc.php
Disallow /portal.html
Disallow /purposes.json

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

Comments

  • Automatically banned scanners and crawlers section

Warnings

  • 2 invalid lines.