selectshop.pl
robots.txt

Robots Exclusion Standard data for selectshop.pl

Resource Scan

Scan Details

Site Domain selectshop.pl
Base Domain selectshop.pl
Scan Status Ok
Last Scan2024-09-21T01:36:09+00:00
Next Scan 2024-10-21T01:36:09+00:00

Last Scan

Scanned2024-09-21T01:36:09+00:00
URL https://selectshop.pl/robots.txt
Domain IPs 104.22.70.201, 104.22.71.201, 172.67.29.2, 2606:4700:10::6816:46c9, 2606:4700:10::6816:47c9, 2606:4700:10::ac43:1d02
Response IP 172.67.29.2
Found Yes
Hash fd42d86051ccc2a312a5d1d11f96ef8d01def5909ceedbd864d237132dfd05a5
SimHash 40cc5b02ca3b

Groups

*

Rule Path
Disallow /cart/
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /app/
Disallow /cache/
Disallow /cart/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /api.php
Disallow /cron.php
Disallow /get.php
Disallow /cron.sh
Disallow /error_log
Disallow /purposes.json
Disallow /*?query=*
Disallow /*?order=*
Disallow /%26order%3D*
Disallow /*?v=*
Disallow /*?s=*
Disallow /*?p=*

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://selectshop.pl/sitemap.xml

Comments

  • Automatically banned scanners and crawlers section

Warnings

  • 2 invalid lines.