sempai.pl
robots.txt

Robots Exclusion Standard data for sempai.pl

Resource Scan

Scan Details

Site Domain sempai.pl
Base Domain sempai.pl
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-03T09:22:59+00:00
Next Scan 2025-11-02T09:22:59+00:00

Last Successful Scan

Scanned2025-06-12T15:02:30+00:00
URL https://sempai.pl/robots.txt
Domain IPs 94.154.117.227
Response IP 94.154.117.227
Found Yes
Hash e15ed75d5ca245b8c77550c522a9bb4b1e1a0c01f086cf4ea1fbddbf9d407035
SimHash d21bd1838b3a

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /nowawycena
Disallow */feed*
Allow /blog/feedback-co-to-jest-i-jak-zbierac-go-od-klientow/
Disallow /wp-admin/admin-ajax.php
Disallow */lp/
Disallow *?trk
Disallow *?tag
Disallow *?nocache
Disallow /wp-config.php
Disallow *?author
Disallow */addtoany
Disallow */tag
Disallow */app/webroot
Disallow /Opinie
Disallow */Nagrody
Disallow *?aam-media
Disallow /page/3/
Disallow /lasery
Disallow /nikon
Disallow /dewalt
Disallow /dalmierz
Disallow /niwelator
Disallow /poziomic
Disallow /okulary
Disallow /wykrywacze
Disallow /cst-berger
Disallow /bosch
Disallow /adaptery
Disallow /products
Disallow /statywy
Disallow /leica
Disallow /do-wnetrz
Disallow /na-zewnatrz
Disallow /blog/2014/
Disallow /blog/2015/
Disallow /blog/2016/
Disallow /blog/2017/
Disallow /blog/2018/
Disallow /blog/2019/
Disallow /blog/2020/
Disallow /blog/2021/
Disallow /blog/2022/
Disallow /blog/2023/
Disallow *?mode
Disallow */node_modules/
Disallow /1*.htm
Disallow /2*.htm
Disallow /3*.htm
Disallow /4*.htm
Disallow /5*.htm
Disallow /6*.htm
Disallow /7*.htm
Disallow /8*.htm
Disallow /9*.htm
Disallow /speaker/
Disallow */index.php?*.htm
Disallow /opinie-klientow/
Disallow /search/
Disallow *?s=
Disallow */admin.php$

Warnings

  • 1 invalid line.