cenowarka.pl
robots.txt

Robots Exclusion Standard data for cenowarka.pl

Resource Scan

Scan Details

Site Domain cenowarka.pl
Base Domain cenowarka.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-22T18:58:01+00:00
Next Scan 2026-03-22T18:58:01+00:00

Last Successful Scan

Scanned2025-05-27T05:22:02+00:00
URL https://cenowarka.pl/robots.txt
Domain IPs 104.18.12.155, 104.18.13.155, 2606:4700::6812:c9b, 2606:4700::6812:d9b
Response IP 104.18.13.155
Found Yes
Hash 66bca96df5d9d572a8dd5676e5e04bcf79de00d3d3e2f789c99d4033c4ad3a79
SimHash ce13cc00a613

Groups

*

Rule Path
Disallow /redir/
Disallow /?report
Disallow /?hb=
Disallow /?rfetch=
Disallow /svsrch
Disallow /hardware/
Disallow /software/
Disallow /games/
Disallow /video-foto-tv/
Disallow /telefon-co/
Disallow /audio-hifi/
Disallow /filme/
Disallow /haushalt/
Disallow /sport-freizeit/
Disallow /drogerie/
Disallow /auto-motorrad/
Disallow /spielzeug-modellbau/
Disallow /baumarkt-garten/
Disallow /analytics/
Disallow /?fs=
Disallow /*?*asuch=
Disallow /*?*mobile=
Disallow /*?*sort=
Disallow /*?*bpim=
Disallow /*?*bpmax=
Disallow /*?*v=
Disallow /*?*plz=
Disallow /*?*dist=
Disallow /*?*mail=
Disallow /*?*bl1_id=
Disallow /*?*phist=
Disallow /*?*view=
Disallow /*?*promode=
Disallow /*?*tableonly=

bingbot
hyscore

Rule Path
Disallow /redir/
Disallow /?report
Disallow /?hb=
Disallow /?fs=
Disallow /?rfetch=
Disallow /*?*pg=
Disallow /svsrch
Disallow /hardware/
Disallow /software/
Disallow /games/
Disallow /video-foto-tv/
Disallow /telefon-co/
Disallow /audio-hifi/
Disallow /filme/
Disallow /haushalt/
Disallow /sport-freizeit/
Disallow /drogerie/
Disallow /auto-motorrad/
Disallow /spielzeug-modellbau/
Disallow /baumarkt-garten/
Disallow /analytics/
Disallow /?fs=
Disallow /*?*asuch=
Disallow /*?*mobile=
Disallow /*?*sort=
Disallow /*?*bpim=
Disallow /*?*bpmax=
Disallow /*?*v=
Disallow /*?*plz=
Disallow /*?*dist=
Disallow /*?*mail=
Disallow /*?*bl1_id=
Disallow /*?*phist=
Disallow /*?*view=
Disallow /*?*promode=
Disallow /*?*tableonly=

Other Records

Field Value
crawl-delay 1

riddler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cenowarka.pl/smap/sitemap-pl-index.xml.gz