cenobitz.pl
robots.txt
Robots Exclusion Standard data for cenobitz.pl
Resource Scan
Scan Details
| Site Domain | cenobitz.pl |
| Base Domain | cenobitz.pl |
| Scan Status | Ok |
| Last Scan | 2025-10-13T09:03:07+00:00 |
| Next Scan | 2025-10-20T09:03:07+00:00 |
Last Scan
| Scanned | 2025-10-13T09:03:07+00:00 |
| URL | https://cenobitz.pl/robots.txt |
| Redirect | https://cenobitz.com/robots.txt |
| Redirect Domain | cenobitz.com |
| Redirect Base | cenobitz.com |
| Domain IPs | 146.59.21.247 |
| Redirect IPs | 137.74.7.246 |
| Response IP | 137.74.7.246 |
| Found | Yes |
| Hash | 945a155b8cb9a36aaa8a16b56a801ed3eacc8c610fd5e2e08e2c98782b124c39 |
| SimHash | 500a5540e237 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
claude
anthropic-ai
anthropicbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
ahrefsbot
mj12bot
semrushbot
semrushbot-sa
seokicks
seokicks-robot
sistrix
sistrixcrawler
cognitiveseo
screaming frog seo spider
rogerbot
dotbot
spbot
mauibot
seolyticscrawler
seekport
searchmetricsbot
| Rule | Path |
|---|---|
| Disallow | / |
turnitinbot
turnitinbot/3.0
heritrix
pimonster
pimonster
eccp/1.0 (search@eniro.com)
yandex
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
ezooms robot
perl lwp
blexbot
netestate ne crawler (+http://www.website-datenbank.de/)
wiseguys robot
megaindex.ru
gsa-crawler (enterprise; t4-knhh62cdkc2w3; gsa_manage@nikon-sys.co.jp)
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /api/ |
| Disallow | /private/ |
| Disallow | /temp/ |
| Disallow | /drafts/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cenobitz.com/sitemap.xml |
Comments