Log In Sign Up

centrum-czesci.pl
robots.txt

Robots Exclusion Standard data for centrum-czesci.pl

Resource Scan

Scan Details

Site Domain centrum-czesci.pl
Base Domain centrum-czesci.pl
Scan Status Ok
Last Scan6/11/2025, 5:16:46 PM
Next Scan 7/11/2025, 5:16:46 PM

Last Scan

Scanned6/11/2025, 5:16:46 PM
URL https://centrum-czesci.pl/robots.txt
Domain IPs 77.79.221.140, 77.79.221.172
Response IP 77.79.221.172
Found Yes
Hash eb02538e0a97454bdb3336ee400afd46ab9aba6ad97b724358ba293bcdda0417
SimHash e93cbc50cdc3

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /
Disallow /*/p/mail/recommend
Disallow /*/p/q
Allow /environment/cache/images
Disallow /application
Disallow /environment
Disallow /libraries
Disallow /*/fav/add
Disallow /*/p/comment/add

claudebot

Rule Path
Disallow /

obot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://sklep79637.shoparena.pl/console/integration/execute/name/GoogleSitemap
Back to top

Comments

  • Disallow: /*/reg
  • Disallow: /*/login
  • Disallow: /*/basket
  • Disallow: /*/searchquery
Back to top

Warnings

  • `request-rate` is not a known field.
Back to top