nrynek.pl
robots.txt

Robots Exclusion Standard data for nrynek.pl

Resource Scan

Scan Details

Site Domain nrynek.pl
Base Domain nrynek.pl
Scan Status Ok
Last Scan2025-10-05T22:25:10+00:00
Next Scan 2025-11-04T22:25:10+00:00

Last Scan

Scanned2025-10-05T22:25:10+00:00
URL https://nrynek.pl/robots.txt
Domain IPs 212.7.213.33
Response IP 212.7.213.33
Found Yes
Hash 453a4a9d88e2cc2db819ef498dfde69113e1f854d67719fbee18fdf4ba98bef1
SimHash 715cd0e0df10

Groups

*

Rule Path
Allow /
Disallow /rss
Disallow /users/login.html
Disallow /schowek.html

Other Records

Field Value
crawl-delay 900

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14400

amazonbot

Rule Path
Disallow /