oknonet.pl
robots.txt

Robots Exclusion Standard data for oknonet.pl

Resource Scan

Scan Details

Site Domain oknonet.pl
Base Domain oknonet.pl
Scan Status Ok
Last Scan2025-12-10T19:46:57+00:00
Next Scan 2026-01-09T19:46:57+00:00

Last Scan

Scanned2025-12-10T19:46:57+00:00
URL https://oknonet.pl/robots.txt
Domain IPs 104.26.8.23, 104.26.9.23, 172.67.73.67, 2606:4700:20::681a:817, 2606:4700:20::681a:917, 2606:4700:20::ac43:4943
Response IP 172.67.73.67
Found Yes
Hash fa287c55c68c8d75625fed194f2031e849b3f4963ed489c2d2b0a3e8d22bd998
SimHash 4a18c8626e9b

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/uploads/
Disallow /trackback/
Disallow /feed/
Disallow /*?
Disallow /tag/
Disallow /category/

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://oknonet.pl/sitemap.xml

Comments

  • Blokowanie znanych złych botów
  • Blokowanie konkretnych obszarów WordPressa
  • Mapa strony XML