discordzik.pl
robots.txt

Robots Exclusion Standard data for discordzik.pl

Resource Scan

Scan Details

Site Domain discordzik.pl
Base Domain discordzik.pl
Scan Status Ok
Last Scan2025-11-19T11:38:31+00:00
Next Scan 2025-11-26T11:38:31+00:00

Last Scan

Scanned2025-11-19T11:38:31+00:00
URL https://discordzik.pl/robots.txt
Domain IPs 104.21.69.33, 172.67.203.154, 2606:4700:3030::6815:4521, 2606:4700:3035::ac43:cb9a
Response IP 104.21.69.33
Found Yes
Hash b3ef05c977de54d31e92a2f6adf4ce5faa9405c314b09214faceadd308406157
SimHash 05295e5044a0

Groups

*

Rule Path
Allow /$
Allow /server/
Allow /bots/
Allow /categories/
Disallow /dashboard/
Disallow /account/
Disallow /api/
Disallow /admin/
Disallow /private/
Disallow /bots/new/
Disallow /servers/new/
Disallow /profile/
Disallow /*/edit/
Disallow /*/delete/
Disallow /*?*
Disallow /404/
Disallow /blocked/
Disallow /auth/
Disallow /login/
Disallow /callback/
Disallow /tos/
Disallow /privacy/
Disallow /cookies/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://discordzik.pl/sitemap_index.xml

Comments

  • Legal pages
  • Crawl directives
  • Sitemaps