5dok.info
robots.txt

Robots Exclusion Standard data for 5dok.info

Resource Scan

Scan Details

Site Domain 5dok.info
Base Domain 5dok.info
Scan Status Ok
Last Scan2025-05-01T18:20:14+00:00
Next Scan 2025-05-08T18:20:14+00:00

Last Scan

Scanned2025-05-01T18:20:14+00:00
URL https://5dok.info/robots.txt
Domain IPs 159.203.78.164
Response IP 159.203.78.164
Found Yes
Hash 59a052352cb536149a2ab4fbf7c1f0bc89456c625428477cd990c2d647a01277
SimHash 7818546cc6de

Groups

*

Rule Path
Disallow /admin/
Disallow /user/
Disallow /app/
Disallow /livewire/
Disallow /api/
Disallow /auth/
Disallow /sapi/
Disallow /iframe/
Disallow /arrilot/
Disallow /search
Disallow /v4/
Disallow /v3/
Disallow /v2/
Disallow /document/download
Disallow /blog
Disallow /pub
Disallow /tagged
Disallow /upload
Disallow /*/download/

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://5dok.info/sitemaps/document
sitemap https://5dok.info/sitemaps/user-document
sitemap https://5dok.info/sitemaps/titles
sitemap https://5dok.info/sitemaps/subjects
sitemap https://5dok.info/sitemaps/parts
sitemap https://5dok.info/sitemap/recent-documents.xml
sitemap https://5dok.info/sitemap/recent-articles.xml