rokibulroni.com
robots.txt

Robots Exclusion Standard data for rokibulroni.com

Resource Scan

Scan Details

Site Domain rokibulroni.com
Base Domain rokibulroni.com
Scan Status Ok
Last Scan2026-01-22T17:02:41+00:00
Next Scan 2026-01-29T17:02:41+00:00

Last Scan

Scanned2026-01-22T17:02:41+00:00
URL https://rokibulroni.com/robots.txt
Domain IPs 104.21.3.101, 172.67.153.129, 2606:4700:3035::ac43:9981, 2606:4700:3036::6815:365
Response IP 172.67.153.129
Found Yes
Hash 615a7497c8eb28de2d2956fbc7379e46e81f17050dba2567b8b074a040ce6775
SimHash 4d4511c4e79b

Groups

*

Rule Path
Allow /$
Allow /index.html
Allow /about/
Allow /contact/
Allow /work/
Allow /work/.*
Allow /blog/
Allow /blog/.*
Disallow /private/
Disallow /admin/
Disallow /notes/

Other Records

Field Value
sitemap https://rokibulroni.com/sitemap.xml

Comments

  • robots.txt – rokibulroni.com
  • Explicitly allow important public pages
  • Block everything else under subdomains or unlisted paths
  • Sitemap for fast discovery