link-unlock.com
robots.txt

Robots Exclusion Standard data for link-unlock.com

Resource Scan

Scan Details

Site Domain link-unlock.com
Base Domain link-unlock.com
Scan Status Ok
Last Scan2026-02-19T14:09:06+00:00
Next Scan 2026-02-26T14:09:06+00:00

Last Scan

Scanned2026-02-19T14:09:06+00:00
URL https://link-unlock.com/robots.txt
Domain IPs 104.21.15.147, 172.67.206.82, 2606:4700:3030::ac43:ce52, 2606:4700:3035::6815:f93
Response IP 172.67.206.82
Found Yes
Hash f3f0eaf1170bc81537ec6206ee9d585500c07c91f61ef5267382ffc64a1224b3
SimHash 2b92deb2a621

Groups

*

Rule Path
Allow /
Allow /privacy
Allow /terms
Allow /%40*
Allow /register
Allow /login
Disallow /dashboard/
Disallow /admin/
Disallow /api/
Disallow /settings/
Disallow /_next/
Allow /images/
Allow /fonts/
Allow /favicon.ico
Allow /*.css
Allow /*.js

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://link-unlock.com/sitemap.xml

Comments

  • Sitemaps
  • Public content
  • Protected areas
  • Static assets (allow)
  • Crawl delay to prevent server overload