licenses.dev
robots.txt

Robots Exclusion Standard data for licenses.dev

Resource Scan

Scan Details

Site Domain licenses.dev
Base Domain licenses.dev
Scan Status Ok
Last Scan2026-03-20T00:03:22+00:00
Next Scan 2026-04-19T00:03:22+00:00

Last Scan

Scanned2026-03-20T00:03:22+00:00
URL https://licenses.dev/robots.txt
Domain IPs 104.21.60.141, 172.67.197.130, 2606:4700:3032::ac43:c582, 2606:4700:3035::6815:3c8d
Response IP 172.67.197.130
Found Yes
Hash ef42416094b57fdb1ec5e53e29e73e8816a50555b04c9f81ecbec16aacd3412f
SimHash c10d91148533

Groups

*

Rule Path
Disallow /b/
Allow /

Other Records

Field Value
sitemap https://licenses.dev/sitemap.xml