bl.is
robots.txt

Robots Exclusion Standard data for bl.is

Resource Scan

Scan Details

Site Domain bl.is
Base Domain bl.is
Scan Status Ok
Last Scan2025-11-12T09:39:52+00:00
Next Scan 2025-12-12T09:39:52+00:00

Last Scan

Scanned2025-11-12T09:39:52+00:00
URL https://bl.is/robots.txt
Redirect https://www.bl.is/robots.txt
Redirect Domain www.bl.is
Redirect Base bl.is
Domain IPs 104.26.14.188, 104.26.15.188, 172.67.74.27, 2606:4700:20::681a:ebc, 2606:4700:20::681a:fbc, 2606:4700:20::ac43:4a1b
Redirect IPs 104.26.14.188, 104.26.15.188, 172.67.74.27, 2606:4700:20::681a:ebc, 2606:4700:20::681a:fbc, 2606:4700:20::ac43:4a1b
Response IP 172.67.74.27
Found Yes
Hash c81f4c852e14fc9b37eafaf6f5bd37bb8317810cafafc3b8979139d1f8d25d1c
SimHash a125c90dcfd1

Groups

*

Rule Path
Disallow /admin

Comments

  • Set the full url to use the sitemap
  • Sitemap: __FULL_URL_HERE__/sitemap.xml