gildi.is
robots.txt

Robots Exclusion Standard data for gildi.is

Resource Scan

Scan Details

Site Domain gildi.is
Base Domain gildi.is
Scan Status Ok
Last Scan2025-12-06T06:24:21+00:00
Next Scan 2026-01-05T06:24:21+00:00

Last Scan

Scanned2025-12-06T06:24:21+00:00
URL https://gildi.is/robots.txt
Domain IPs 52.17.138.106, 54.77.28.175, 63.33.226.8
Response IP 54.77.28.175
Found Yes
Hash c81f4c852e14fc9b37eafaf6f5bd37bb8317810cafafc3b8979139d1f8d25d1c
SimHash a125c90dcfd1

Groups

*

Rule Path
Disallow /admin

Comments

  • Set the full url to use the sitemap
  • Sitemap: __FULL_URL_HERE__/sitemap.xml