bilrudur.is
robots.txt

Robots Exclusion Standard data for bilrudur.is

Resource Scan

Scan Details

Site Domain bilrudur.is
Base Domain bilrudur.is
Scan Status Ok
Last Scan2024-09-28T19:31:36+00:00
Next Scan 2024-10-12T19:31:36+00:00

Last Scan

Scanned2024-09-28T19:31:36+00:00
URL https://bilrudur.is/robots.txt
Redirect https://www.orka.is/robots.txt
Redirect Domain www.orka.is
Redirect Base orka.is
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.22, 76.76.21.9
Response IP 76.76.21.241
Found Yes
Hash 5c1cdb3bea0a0c896005f5748923134d4400b52e0f951b40722fd93d2a5fe9f4
SimHash 50040053d7b0

Groups

ccbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

*

Rule Path
Allow /*
Disallow /api/*

Other Records

Field Value
sitemap https://www.orka.is/sitemap.xml

Warnings

  • `host` is not a known field.