ras.is
robots.txt

Robots Exclusion Standard data for ras.is

Resource Scan

Scan Details

Site Domain ras.is
Base Domain ras.is
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-23T07:35:30+00:00
Next Scan 2025-09-21T07:35:30+00:00

Last Successful Scan

Scanned2024-05-22T17:58:34+00:00
URL https://ras.is/robots.txt
Redirect https://www.ras.is/robots.txt
Redirect Domain www.ras.is
Redirect Base ras.is
Domain IPs 52.19.46.82
Redirect IPs 13.226.2.121, 13.226.2.33, 13.226.2.53, 13.226.2.69, 2600:9000:21f8:4000:1d:9aac:9800:93a1, 2600:9000:21f8:7a00:1d:9aac:9800:93a1, 2600:9000:21f8:800:1d:9aac:9800:93a1, 2600:9000:21f8:b200:1d:9aac:9800:93a1, 2600:9000:21f8:c800:1d:9aac:9800:93a1, 2600:9000:21f8:f800:1d:9aac:9800:93a1, 2600:9000:21f8:fa00:1d:9aac:9800:93a1, 2600:9000:21f8:fe00:1d:9aac:9800:93a1
Response IP 18.165.171.78
Found Yes
Hash 242d2f546dd09d8b5ec2a555a32ead233521da3d8de288c1b171900ad7548fc0
SimHash a9219531cbeb

Groups

*

Rule Path
Disallow /*/search?
Disallow /*/leit?
Disallow /_w/
Disallow /inc/
Disallow /lang/
Disallow /lib/
Disallow /local/
Disallow /modules/
Disallow /sql/
Disallow /static/header/

Other Records

Field Value
crawl-delay 5