ahlsell.no
robots.txt

Robots Exclusion Standard data for ahlsell.no

Resource Scan

Scan Details

Site Domain ahlsell.no
Base Domain ahlsell.no
Scan Status Ok
Last Scan2024-10-21T20:01:39+00:00
Next Scan 2024-11-20T20:01:39+00:00

Last Scan

Scanned2024-10-21T20:01:39+00:00
URL https://ahlsell.no/robots.txt
Redirect https://www.ahlsell.no/robots.txt
Redirect Domain www.ahlsell.no
Redirect Base ahlsell.no
Domain IPs 13.107.246.10
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.57
Found Yes
Hash 2356e417a35a5078957e994fda7ae70e4f9786475604986c741ce07683bc3652
SimHash d844dc8072a1

Groups

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /da-DK/
Disallow /sv-SE/
Disallow /fi-FI/
Disallow /nn-NO/

Other Records

Field Value
crawl-delay 10