superprof.no
robots.txt

Robots Exclusion Standard data for superprof.no

Resource Scan

Scan Details

Site Domain superprof.no
Base Domain superprof.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-04T06:45:10+00:00
Next Scan 2025-10-03T06:45:10+00:00

Last Successful Scan

Scanned2025-05-14T05:59:49+00:00
URL https://superprof.no/robots.txt
Redirect https://www.superprof.no/robots.txt
Redirect Domain www.superprof.no
Redirect Base superprof.no
Domain IPs 18.172.213.107, 18.172.213.122, 18.172.213.52, 18.172.213.88, 2600:9000:2837:4400:1f:58b0:2b40:93a1, 2600:9000:2837:4e00:1f:58b0:2b40:93a1, 2600:9000:2837:6a00:1f:58b0:2b40:93a1, 2600:9000:2837:800:1f:58b0:2b40:93a1, 2600:9000:2837:8200:1f:58b0:2b40:93a1, 2600:9000:2837:a00:1f:58b0:2b40:93a1, 2600:9000:2837:a400:1f:58b0:2b40:93a1, 2600:9000:2837:c200:1f:58b0:2b40:93a1
Redirect IPs 2600:9000:2792:1400:1f:58b0:2b40:93a1, 2600:9000:2792:3200:1f:58b0:2b40:93a1, 2600:9000:2792:3400:1f:58b0:2b40:93a1, 2600:9000:2792:6e00:1f:58b0:2b40:93a1, 2600:9000:2792:9200:1f:58b0:2b40:93a1, 2600:9000:2792:aa00:1f:58b0:2b40:93a1, 2600:9000:2792:c800:1f:58b0:2b40:93a1, 2600:9000:2792:e800:1f:58b0:2b40:93a1, 3.169.71.10, 3.169.71.13, 3.169.71.25, 3.169.71.37
Response IP 108.156.22.98
Found Yes
Hash 3256b851a8ab61566cb486df92233739dbfba4354e89304ae5638f69bffef4e2
SimHash 0a021835e9b3

Groups

*

Rule Path
Disallow /linking-*
Disallow /dashbord*
Disallow /lib/
Disallow /ajax/
Disallow /a/
Disallow /blog/?s=*
Disallow /blog/?wordfence_lh=*
Disallow *?replytocom=*

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.superprof.no/sitemap.xml
sitemap https://www.superprof.no/blog/sitemap.xml