lydenavnorge.no
robots.txt

Robots Exclusion Standard data for lydenavnorge.no

Resource Scan

Scan Details

Site Domain lydenavnorge.no
Base Domain lydenavnorge.no
Scan Status Ok
Last Scan2024-07-02T04:43:23+00:00
Next Scan 2024-07-09T04:43:23+00:00

Last Scan

Scanned2024-07-02T04:43:23+00:00
URL https://lydenavnorge.no/robots.txt
Domain IPs 18.239.50.27, 18.239.50.29, 18.239.50.80, 18.239.50.9
Response IP 18.165.171.9
Found Yes
Hash 03fd49975fc92084abe465f58f2980b13ded68a6a2c1054dd73b6b5e095d4843
SimHash 7014014fe0c4

Groups

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

omgili

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /radioplayer/

*

Rule Path
Disallow /p4/player

*

Rule Path
Disallow /p5/player

*

Rule Path
Disallow /p6/player

*

Rule Path
Disallow /p7/player

*

Rule Path
Disallow /p8/player

*

Rule Path
Disallow /p9/player

*

Rule Path
Disallow /p10/player

*

Rule Path
Disallow /p11/player

*

Rule Path
Disallow /p12/player

*

Rule Path
Disallow /nrj/player