mcsiden.no
robots.txt

Robots Exclusion Standard data for mcsiden.no

Resource Scan

Scan Details

Site Domain mcsiden.no
Base Domain mcsiden.no
Scan Status Ok
Last Scan2026-02-14T22:13:21+00:00
Next Scan 2026-03-16T22:13:21+00:00

Last Scan

Scanned2026-02-14T22:13:21+00:00
URL https://mcsiden.no/robots.txt
Domain IPs 2a02:2350:5:102:8062:4ab3:e90c:86b9, 77.111.240.172
Response IP 77.111.240.172
Found Yes
Hash 95e3c3bb14e81bc521f0484bcd093ae204943829f8838afe60295d23af567654
SimHash 425edc40e290

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 20

dotbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10