manpower.no
robots.txt

Robots Exclusion Standard data for manpower.no

Resource Scan

Scan Details

Site Domain manpower.no
Base Domain manpower.no
Scan Status Ok
Last Scan2024-11-07T12:11:33+00:00
Next Scan 2024-11-21T12:11:33+00:00

Last Scan

Scanned2024-11-07T12:11:33+00:00
URL https://manpower.no/robots.txt
Redirect https://www.manpower.no/robots.txt
Redirect Domain www.manpower.no
Redirect Base manpower.no
Domain IPs 104.18.35.189, 172.64.152.67, 2606:4700:4400::6812:23bd, 2606:4700:4400::ac40:9843
Redirect IPs 104.18.35.189, 172.64.152.67, 2606:4700:4400::6812:23bd, 2606:4700:4400::ac40:9843
Response IP 104.18.35.189
Found Yes
Hash bd2e7e9bf15b653b00768d72e359a8b2aa0e0fb47206ad7ffd9a6bf9ba677661
SimHash 28413e51e5b9

Groups

slurp

Rule Path
Allow /
Disallow /candidate

teoma

Rule Path
Allow /
Disallow /candidate

google

Rule Path
Allow /
Disallow /cs
Disallow /el
Disallow /fr
Disallow /ja
Disallow /ko
Disallow /pt
Disallow /ro
Disallow /sk
Disallow /tr
Disallow /vi
Disallow /cs-cz
Disallow /da-dk
Disallow /de-de
Disallow /en-be
Disallow /en-ch
Disallow /en-de
Disallow /en-fi
Disallow /en-ie
Disallow /en-il
Disallow /en-in
Disallow /en-my
Disallow /en-nl
Disallow /en-sg
Disallow /en-za
Disallow /es-ar
Disallow /es-cl
Disallow /es-co
Disallow /es-cr
Disallow /es-mx
Disallow /es-pe
Disallow /es-py
Disallow /es-uy
Disallow /fi-fi
Disallow /it-ch
Disallow /ko-kr
Disallow /pl-pl
Disallow /pt-br
Disallow /candidate

msnbot

Rule Path
Allow /
Disallow /candidate

exabot

Rule Path
Allow /
Disallow /candidate

bingbot

Rule Path
Allow /
Disallow /candidate

applebot

Rule Path
Allow /
Disallow /candidate

aolbuild

Rule Path
Allow /
Disallow /candidate

googlebot

Rule Path
Allow /
Disallow /candidate

deepcrawl

Rule Path
Allow /
Disallow /candidate

ahrefsbot

Rule Path
Allow /
Disallow /candidate

bingpreview

Rule Path
Allow /
Disallow /candidate

duckduckbot

Rule Path
Allow /
Disallow /candidate

ia_archiver

Rule Path
Allow /
Disallow /candidate

facebot/1.0

Rule Path
Allow /
Disallow /candidate

siteauditbot

Rule Path
Allow /
Disallow /candidate

adsbot-google

Rule Path
Allow /
Disallow /candidate

semrushbot-sa

Rule Path
Allow /
Disallow /candidate

semrushbot-ba

Rule Path
Allow /
Disallow /candidate

semrushbot-si

Rule Path
Allow /
Disallow /candidate

semrushbot-ct

Rule Path
Allow /
Disallow /candidate

semrushbot-bm

Rule Path
Allow /
Disallow /candidate

semrushbot-swa

Rule Path
Allow /
Disallow /candidate

splitsignalbot

Rule Path
Allow /
Disallow /candidate

archive.org_bot

Rule Path
Allow /
Disallow /candidate

mediapartners-google

Rule Path
Allow /
Disallow /candidate

siteimprovebot-crawler

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /
Disallow /candidate

*
facebookexternalhit

Rule Path
Allow /
Disallow /candidate

Other Records

Field Value
sitemap https://www.manpower.no/sitemap.xml