finn.no
robots.txt

Groups

*

baiduspider

twitterbot

indeedbot

jobblebot

neuvoo

Other Records

Comments

• Notice: Crawling FINN.no is prohibited unless you have written permission.
• See the terms and conditions in the footer:
• Innholdet er beskyttet etter åndsverksloven. Bruk av automatiserte tjenester (roboter, spidere, indeksering m.m.)
• samt andre fremgangsmåter for systematisk eller regelmessig bruk er ikke tillatt uten eksplisitt samtykke fra FINN.no.
• tmp disabled: Disallow: /user/
• Don't index searches for old gallery urls
• FAS shortcut links:
• If googlebot respects that these 301 to a disallowed page, we can remove these.
• 50k weekly. Many google referrers
• 20k weekly. Many google referrers
• 4k weekly. Many google referrers
• motor rules
• bil vertical
• nyttekjøretøy
• vanused and vanimport already handled in bil
• indexing of b2b ads wanted
• mc
• indexing of mc ads not wanted
• båt
• indexing of boat ads not wanted
• Eiendom
• Bolig til leie - result page.
• allowed realestate ad pages:
• disallowed realestate ad pages:
• BAP
• Indexable, with some exceptions, see end of file
• Disallow: /bap/shipping.html
• JOB
• Indexable, with some exceptions, see end of file
• PAL (PArtnerLøsning)
• disallow ad and search pages
• REISE
• disallow flight search results
• Personal Finance
• Shopping was discontinued 2019.
• Misc
• Exceptions:
• Twitterbot is allowed for Twitter Cards to work