Log In Sign Up

hemnet.se
robots.txt

Robots Exclusion Standard data for hemnet.se

Resource Scan

Scan Details

Site Domain hemnet.se
Base Domain hemnet.se
Scan Status Ok
Last Scan2024-11-09T09:53:52+00:00
Next Scan 2024-11-16T09:53:52+00:00

Last Scan

Scanned2024-11-09T09:53:52+00:00
URL https://hemnet.se/robots.txt
Redirect https://www.hemnet.se/robots.txt
Redirect Domain www.hemnet.se
Redirect Base hemnet.se
Domain IPs 104.18.97.117, 104.18.98.117, 2606:4700::6812:6175, 2606:4700::6812:6275
Redirect IPs 104.18.97.117, 104.18.98.117, 2606:4700::6812:6175, 2606:4700::6812:6275
Response IP 104.18.98.117
Found Yes
Hash ea8ec56a10cd6981ec7c98151597ee83a993d9c983d639bfbaf1eeb624cae4c9
SimHash 66508d40cfd1

Groups

*
*

Rule Path
Disallow /betalning/*

*

Rule Path
Disallow /raketen/*

*

Rule Path
Allow /raketen/kampanj

*

Rule Path
Disallow /paket/*

*

Rule Path
Disallow /paketval/*

*

Rule Path
Disallow /fornya-annons/*

*

Rule Path
Disallow /saljkollen/*
Back to top

Other Records

Field Value
sitemap https://www.hemnet.se/sitemap.xml
Back to top

Comments

  • Kul att du hittat hit!
  • Vill du också jobba på en av Sveriges största sajter med miljontals unika besökare?
  • Gör en spontanansökan på https://career.hemnet.se/
  • Block all crawlers for checkout since there is no reason for a bot to be here
  • Block all crawlers for toplisting page since it is a unique page for every listing and nothing here we want a bot to find
  • Alllow all crawlers to reach the campaign page for toplisting and nothing here we want a bot to find
  • Block all crawlers for package upgrade page since it is a unique page for every listing and nothing here we want a bot to find
  • Block all crawlers for initial package selection page since it is a unique page for every listing and nothing here we want a bot to find
  • Block all crawlers for renewal page since it is a unique page for every listing and nothing here we want a bot to find
  • Block all crawlers for sellers page since it is a unique page for every listing and nothing here we want a bot to find
Back to top