hastnet.se
robots.txt

Robots Exclusion Standard data for hastnet.se

Resource Scan

Scan Details

Site Domain hastnet.se
Base Domain hastnet.se
Scan Status Ok
Last Scan2024-05-16T21:30:13+00:00
Next Scan 2024-05-23T21:30:13+00:00

Last Scan

Scanned2024-05-16T21:30:13+00:00
URL https://hastnet.se/robots.txt
Redirect https://www.hastnet.se/robots.txt
Redirect Domain www.hastnet.se
Redirect Base hastnet.se
Domain IPs 104.26.14.10, 104.26.15.10, 172.67.70.115, 2606:4700:20::681a:e0a, 2606:4700:20::681a:f0a, 2606:4700:20::ac43:4673
Redirect IPs 104.26.14.10, 104.26.15.10, 172.67.70.115, 2606:4700:20::681a:e0a, 2606:4700:20::681a:f0a, 2606:4700:20::ac43:4673
Response IP 104.26.15.10
Found Yes
Hash b0239da1e931a48a1cbce0658767a7b07037d7bdf9c415583792685cca67321e
SimHash 3601d9053f3a

Groups

ias_crawler

Rule Path
Disallow

ias_wombles

Rule Path
Disallow

*

Rule Path
Disallow /api/*
Disallow /skapa-konto/byt-epost/*/
Disallow /skapa-konto/bekrafta-epostadress/*/
Disallow /skapa-konto/kontrollera-epost/*
Disallow /annonser/redigera/*
Disallow /annonser/forhandsvisning/*
Disallow /annonser/premium/*
Disallow /vas/checkout/*
Disallow /annonser/ny/*
Disallow /create-new-listing/*
Disallow /form-engine-playground/*
Disallow /chat/*
Disallow /*.pdf$
Disallow /*?sortera=
Disallow /*?k%C3%B6n=
Disallow /*?F%C3%B6delsedatum=
Disallow /*?skick=
Disallow /*?support=
Allow */*/?category=*
Allow */*/?loperUt=true

Other Records

Field Value
sitemap https://www.hastnet.se/sitemaps/sitemap_index.xml

Warnings

  • 1 invalid line.