hastnet.se
robots.txt
Robots Exclusion Standard data for hastnet.se
Resource Scan
Scan Details
Site Domain | hastnet.se |
Base Domain | hastnet.se |
Scan Status | Ok |
Last Scan | 2024-05-16T21:30:13+00:00 |
Next Scan | 2024-05-23T21:30:13+00:00 |
Last Scan
Scanned | 2024-05-16T21:30:13+00:00 |
URL | https://hastnet.se/robots.txt |
Redirect | https://www.hastnet.se/robots.txt |
Redirect Domain | www.hastnet.se |
Redirect Base | hastnet.se |
Domain IPs | 104.26.14.10, 104.26.15.10, 172.67.70.115, 2606:4700:20::681a:e0a, 2606:4700:20::681a:f0a, 2606:4700:20::ac43:4673 |
Redirect IPs | 104.26.14.10, 104.26.15.10, 172.67.70.115, 2606:4700:20::681a:e0a, 2606:4700:20::681a:f0a, 2606:4700:20::ac43:4673 |
Response IP | 104.26.15.10 |
Found | Yes |
Hash | b0239da1e931a48a1cbce0658767a7b07037d7bdf9c415583792685cca67321e |
SimHash | 3601d9053f3a |
Groups
*
Rule | Path |
---|---|
Disallow | /api/* |
Disallow | /skapa-konto/byt-epost/*/ |
Disallow | /skapa-konto/bekrafta-epostadress/*/ |
Disallow | /skapa-konto/kontrollera-epost/* |
Disallow | /annonser/redigera/* |
Disallow | /annonser/forhandsvisning/* |
Disallow | /annonser/premium/* |
Disallow | /vas/checkout/* |
Disallow | /annonser/ny/* |
Disallow | /create-new-listing/* |
Disallow | /form-engine-playground/* |
Disallow | /chat/* |
Disallow | /*.pdf$ |
Disallow | /*?sortera= |
Disallow | /*?k%C3%B6n= |
Disallow | /*?F%C3%B6delsedatum= |
Disallow | /*?skick= |
Disallow | /*?support= |
Allow | */*/?category=* |
Allow | */*/?loperUt=true |
Other Records
Field | Value |
---|---|
sitemap | https://www.hastnet.se/sitemaps/sitemap_index.xml |
Warnings
- 1 invalid line.