friflyt.no
robots.txt
Robots Exclusion Standard data for friflyt.no
Resource Scan
Scan Details
Site Domain | friflyt.no |
Base Domain | friflyt.no |
Scan Status | Ok |
Last Scan | 2024-09-11T17:38:42+00:00 |
Next Scan | 2024-10-11T17:38:42+00:00 |
Last Scan
Scanned | 2024-09-11T17:38:42+00:00 |
URL | https://friflyt.no/robots.txt |
Redirect | https://www.friflyt.no:443/robots.txt |
Redirect Domain | www.friflyt.no |
Redirect Base | friflyt.no |
Domain IPs | 18.197.240.245, 3.125.79.39, 52.28.96.130 |
Redirect IPs | 18.155.68.103, 18.155.68.64, 18.155.68.66, 18.155.68.96 |
Response IP | 18.155.68.64 |
Found | Yes |
Hash | 0a44f42001096eb28e347a50d9637ee512198f4c60a3447703215ce610ca7993 |
SimHash | e544d136a393 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /abonnement/ |
Disallow | /user/ |
Disallow | /iuser/ |
Disallow | /sso/ |
Disallow | /fakta/footer |
Disallow | /sitemap.json |
Disallow | /bruktmarked/create |
Disallow | /bruktmarked/list |
Disallow | /bruktmarked/update/* |
Disallow | /forum/ny/* |
Disallow | /content/* |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.friflyt.no/sitemap.xml.gz |