elbil24.no
robots.txt
Robots Exclusion Standard data for elbil24.no
Resource Scan
Scan Details
Site Domain | elbil24.no |
Base Domain | elbil24.no |
Scan Status | Ok |
Last Scan | 2024-06-06T17:30:43+00:00 |
Next Scan | 2024-06-13T17:30:43+00:00 |
Last Scan
Scanned | 2024-06-06T17:30:43+00:00 |
URL | https://elbil24.no/robots.txt |
Redirect | https://www.elbil24.no/robots.txt |
Redirect Domain | www.elbil24.no |
Redirect Base | elbil24.no |
Domain IPs | 2a02:c0:ac:3:db::180, 2a02:c0:ac:3:db::181, 2a02:c0:ac:3:db::182, 2a02:c0:ac:3:db::183, 87.238.33.180, 87.238.33.181, 87.238.33.182, 87.238.33.183 |
Redirect IPs | 2a02:c0:ac:3:db::180, 2a02:c0:ac:3:db::181, 2a02:c0:ac:3:db::182, 2a02:c0:ac:3:db::183, 87.238.33.180, 87.238.33.181, 87.238.33.182, 87.238.33.183 |
Response IP | 87.238.33.180 |
Found | Yes |
Hash | 38a954b394b10d54675969943ad9bd0417d92beb294444cb468e9eb433846b9f |
SimHash | 101e0971e117 |
Groups
*
Rule | Path |
---|---|
Disallow | /youtube-player/ |
Disallow | /video/playlist/ |
Disallow | /video/popular/ |
Disallow | /video/* |
Disallow | /app/* |
Allow | /app/cyclops-router-api/api/v1/ |
Allow | /app/jw-api-proxy/sitemap/index/elbil24.xml |
Allow | /video/*/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.elbil24.no/sitemapindex.xml |
sitemap | https://elbil24.no/app/jw-api-proxy/sitemap/index/elbil24.xml |