meningstorget.no
robots.txt
Robots Exclusion Standard data for meningstorget.no
Resource Scan
Scan Details
| Site Domain | meningstorget.no |
| Base Domain | meningstorget.no |
| Scan Status | Ok |
| Last Scan | 2024-06-25T01:51:46+00:00 |
| Next Scan | 2024-07-25T01:51:46+00:00 |
Last Scan
| Scanned | 2024-06-25T01:51:46+00:00 |
| URL | https://meningstorget.no/robots.txt |
| Redirect | https://www.meningstorget.no:443/robots.txt |
| Redirect Domain | www.meningstorget.no |
| Redirect Base | meningstorget.no |
| Domain IPs | 15.197.227.85, 3.33.246.177 |
| Redirect IPs | 13.35.18.10, 13.35.18.35, 13.35.18.41, 13.35.18.97, 2600:9000:20c7:1200:17:1c0b:7fc0:93a1, 2600:9000:20c7:7200:17:1c0b:7fc0:93a1, 2600:9000:20c7:8c00:17:1c0b:7fc0:93a1, 2600:9000:20c7:9e00:17:1c0b:7fc0:93a1, 2600:9000:20c7:aa00:17:1c0b:7fc0:93a1, 2600:9000:20c7:ba00:17:1c0b:7fc0:93a1, 2600:9000:20c7:ce00:17:1c0b:7fc0:93a1, 2600:9000:20c7:d600:17:1c0b:7fc0:93a1 |
| Response IP | 13.35.18.97 |
| Found | Yes |
| Hash | 4d2f088f4f01b065712fb369078abd7890d910a8d93ff7e27555c5dcaf29f3cc |
| SimHash | 51122e9401f2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /translation/preview/ |
| Disallow | /mobile_eula/ |
| Disallow | /mobile-privacy-policy/ |
| Disallow | /unsubscribe |
| Disallow | /affiliate |
| Disallow | /auth/ |
| Disallow | /legal |
| Disallow | /cookies |
| Disallow | /SocialSignup |
| Disallow | /secured/ |
| Disallow | /*/secured/* |
| Disallow | /Signup/ |
| Disallow | /Signup/* |
| Disallow | /general/news/ |
| Disallow | */general/news/* |
| Disallow | /general/recruitment/ |
| Disallow | */general/recruitment/* |
| Disallow | /general/facebook/ |
| Disallow | */general/facebook/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.meningstorget.no/sitemap.xml |