masterbloggen.no
robots.txt
Robots Exclusion Standard data for masterbloggen.no
Resource Scan
Scan Details
Site Domain | masterbloggen.no |
Base Domain | masterbloggen.no |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-17T22:53:58+00:00 |
Next Scan | 2025-10-01T22:53:58+00:00 |
Last Successful Scan
Scanned | 2025-08-10T19:24:39+00:00 |
URL | https://www.masterbloggen.no/robots.txt |
Domain IPs | 104.21.82.63, 172.67.197.111, 2606:4700:3032::6815:523f, 2606:4700:3036::ac43:c56f |
Response IP | 104.21.82.63 |
Found | Yes |
Hash | 2087c1b2617b3f98a516d5811f8c07475dbedd7b103bff03a06ea89be7203880 |
SimHash | e4155d4c0633 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
Disallow | /trackback/ |
Disallow | /feed/ |
Other Records
Field | Value |
---|---|
sitemap | http://masterbloggen.no/sitemap.xml |