pro.dk
robots.txt
Robots Exclusion Standard data for pro.dk
Resource Scan
Scan Details
Site Domain | pro.dk |
Base Domain | pro.dk |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2025-05-24T15:29:19+00:00 |
Next Scan | 2025-08-22T15:29:19+00:00 |
Last Successful Scan
Scanned | 2023-04-13T14:45:24+00:00 |
URL | https://pro.dk/robots.txt |
Domain IPs | 87.116.31.16 |
Response IP | 87.116.31.16 |
Found | Yes |
Hash | 2826059db5135d16b87e8c8d77022d6780d17075d65649b0dc52bf6d0aa1846f |
SimHash | 390d1943a5c6 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /*/ctl/ | Googlebot permits * |
Disallow | /admin/ | - |
Disallow | /App_Browsers/ | - |
Disallow | /App_Code/ | - |
Disallow | /App_Data/ | - |
Disallow | /App_GlobalResources/ | - |
Disallow | /bin/ | - |
Disallow | /Components/ | - |
Disallow | /Config/ | - |
Disallow | /contest/ | - |
Disallow | /controls/ | - |
Disallow | /Documentation/ | - |
Disallow | /HttpModules/ | - |
Disallow | /Install/ | - |
Disallow | /Providers/ | - |
Disallow | /Activity-Feed/userId/ | Do not index user profiles |
Comments