dadavidson.com
robots.txt
Robots Exclusion Standard data for dadavidson.com
Resource Scan
Scan Details
| Site Domain | dadavidson.com |
| Base Domain | dadavidson.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-05-18T22:04:00+00:00 |
| Next Scan | 2025-08-16T22:04:00+00:00 |
Last Successful Scan
| Scanned | 2024-09-28T19:57:23+00:00 |
| URL | https://dadavidson.com/robots.txt |
| Domain IPs | 104.18.32.247, 172.64.155.9, 2606:4700:4400::6812:20f7, 2606:4700:4400::ac40:9b09 |
| Response IP | 172.64.155.9 |
| Found | Yes |
| Hash | 2826059db5135d16b87e8c8d77022d6780d17075d65649b0dc52bf6d0aa1846f |
| SimHash | 390d1943a5c6 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Googlebot permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
Comments