mcawee.com
robots.txt
Robots Exclusion Standard data for mcawee.com
Resource Scan
Scan Details
| Site Domain | mcawee.com |
| Base Domain | mcawee.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-03-29T05:21:00+00:00 |
| Next Scan | 2025-04-12T05:21:00+00:00 |
Last Successful Scan
| Scanned | 2025-02-19T04:02:56+00:00 |
| URL | http://mcawee.com/robots.txt |
| Redirect | https://trackme.wdk18.com/coinbase/mcawee/robots.txt |
| Redirect Domain | trackme.wdk18.com |
| Redirect Base | wdk18.com |
| Domain IPs | 2a00:18e0:5:2:7577:4e4d:413b:f507, 2a00:18e0:5:3:dfe2:c743:85aa:61bc, 5.22.145.121, 5.22.145.16 |
| Redirect IPs | 104.21.58.228, 172.67.165.215, 2606:4700:3033::6815:3ae4, 2606:4700:3036::ac43:a5d7 |
| Response IP | 104.21.58.228 |
| Found | Yes |
| Hash | 8a589dc20d195b5b788660b96f3f55f3cce99172417b62a1b9e40d527bc7a5a7 |
| SimHash | 4104d661c731 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |