justtechthings.com
robots.txt
Robots Exclusion Standard data for justtechthings.com
Resource Scan
Scan Details
| Site Domain | justtechthings.com |
| Base Domain | justtechthings.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-09-17T03:21:43+00:00 |
| Next Scan | 2025-12-16T03:21:43+00:00 |
Last Successful Scan
| Scanned | 2023-11-28T00:15:35+00:00 |
| URL | https://justtechthings.com/robots.txt |
| Redirect | https://www.justtechthings.com/robots.txt |
| Redirect Domain | www.justtechthings.com |
| Redirect Base | justtechthings.com |
| Domain IPs | 104.21.51.18, 172.67.218.119, 2606:4700:3032::6815:3312, 2606:4700:3032::ac43:da77 |
| Redirect IPs | 104.21.51.18, 172.67.218.119, 2606:4700:3032::6815:3312, 2606:4700:3032::ac43:da77 |
| Response IP | 104.21.51.18 |
| Found | Yes |
| Hash | 7f237eec03988fe9932670e03598172f7cc74e649e02e6fe0cb20b2a21389f3b |
| SimHash | 6f08c0c2e331 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |