justinagustin.com
robots.txt
Robots Exclusion Standard data for justinagustin.com
Resource Scan
Scan Details
| Site Domain | justinagustin.com |
| Base Domain | justinagustin.com |
| Scan Status | Ok |
| Last Scan | 2025-11-06T05:48:30+00:00 |
| Next Scan | 2025-11-20T05:48:30+00:00 |
Last Scan
| Scanned | 2025-11-06T05:48:30+00:00 |
| URL | https://justinagustin.com/robots.txt |
| Domain IPs | 34.120.223.236 |
| Response IP | 34.120.223.236 |
| Found | Yes |
| Hash | d3a399f522736ba0875be172c40d571f5aef75d0f7ee590bd2cd1114f71e5b9c |
| SimHash | ad0098060f90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /users/sign_up |
| Disallow | /users/password/new |
| Disallow | /sign_in |
| Disallow | /dashboard |
Other Records
| Field | Value |
|---|---|
| sitemap | https://justinagustin.com/sitemap.xml |