augustman.com
robots.txt
Robots Exclusion Standard data for augustman.com
Resource Scan
Scan Details
| Site Domain | augustman.com |
| Base Domain | augustman.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-20T02:26:44+00:00 |
| Next Scan | 2024-06-19T02:26:44+00:00 |
Last Successful Scan
| Scanned | 2024-04-21T00:19:12+00:00 |
| URL | https://augustman.com/robots.txt |
| Redirect | https://www.augustman.com/robots.txt |
| Redirect Domain | www.augustman.com |
| Redirect Base | augustman.com |
| Domain IPs | 104.21.66.43, 172.67.156.171, 2606:4700:3037::6815:422b, 2606:4700:3037::ac43:9cab |
| Redirect IPs | 13.33.88.106, 13.33.88.114, 13.33.88.28, 13.33.88.57, 2600:9000:223b:1200:1b:e54d:c140:93a1, 2600:9000:223b:3200:1b:e54d:c140:93a1, 2600:9000:223b:4400:1b:e54d:c140:93a1, 2600:9000:223b:5c00:1b:e54d:c140:93a1, 2600:9000:223b:6e00:1b:e54d:c140:93a1, 2600:9000:223b:9a00:1b:e54d:c140:93a1, 2600:9000:223b:9c00:1b:e54d:c140:93a1, 2600:9000:223b:f000:1b:e54d:c140:93a1 |
| Response IP | 13.33.88.114 |
| Found | Yes |
| Hash | be7dabec12b004b8ce689755fe41db0fcd8beaa6e5fcf8e558b759a527c00fa5 |
| SimHash | 132f6174ce31 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*/wp-admin |
| Disallow | /*/wp-login.php |
| Disallow | */feed/* |
| Disallow | *?path=* |
| Disallow | /1021996/ |
| Disallow | /var/augustman/ |
| Disallow | */wp-content/plugins/ |
| Disallow | */wp-includes/css/ |
| Disallow | /*?amp=* |
| Disallow | /id/* |
| Disallow | */newsletter/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.augustman.com/sg/news-sitemap.xml |
| sitemap | https://www.augustman.com/sg/sitemap_index.xml |
| sitemap | https://www.augustman.com/my/news-sitemap.xml |
| sitemap | https://www.augustman.com/my/sitemap_index.xml |
| sitemap | https://www.augustman.com/in/news-sitemap.xml |
| sitemap | https://www.augustman.com/in/sitemap_index.xml |
| sitemap | https://www.augustman.com/th/news-sitemap.xml |
| sitemap | https://www.augustman.com/th/sitemap_index.xml |
| sitemap | https://www.augustman.com/hk/news-sitemap.xml |
| sitemap | https://www.augustman.com/hk/sitemap_index.xml |