aws.awdev.my.id
robots.txt
Robots Exclusion Standard data for aws.awdev.my.id
Resource Scan
Scan Details
| Site Domain | aws.awdev.my.id |
| Base Domain | awdev.my.id |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-08-23T13:16:14+00:00 |
| Next Scan | 2025-11-21T13:16:14+00:00 |
Last Successful Scan
| Scanned | 2022-09-22T13:21:22+00:00 |
| URL | http://aws.awdev.my.id/robots.txt |
| Response IP | 142.251.12.121 |
| Found | Yes |
| Hash | b8f51fc8267227a4839f6195773debbf18bc53ab2d22e4cb855ca8ed3c29fa35 |
| SimHash | 6d4597755451 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /?m=0 |
| Disallow | /?m=1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://awsos.com/sitemap.xml |
| sitemap | https://awsos.blogspot.com/news-sitemap.xml |
| sitemap | http://www.awsos.blogspot.com/feeds/posts/default?orderby=updated |
| sitemap | https://www.awsos.blogspot.com/sitemapimages.xml |
| sitemap | https://www.awsos.blogspot.com/sitemap.xml |
| sitemap | https://www.awsos.blogspot.com/news-sitemap.xml |
| sitemap | https://www.awsos.blogspot.com/feeds/posts/default?orderby=updated |
| sitemap | https://www.awsos.blogspot.com/sitemap.xml?page=1 |
| sitemap | https://www.awsos.blogspot.com/sitemap.xml?page=2 |
| sitemap | https://www.awsos.blogspot.com/sitemap.xml?page=3 |
| sitemap | https://www.awsos.blogspot.com/atom.xml?redirect=false&start-index=101&max-results=100 |
| sitemap | https://www.awsos.blogspot.com/feeds/posts/default?orderby=updated |