aruf.my.id
robots.txt
Robots Exclusion Standard data for aruf.my.id
Resource Scan
Scan Details
| Site Domain | aruf.my.id |
| Base Domain | aruf.my.id |
| Scan Status | Ok |
| Last Scan | 2025-04-05T16:18:34+00:00 |
| Next Scan | 2025-04-12T16:18:34+00:00 |
Last Scan
| Scanned | 2025-04-05T16:18:34+00:00 |
| URL | https://www.aruf.my.id/robots.txt |
| Domain IPs | 104.21.25.83, 172.67.133.201, 2606:4700:3035::ac43:85c9, 2606:4700:3036::6815:1953 |
| Response IP | 104.21.25.83 |
| Found | Yes |
| Hash | 8994c147ee5b2c5059b05523fa2044c5a92f5d889787fa01afd2313d87f196c7 |
| SimHash | eb46c2d0d393 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /p/set-stu.html |
| Disallow | /p/thanks.html |
| Disallow | /p/blank-page.html |
| Disallow | /p/test.html |
| Disallow | /p/test-2.html |
| Disallow | /p/live.html |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aruf.my.id/sitemap.xml |
| sitemap | https://www.aruf.my.id/atom.xml?redirect=false&start-index=1&max-results=500 |
| sitemap | https://www.aruf.my.id/feeds/posts/default |
| sitemap | https://www.aruf.my.id/sitemap-pages.xml |