stories.web.id
robots.txt
Robots Exclusion Standard data for stories.web.id
Resource Scan
Scan Details
| Site Domain | stories.web.id |
| Base Domain | stories.web.id |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-08T20:43:11+00:00 |
| Next Scan | 2024-07-07T20:43:11+00:00 |
Last Successful Scan
| Scanned | 2021-08-29T14:16:36+00:00 |
| URL | https://stories.web.id/robots.txt |
| Found | Yes |
| Hash | a4148976b35e757b0844ab7a75307d2a26fccea48bea6203700b6e71759b51e7 |
| SimHash | 2800c3d05613 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ads.txt |
| Allow | /upload |
| Disallow | /ads |
| Disallow | /beranda |
| Disallow | /add |
| Disallow | /edit |
| Disallow | /search |
| Disallow | /v1 |
| Disallow | /v2 |
| Disallow | /v3 |
| Disallow | /edittext |
| Disallow | /notification |
| Disallow | /menulis |
| Disallow | /undangan |
| Disallow | /write |
| Disallow | /preview |
| Disallow | /login |
| Disallow | /daftar |
| Disallow | /maintenance.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://stories.web.id/sitemap.xml |