wartaekonomi.co.id
robots.txt
Robots Exclusion Standard data for wartaekonomi.co.id
Resource Scan
Scan Details
| Site Domain | wartaekonomi.co.id |
| Base Domain | wartaekonomi.co.id |
| Scan Status | Ok |
| Last Scan | 2024-11-04T19:56:59+00:00 |
| Next Scan | 2024-11-11T19:56:59+00:00 |
Last Scan
| Scanned | 2024-11-04T19:56:59+00:00 |
| URL | https://wartaekonomi.co.id/robots.txt |
| Domain IPs | 104.26.2.12, 104.26.3.12, 172.67.70.25, 2606:4700:20::681a:20c, 2606:4700:20::681a:30c, 2606:4700:20::ac43:4619 |
| Response IP | 172.67.70.25 |
| Found | Yes |
| Hash | 782e8853c067b146f83db176f614a6209ee24f3062c6a1250156c0486441b4f7 |
| SimHash | 291f8772c151 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /campaign/ |
| Disallow | /cdn-cgi/ |
| Disallow | /search* |
| Disallow | /websub/popular/* |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://wartaekonomi.co.id/sitemap.xml |