beritaindependen.com
robots.txt

Robots Exclusion Standard data for beritaindependen.com

Resource Scan

Scan Details

Site Domain beritaindependen.com
Base Domain beritaindependen.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-21T13:04:04+00:00
Next Scan 2025-11-19T13:04:04+00:00

Last Successful Scan

Scanned2025-01-01T12:53:41+00:00
URL https://beritaindependen.com/robots.txt
Domain IPs 172.96.191.224
Response IP 172.96.191.224
Found Yes
Hash 9621dd53e12c2a6fbd56982b8c3c15e3228c4cc5921139f5b41897c602795fff
SimHash 41008c00c9b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://beritaindependen.com/sitemaps.xml