agrego.id
robots.txt

Robots Exclusion Standard data for agrego.id

Resource Scan

Scan Details

Site Domain agrego.id
Base Domain agrego.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-27T01:31:59+00:00
Next Scan 2026-03-13T01:31:59+00:00

Last Successful Scan

Scanned2025-12-29T01:21:56+00:00
URL https://agrego.id/robots.txt
Domain IPs 104.21.10.52, 172.67.131.60, 2606:4700:3033::6815:a34, 2606:4700:3033::ac43:833c
Response IP 172.67.131.60
Found Yes
Hash 7caf652dba777fcc00c1acf4ca5462228c45aff2d754dc52f88e98dd634ddddd
SimHash 61019c004b93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://agrego.id/wp-sitemap.xml