subset.id
robots.txt

Robots Exclusion Standard data for subset.id

Resource Scan

Scan Details

Site Domain subset.id
Base Domain subset.id
Scan Status Ok
Last Scan2026-02-02T05:38:34+00:00
Next Scan 2026-03-04T05:38:34+00:00

Last Scan

Scanned2026-02-02T05:38:34+00:00
URL https://subset.id/robots.txt
Domain IPs 104.21.41.162, 172.67.148.58, 2606:4700:3032::ac43:943a, 2606:4700:3036::6815:29a2
Response IP 172.67.148.58
Found Yes
Hash 6cfef1df93bdfdf0c17b735d2bfe6344136e0936c9014eb12efd7bacb80a72bf
SimHash a104dc046112

Groups

*

Rule Path
Disallow /cache/