clever.my.id
robots.txt

Robots Exclusion Standard data for clever.my.id

Resource Scan

Scan Details

Site Domain clever.my.id
Base Domain clever.my.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-14T11:27:54+00:00
Next Scan 2026-03-14T11:27:54+00:00

Last Successful Scan

Scanned2022-11-23T22:19:12+00:00
URL https://clever.my.id/robots.txt
Response IP 104.21.26.169, 172.67.137.101
Found Yes
Hash 11d8e48a9d9629fa5ad5fb001cf206577e9f84e42ebbf3145f80298837a97c23
SimHash a4414c0049d1

Groups

*

Rule Path
Disallow /admin
Disallow /user-*
Disallow /serach-*