pers.my.id
robots.txt

Robots Exclusion Standard data for pers.my.id

Resource Scan

Scan Details

Site Domain pers.my.id
Base Domain pers.my.id
Scan Status Ok
Last Scan2025-11-17T09:50:13+00:00
Next Scan 2025-11-24T09:50:13+00:00

Last Scan

Scanned2025-11-17T09:50:13+00:00
URL https://pers.my.id/robots.txt
Redirect https://www.pers.my.id/robots.txt
Redirect Domain www.pers.my.id
Redirect Base pers.my.id
Domain IPs 104.21.29.174, 172.67.149.142, 2606:4700:3034::6815:1dae, 2606:4700:3035::ac43:958e
Redirect IPs 104.21.29.174, 172.67.149.142, 2606:4700:3034::6815:1dae, 2606:4700:3035::ac43:958e
Response IP 104.21.29.174
Found Yes
Hash dc40f30573b8ebbdbe133f346a24b6e46a8a06302fe3ed48a2af461b261d16ad
SimHash 0904d450cf13

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Disallow /share-widget
Allow /

Other Records

Field Value
sitemap http://www.pers.my.id/sitemap.xml