system021.my.id
robots.txt

Robots Exclusion Standard data for system021.my.id

Resource Scan

Scan Details

Site Domain system021.my.id
Base Domain system021.my.id
Scan Status Ok
Last Scan2025-11-17T22:55:43+00:00
Next Scan 2025-11-24T22:55:43+00:00

Last Scan

Scanned2025-11-17T22:55:43+00:00
URL https://system021.my.id/robots.txt
Redirect https://www.system021.my.id/robots.txt
Redirect Domain www.system021.my.id
Redirect Base system021.my.id
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 2404:6800:4003:c0f::79, 74.125.68.121
Response IP 142.251.10.121
Found Yes
Hash 63a2c28c95d41e8d0b2ee1e27df1caf43508c82cf11ec7ba3de8792f0abe5aa8
SimHash 89108052c752

Groups

*

Rule Path
Allow /
Disallow /search?q=

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.system021.my.id/sitemap.xml
sitemap https://www.system021.my.id/sitemap-pages.xml