utusan.com.my
robots.txt

Robots Exclusion Standard data for utusan.com.my

Resource Scan

Scan Details

Site Domain utusan.com.my
Base Domain utusan.com.my
Scan Status Ok
Last Scan2024-09-16T04:34:03+00:00
Next Scan 2024-09-23T04:34:03+00:00

Last Scan

Scanned2024-09-16T04:34:03+00:00
URL https://utusan.com.my/robots.txt
Domain IPs 104.26.0.2, 104.26.1.2, 172.67.70.165, 2606:4700:20::681a:102, 2606:4700:20::681a:2, 2606:4700:20::ac43:46a5
Response IP 172.67.70.165
Found Yes
Hash 6b8fa6bffa9724e7abaadcbf346e395a72120f573f5b97b540e0d6d8df0038a2
SimHash 48088aa0cbb2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /?
Allow /wp-admin/admin-ajax.php

semrushbot

Rule Path
Disallow /