starmediagroup.my
robots.txt
Robots Exclusion Standard data for starmediagroup.my
Resource Scan
Scan Details
Site Domain | starmediagroup.my |
Base Domain | starmediagroup.my |
Scan Status | Ok |
Last Scan | 2024-10-23T17:48:39+00:00 |
Next Scan | 2024-11-22T17:48:39+00:00 |
Last Scan
Scanned | 2024-10-23T17:48:39+00:00 |
URL | https://starmediagroup.my/robots.txt |
Domain IPs | 13.225.4.12, 13.225.4.42, 13.225.4.54, 13.225.4.62 |
Response IP | 13.225.4.42 |
Found | Yes |
Hash | b648b7d6fef1a91ed1d561887f8b82eefc7d1882b5b6a461952388d994d00713 |
SimHash | 71359930cb32 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | xmlrpc.php |
Allow | /wp-admin/admin-ajax.php?action=dynamic_css |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 10 | specifies a 10 second timeout |