m.republika.co.id
robots.txt
Robots Exclusion Standard data for m.republika.co.id
Resource Scan
Scan Details
Site Domain | m.republika.co.id |
Base Domain | republika.co.id |
Scan Status | Ok |
Last Scan | 2024-10-03T03:07:06+00:00 |
Next Scan | 2024-11-02T03:07:06+00:00 |
Last Scan
Scanned | 2024-10-03T03:07:06+00:00 |
URL | https://m.republika.co.id/robots.txt |
Domain IPs | 104.18.8.234, 104.18.9.234, 2606:4700::6812:8ea, 2606:4700::6812:9ea |
Response IP | 104.18.9.234 |
Found | Yes |
Hash | 32d45a73c11a8e965b6e235139187f4fe18b0676695faa4955ca67addeb54a27 |
SimHash | 0918cf148531 |
Groups
*
Rule | Path |
---|---|
Disallow | /cache/ |
Disallow | /code/ |
Disallow | /codeigniter/ |
Disallow | /database/ |
Disallow | /fonts/ |
Disallow | /helpers/ |
Disallow | /language/ |
Disallow | /libraries |
Disallow | /logs/ |
Disallow | /plugins/ |
Disallow | /scaffolding/ |
Allow | / |