static.rappler.com
robots.txt
Robots Exclusion Standard data for static.rappler.com
Resource Scan
Scan Details
Site Domain | static.rappler.com |
Base Domain | rappler.com |
Scan Status | Ok |
Last Scan | 2024-06-25T03:04:23+00:00 |
Next Scan | 2024-07-25T03:04:23+00:00 |
Last Scan
Scanned | 2024-06-25T03:04:23+00:00 |
URL | https://static.rappler.com/robots.txt |
Domain IPs | 13.35.18.122, 13.35.18.124, 13.35.18.21, 13.35.18.48 |
Response IP | 13.35.18.122 |
Found | Yes |
Hash | c0051e8d398f65fc0973e8d0f66b1e34deb290237985800dfa00e6ab813694e2 |
SimHash | 830480302333 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Allow | /images/ |
Allow | /media/ |
Allow | /components/ |
Allow | /modules/ |
Allow | /templates/ |
Allow | /cache/ |
Allow | /js/ |
Allow | /plugins/ |