panthi.lk
robots.txt
Robots Exclusion Standard data for panthi.lk
Resource Scan
Scan Details
| Site Domain | panthi.lk |
| Base Domain | panthi.lk |
| Scan Status | Ok |
| Last Scan | 2025-09-19T19:36:09+00:00 |
| Next Scan | 2025-09-26T19:36:09+00:00 |
Last Scan
| Scanned | 2025-09-19T19:36:09+00:00 |
| URL | https://panthi.lk/robots.txt |
| Domain IPs | 104.21.43.23, 172.67.216.48, 2606:4700:3036::6815:2b17, 2606:4700:3036::ac43:d830 |
| Response IP | 104.21.43.23 |
| Found | Yes |
| Hash | 3548518ea940e6468a9caa8f7ad0045c6326a2902b5791c1547aaebb34dc9141 |
| SimHash | 1d1608d2c791 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /include/ |
| Disallow | /admin/ |
| Disallow | /content/ |
| Disallow | /images/catagoryImages/ |
| Disallow | /header.php |
| Disallow | /delete_ads.php?id=* |
| Disallow | /cdn-cgi/ |
| Allow | / |