heraldgoa.in
robots.txt
Robots Exclusion Standard data for heraldgoa.in
Resource Scan
Scan Details
Site Domain | heraldgoa.in |
Base Domain | heraldgoa.in |
Scan Status | Ok |
Last Scan | 2024-05-13T14:24:58+00:00 |
Next Scan | 2024-05-20T14:24:58+00:00 |
Last Scan
Scanned | 2024-05-13T14:24:58+00:00 |
URL | https://heraldgoa.in/robots.txt |
Redirect | https://www.heraldgoa.in/robots.txt |
Redirect Domain | www.heraldgoa.in |
Redirect Base | heraldgoa.in |
Domain IPs | 104.21.83.175, 172.67.179.176, 2606:4700:3031::6815:53af, 2606:4700:3031::ac43:b3b0 |
Redirect IPs | 104.21.83.175, 172.67.179.176, 2606:4700:3031::6815:53af, 2606:4700:3031::ac43:b3b0 |
Response IP | 104.21.83.175 |
Found | Yes |
Hash | 9e5832d88d1748ded2872415e738817691817811dd1df169658709e36a7b9882 |
SimHash | a8405e8aa990 |
Groups
*
Rule | Path |
---|---|
Disallow | /The-Sunday-Roundtable/iffi-officer-accused-of-passing-lewd-remarks/72480.html |
Disallow | /The-Sunday-Roundtable/police-begin-probe-in-iffi-harassment-case/72507.html |