exclusivelines.lk
robots.txt

Robots Exclusion Standard data for exclusivelines.lk

Resource Scan

Scan Details

Site Domain exclusivelines.lk
Base Domain exclusivelines.lk
Scan Status Ok
Last Scan2024-09-04T01:18:15+00:00
Next Scan 2024-10-04T01:18:15+00:00

Last Scan

Scanned2024-09-04T01:18:15+00:00
URL https://exclusivelines.lk/robots.txt
Domain IPs 104.26.4.33, 104.26.5.33, 172.67.68.53, 2606:4700:20::681a:421, 2606:4700:20::681a:521, 2606:4700:20::ac43:4435
Response IP 104.26.5.33
Found Yes
Hash 871c5384fa7db844da69bbe4b13ad10a557ef86ebb27ff48295f4a9b400d567c
SimHash 15145001af50

Groups

amazonbot

Rule Path
Disallow /do-not-crawl/

*

Rule Path
Disallow /not-allowed/