portal.tarsusdistribution.co.za
robots.txt

Robots Exclusion Standard data for portal.tarsusdistribution.co.za

Resource Scan

Scan Details

Site Domain portal.tarsusdistribution.co.za
Base Domain tarsusdistribution.co.za
Scan Status Ok
Last Scan2024-11-12T00:00:17+00:00
Next Scan 2024-11-26T00:00:17+00:00

Last Scan

Scanned2024-11-12T00:00:17+00:00
URL https://portal.tarsusdistribution.co.za/robots.txt
Domain IPs 108.156.133.11, 108.156.133.69, 108.156.133.70, 108.156.133.74, 2600:9000:2755:1c00:5:b06c:dd00:93a1, 2600:9000:2755:5c00:5:b06c:dd00:93a1, 2600:9000:2755:8a00:5:b06c:dd00:93a1, 2600:9000:2755:a00:5:b06c:dd00:93a1, 2600:9000:2755:d400:5:b06c:dd00:93a1, 2600:9000:2755:e600:5:b06c:dd00:93a1, 2600:9000:2755:f200:5:b06c:dd00:93a1, 2600:9000:2755:fa00:5:b06c:dd00:93a1
Response IP 108.156.133.69
Found Yes
Hash c257b8d671b6c9200de8da9abf02cb27ac38ac0eda014741c5812a49149a7ee0
SimHash 880088528233

Groups

*

Rule Path
Disallow /
Allow /account/login
Allow /account/join

Other Records

Field Value
sitemap https://portal.tarsusdistribution.co.za/sitemap.xml