justsex.co.za
robots.txt
Robots Exclusion Standard data for justsex.co.za
Resource Scan
Scan Details
Site Domain | justsex.co.za |
Base Domain | justsex.co.za |
Scan Status | Ok |
Last Scan | 2025-03-29T04:05:56+00:00 |
Next Scan | 2025-04-28T04:05:56+00:00 |
Last Scan
Scanned | 2025-03-29T04:05:56+00:00 |
URL | https://justsex.co.za/robots.txt |
Domain IPs | 2600:9000:2721:1c00:11:a16a:2100:93a1, 2600:9000:2721:2000:11:a16a:2100:93a1, 2600:9000:2721:3800:11:a16a:2100:93a1, 2600:9000:2721:4800:11:a16a:2100:93a1, 2600:9000:2721:7800:11:a16a:2100:93a1, 2600:9000:2721:be00:11:a16a:2100:93a1, 2600:9000:2721:c000:11:a16a:2100:93a1, 2600:9000:2721:e400:11:a16a:2100:93a1, 3.165.102.121, 3.165.102.32, 3.165.102.40, 3.165.102.88 |
Response IP | 3.165.102.40 |
Found | Yes |
Hash | 2d261956c6e3487552f08720a277d57c6b25dfbe437aaa7509266086c128666d |
SimHash | 2b12f70bac68 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /campaign/* |
Disallow | /support |
Disallow | /terms |
Disallow | /privacy |
Disallow | /imprint |
Disallow | /login |
Disallow | /ajax |
Disallow | /form/* |
Disallow | /profileadvertising |
Disallow | /network |
Disallow | /cookies |
Disallow | /remarketing |