ugj.net
robots.txt
Robots Exclusion Standard data for ugj.net
Resource Scan
Scan Details
Site Domain | ugj.net |
Base Domain | ugj.net |
Scan Status | Ok |
Last Scan | 2024-09-20T23:13:43+00:00 |
Next Scan | 2024-10-20T23:13:43+00:00 |
Last Scan
Scanned | 2024-09-20T23:13:43+00:00 |
URL | https://ugj.net/robots.txt |
Domain IPs | 104.21.234.220, 104.21.234.221, 2606:4700:3038::6815:eadc, 2606:4700:3038::6815:eadd |
Response IP | 104.21.234.221 |
Found | Yes |
Hash | 5388df18cf0cf15806449f7f23792a360efec81866b7663b8e9010b21e496210 |
SimHash | 901dc4a8ee1a |
Groups
*
Rule | Path |
---|---|
Disallow | /sex/ |
Disallow | /tokyogirls/ |
Disallow | /tokyoporns/ |
Disallow | /asianporns/ |
Disallow | /koreanporns/ |