ugj.net
robots.txt

Robots Exclusion Standard data for ugj.net

Resource Scan

Scan Details

Site Domain ugj.net
Base Domain ugj.net
Scan Status Ok
Last Scan2024-09-20T23:13:43+00:00
Next Scan 2024-10-20T23:13:43+00:00

Last Scan

Scanned2024-09-20T23:13:43+00:00
URL https://ugj.net/robots.txt
Domain IPs 104.21.234.220, 104.21.234.221, 2606:4700:3038::6815:eadc, 2606:4700:3038::6815:eadd
Response IP 104.21.234.221
Found Yes
Hash 5388df18cf0cf15806449f7f23792a360efec81866b7663b8e9010b21e496210
SimHash 901dc4a8ee1a

Groups

ia_archiver

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

pimeyes

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /sex/
Disallow /tokyogirls/
Disallow /tokyoporns/
Disallow /asianporns/
Disallow /koreanporns/