jjgirls.com
robots.txt

Robots Exclusion Standard data for jjgirls.com

Resource Scan

Scan Details

Site Domain jjgirls.com
Base Domain jjgirls.com
Scan Status Ok
Last Scan2024-05-25T11:58:37+00:00
Next Scan 2024-06-24T11:58:37+00:00

Last Scan

Scanned2024-05-25T11:58:37+00:00
URL https://jjgirls.com/robots.txt
Domain IPs 104.21.233.217, 104.21.233.218, 2606:4700:3038::6815:e9d9, 2606:4700:3038::6815:e9da
Response IP 104.21.233.218
Found Yes
Hash 955c0f75cdcc0e2f056eac80e17e15b160ddf62ccffa988120a717cae9294bb0
SimHash 907ccc80e789

Groups

ia_archiver

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

pimeyes

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /sex/
Disallow /japaneses/
Disallow /koreans/
Disallow /uncensoreds/
Disallow /direct/