japanesethumbs.com
robots.txt

Robots Exclusion Standard data for japanesethumbs.com

Resource Scan

Scan Details

Site Domain japanesethumbs.com
Base Domain japanesethumbs.com
Scan Status Ok
Last Scan2024-06-13T19:37:59+00:00
Next Scan 2024-07-13T19:37:59+00:00

Last Scan

Scanned2024-06-13T19:37:59+00:00
URL https://japanesethumbs.com/robots.txt
Domain IPs 104.21.235.103, 104.21.235.104, 2606:4700:3038::6815:eb67, 2606:4700:3038::6815:eb68
Response IP 104.21.235.104
Found Yes
Hash 39fac778627cb3f348998ea500ade20854b94f03d436fcd30b0dc0623565408f
SimHash 104e86a0e50a

Groups

ia_archiver

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

pimeyes

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /sex/
Disallow /javs/
Disallow /hardcores/
Disallow /asianbeautys/
Disallow /koreanbeautys/