ratemydick.net
robots.txt

Robots Exclusion Standard data for ratemydick.net

Resource Scan

Scan Details

Site Domain ratemydick.net
Base Domain ratemydick.net
Scan Status Ok
Last Scan2025-12-01T19:36:19+00:00
Next Scan 2025-12-31T19:36:19+00:00

Last Scan

Scanned2025-12-01T19:36:19+00:00
URL https://ratemydick.net/robots.txt
Domain IPs 198.252.99.222
Response IP 198.252.99.222
Found Yes
Hash f9db058c82c4ac213f6b194fdce32531a9eb12913e55a9ca12f23988ae9acbd2
SimHash b1198c86a211

Groups

*

Rule Path
Disallow /admin/
Disallow /includes/
Disallow /controllers/
Disallow /core/
Disallow /content/
Disallow /csv_photos/
Disallow /ftp_content/
Disallow /ftp_photos/
Disallow /temp_users_uploads/
Disallow /cache/

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /