masturbate2gether.com
robots.txt
Robots Exclusion Standard data for masturbate2gether.com
Resource Scan
Scan Details
Site Domain | masturbate2gether.com |
Base Domain | masturbate2gether.com |
Scan Status | Ok |
Last Scan | 2024-10-27T12:04:40+00:00 |
Next Scan | 2024-11-26T12:04:40+00:00 |
Last Scan
Scanned | 2024-10-27T12:04:40+00:00 |
URL | https://masturbate2gether.com/robots.txt |
Domain IPs | 99.192.128.72 |
Response IP | 99.192.128.72 |
Found | Yes |
Hash | 4193b642a438c405a35ec1d653b7f1c471e289427eb4fde77785dcf910b79353 |
SimHash | 688ece06a01b |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /controllers/ |
Disallow | /api/ |
Disallow | /csv_photos/ |
Disallow | /ftp_content/ |
Disallow | /ftp_photos/ |
Disallow | /temp_users_uploads/ |
Disallow | /cache/ |
Disallow | /?controller |
Disallow | /?filterpage |
Disallow | /*?action* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |