masturbate2gether.com
robots.txt

Robots Exclusion Standard data for masturbate2gether.com

Resource Scan

Scan Details

Site Domain masturbate2gether.com
Base Domain masturbate2gether.com
Scan Status Ok
Last Scan2024-10-27T12:04:40+00:00
Next Scan 2024-11-26T12:04:40+00:00

Last Scan

Scanned2024-10-27T12:04:40+00:00
URL https://masturbate2gether.com/robots.txt
Domain IPs 99.192.128.72
Response IP 99.192.128.72
Found Yes
Hash 4193b642a438c405a35ec1d653b7f1c471e289427eb4fde77785dcf910b79353
SimHash 688ece06a01b

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /admin/
Disallow /controllers/
Disallow /api/
Disallow /csv_photos/
Disallow /ftp_content/
Disallow /ftp_photos/
Disallow /temp_users_uploads/
Disallow /cache/
Disallow /?controller
Disallow /?filterpage
Disallow /*?action*

Other Records

Field Value
crawl-delay 10