gayscattube.com
robots.txt
Robots Exclusion Standard data for gayscattube.com
Resource Scan
Scan Details
Site Domain | gayscattube.com |
Base Domain | gayscattube.com |
Scan Status | Ok |
Last Scan | 2024-09-21T22:43:58+00:00 |
Next Scan | 2024-10-21T22:43:58+00:00 |
Last Scan
Scanned | 2024-09-21T22:43:58+00:00 |
URL | https://gayscattube.com/robots.txt |
Domain IPs | 185.53.162.165 |
Response IP | 185.53.162.165 |
Found | Yes |
Hash | 94e9e09dca4e3033373efb401e9b18e10021e1831e5a7986e19c933595dcbd43 |
SimHash | f10bcc04a093 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /includes/ |
Disallow | /controllers/ |
Disallow | /api/ |
Disallow | /content/ |
Disallow | /csv_photos/ |
Disallow | /ftp_content/ |
Disallow | /ftp_photos/ |
Disallow | /temp_users_uploads/ |
Disallow | /cache/ |