xhamstervideo.net
robots.txt
Robots Exclusion Standard data for xhamstervideo.net
Resource Scan
Scan Details
Site Domain | xhamstervideo.net |
Base Domain | xhamstervideo.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-10-08T09:22:22+00:00 |
Next Scan | 2024-10-09T09:22:22+00:00 |
Last Successful Scan
Scanned | 2024-09-08T09:17:39+00:00 |
URL | https://xhamstervideo.net/robots.txt |
Domain IPs | 104.21.81.194, 172.67.190.151, 2606:4700:3033::ac43:be97, 2606:4700:3035::6815:51c2 |
Response IP | 172.67.190.151 |
Found | Yes |
Hash | 7622db16a0f0e2f07d7c85b1f1c4ace01a14e1137adf5aaf6c16e20c75f20b26 |
SimHash | f4695ae0cb87 |
Groups
*
Rule | Path |
---|---|
Disallow | /video-vote/ |
Disallow | /account/ |
Disallow | /moments |
Disallow | /embed |
Disallow | /creators |