pornvideo.com
robots.txt
Robots Exclusion Standard data for pornvideo.com
Resource Scan
Scan Details
| Site Domain | pornvideo.com |
| Base Domain | pornvideo.com |
| Scan Status | Ok |
| Last Scan | 2024-06-26T12:00:16+00:00 |
| Next Scan | 2024-07-26T12:00:16+00:00 |
Last Scan
| Scanned | 2024-06-26T12:00:16+00:00 |
| URL | https://pornvideo.com/robots.txt |
| Domain IPs | 104.21.55.47, 172.67.144.136, 2606:4700:3033::ac43:9088, 2606:4700:3035::6815:372f |
| Response IP | 104.21.55.47 |
| Found | Yes |
| Hash | 9608ad6312ff119743025d45996c532df5809c7380107fe0543b5301ed3d2926 |
| SimHash | 0136dda8b57a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account.php |
| Disallow | /add-address.php |
| Disallow | /address.php |
| Disallow | /cart.php |
| Disallow | /change-password.php |
| Disallow | /checkout.php |
| Disallow | /confirmation.php |
| Disallow | /edit-account.php |
| Disallow | /edit-address.php |
| Disallow | /edit-card.php |
| Disallow | /edit-payment.php |
| Disallow | /logoff.php |
| Disallow | /order.php |
| Disallow | /place-order.php |
| Disallow | /popunder.php |
| Disallow | /share-session.php |
| Disallow | /status.php |
| Disallow | /test.php |
| Disallow | /faqs.php |
| Disallow | /faqs.html |
| Disallow | /faqs.htm |
| Disallow | /privacy-policy.php |
| Disallow | /privacy-policy.html |
| Disallow | /privacy-policy.htm |
| Disallow | /2257.php |
| Disallow | /2257.html |
| Disallow | /2257.htm |
| Disallow | /ordering.php |
| Disallow | /ordering.html |
| Disallow | /ordering.htm |
| Disallow | /guarantee.php |
| Disallow | /guarantee.html |
| Disallow | /guarantee.htm |
| Disallow | /shipping.php |
| Disallow | /shipping.html |
| Disallow | /shipping.htm |
| Disallow | /returns.php |
| Disallow | /returns.html |
| Disallow | /returns.htm |
| Disallow | /help.php |
| Disallow | /help.html |
| Disallow | /help.htm |
| Disallow | /help.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |