petrieve.org
robots.txt
Robots Exclusion Standard data for petrieve.org
Resource Scan
Scan Details
| Site Domain | petrieve.org |
| Base Domain | petrieve.org |
| Scan Status | Ok |
| Last Scan | 2024-09-23T17:53:24+00:00 |
| Next Scan | 2024-09-30T17:53:24+00:00 |
Last Scan
| Scanned | 2024-09-23T17:53:24+00:00 |
| URL | https://petrieve.org/robots.txt |
| Redirect | https://www.petrieve.org/robots.txt |
| Redirect Domain | www.petrieve.org |
| Redirect Base | petrieve.org |
| Domain IPs | 104.21.69.121, 172.67.208.4, 2606:4700:3032::6815:4579, 2606:4700:3035::ac43:d004 |
| Redirect IPs | 104.21.69.121, 172.67.208.4, 2606:4700:3032::6815:4579, 2606:4700:3035::ac43:d004 |
| Response IP | 172.67.208.4 |
| Found | Yes |
| Hash | 9a45235e010fae5aedbdb233065622ebf48248d0844339896775a15761ddb94b |
| SimHash | 2040d8e0cb51 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /en/ |
| Disallow | /found-pets/ |
| Disallow | /lost-pets/ |
| Disallow | /*canada/ |
| Disallow | /*united-kingdom/ |
| Allow | /ru/ |
| Allow | /photos/ |
| Allow | /img/ |
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*create-pet/* |
| Disallow | /*edit-pet/* |
| Disallow | /*send-message/* |
| Disallow | /*update-map/* |
| Disallow | /*login/* |
| Disallow | /*logout/* |
| Disallow | /*account/* |
| Disallow | /*confirm/* |
| Disallow | /*deactivate/* |
| Disallow | /*errors/* |
| Disallow | /*recover-password/* |
| Disallow | /*resend-confirmation/* |
| Disallow | /*unsubscribe/* |
| Disallow | /*qr/* |
| Disallow | /*support-us/thankyou/* |
Warnings
- `host` is not a known field.