automarketspb.ru
robots.txt
Robots Exclusion Standard data for automarketspb.ru
Resource Scan
Scan Details
| Site Domain | automarketspb.ru |
| Base Domain | automarketspb.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-04-06T10:04:00+00:00 |
| Next Scan | 2025-04-13T10:04:00+00:00 |
Last Successful Scan
| Scanned | 2025-03-29T10:02:31+00:00 |
| URL | https://www.automarketspb.ru/robots.txt |
| Domain IPs | 104.21.59.214, 172.67.184.22, 2606:4700:3030::6815:3bd6, 2606:4700:3035::ac43:b816 |
| Response IP | 104.21.59.214 |
| Found | Yes |
| Hash | 05f3fb6470b5ad716368bc172d92325634daa94e94718ae04fbf605c3cc5e080 |
| SimHash | c1076cea41f2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /out.php |
| Disallow | /*?p |
| Disallow | /*search? |
| Disallow | /*?s= |
| Disallow | /*?action |
| Disallow | /*?from |
| Disallow | /?* |
| Disallow | /user/registration/ |
| Disallow | /browse-by-state/drugoe/ |
| Disallow | /auto/add/ |
| Disallow | /*.php |
| Disallow | /page/salon/http/ |
| Disallow | /listing |
| Disallow | /site/ |
| Disallow | /*?trv |
| Disallow | /rss/ |
| Disallow | /search/?action |
| Disallow | /page/salon/ajax/yw0/ |
| Disallow | /glavnaya |
Other Records
| Field | Value |
|---|---|
| sitemap | http://automarketspb.ru/sitemap.xml |
Warnings
- `host` is not a known field.