avtopub.com
robots.txt
Robots Exclusion Standard data for avtopub.com
Resource Scan
Scan Details
| Site Domain | avtopub.com |
| Base Domain | avtopub.com |
| Scan Status | Ok |
| Last Scan | 2025-05-27T19:16:43+00:00 |
| Next Scan | 2025-06-03T19:16:43+00:00 |
Last Scan
| Scanned | 2025-05-27T19:16:43+00:00 |
| URL | https://avtopub.com/robots.txt |
| Domain IPs | 104.21.81.162, 172.67.145.5, 2606:4700:3034::ac43:9105, 2606:4700:3037::6815:51a2 |
| Response IP | 172.67.145.5 |
| Found | Yes |
| Hash | 593085f7455b8eac482fe35524a86eb0263b58da3f4f3734b5db32a40ae496ec |
| SimHash | 475580f3a2a5 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | /category/ |
| Disallow | /2011/ |
| Disallow | /2012/ |
| Disallow | /2013/ |
| Disallow | /2014/ |
| Disallow | /2015/ |
| Disallow | /2016/ |
| Disallow | /2017/ |
| Disallow | /2018/ |
| Disallow | /2019/ |
| Disallow | /page/ |
| Disallow | /tag |
| Disallow | /feed |
| Disallow | /comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
| Disallow | /wp-json/ |
*
| Rule | Path |
|---|---|
| Allow | /wp-content/themes/*.css |
| Allow | /wp-content/plugins/*.css |
| Allow | /wp-content/uploads/*.css |
| Allow | /wp-includes/css/ |
| Allow | /wp-includes/images/ |
| Allow | /wp-content/themes/*.png |
| Allow | /wp-content/themes/*.gif |
| Allow | /wp-content/themes/*jpg |
| Allow | /wp-content/themes/*.js |
| Allow | /wp-content/plugins/*.js |
| Allow | /wp-content/uploads/*.js |
| Allow | /wp-includes/js/ |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | /feed |
| Disallow | /category/ |
| Disallow | /2011/ |
| Disallow | /2012/ |
| Disallow | /2013/ |
| Disallow | /2014/ |
| Disallow | /2015/ |
| Disallow | /2016/ |
| Disallow | /2017/ |
| Disallow | /2018/ |
| Disallow | /2019/ |
| Disallow | /page/ |
| Disallow | /tag |
| Disallow | /comments |
| Disallow | */trackback |
| Disallow | */comments |
| Disallow | /wp-json/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://avtopub.com/sitemap_index.xml |
Warnings
- `host` is not a known field.