popularnews.ru
robots.txt
Robots Exclusion Standard data for popularnews.ru
Resource Scan
Scan Details
| Site Domain | popularnews.ru |
| Base Domain | popularnews.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-20T03:35:47+00:00 |
| Next Scan | 2024-11-18T03:35:47+00:00 |
Last Successful Scan
| Scanned | 2024-04-23T03:34:09+00:00 |
| URL | https://popularnews.ru/robots.txt |
| Domain IPs | 188.244.36.9 |
| Response IP | 188.244.36.9 |
| Found | Yes |
| Hash | 5e84d8389f82397e3726191040ea37b535a4953a6045ea11568bee0f5b1ed7f3 |
| SimHash | c55f527174f7 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /favicon/* |
| Allow | /static/css/* |
| Allow | /static/bootstrap/css/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/js/* |
| Allow | /static/toastr/* |
| Allow | /static/lightpick/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/images/* |
| Allow | /static/embed/* |
| Allow | /static/popularnews.ru/* |
| Disallow | *?search= |
| Disallow | *?page= |
| Disallow | /*.txt |
| Disallow | /*.mp4 |
| Disallow | /video/ |
| Disallow | /tmp/ |
| Disallow | /uploads/ |
| Disallow | /321/ |
| Disallow | /static/* |
| Disallow | /privacypolicy/ |
| Disallow | /copyright/ |
| Disallow | /contacts/ |
| Disallow | /edit-news/ |
googlebot
| Rule | Path |
|---|---|
| Allow | /favicon/* |
| Allow | /static/css/* |
| Allow | /static/bootstrap/css/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/js/* |
| Allow | /static/toastr/* |
| Allow | /static/lightpick/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/images/* |
| Allow | /static/embed/* |
| Allow | /static/popularnews.ru/* |
| Disallow | *?search= |
| Disallow | *?page= |
| Disallow | /*.txt |
| Disallow | /*.mp4 |
| Disallow | /video/ |
| Disallow | /tmp/ |
| Disallow | /uploads/ |
| Disallow | /321/ |
| Disallow | /static/* |
| Disallow | /privacypolicy/ |
| Disallow | /copyright/ |
| Disallow | /contacts/ |
| Disallow | /edit-news/ |
googlebot-video
| Rule | Path |
|---|---|
| Allow | /favicon/* |
| Allow | /static/css/* |
| Allow | /static/bootstrap/css/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/js/* |
| Allow | /static/toastr/* |
| Allow | /static/lightpick/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/images/* |
| Allow | /static/embed/* |
| Allow | /static/popularnews.ru/* |
| Disallow | *?search= |
| Disallow | *?page= |
| Disallow | /*.txt |
| Disallow | /*.mp4 |
| Disallow | /video/ |
| Disallow | /tmp/ |
| Disallow | /uploads/ |
| Disallow | /321/ |
| Disallow | /static/* |
| Disallow | /privacypolicy/ |
| Disallow | /copyright/ |
| Disallow | /contacts/ |
| Disallow | /edit-news/ |
googlebot-news
| Rule | Path |
|---|---|
| Allow | /favicon/* |
| Allow | /static/css/* |
| Allow | /static/bootstrap/css/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/js/* |
| Allow | /static/toastr/* |
| Allow | /static/lightpick/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/images/* |
| Allow | /static/embed/* |
| Allow | /static/popularnews.ru/* |
| Disallow | *?search= |
| Disallow | *?page= |
| Disallow | /*.txt |
| Disallow | /*.mp4 |
| Disallow | /video/ |
| Disallow | /tmp/ |
| Disallow | /uploads/ |
| Disallow | /321/ |
| Disallow | /static/* |
| Disallow | /privacypolicy/ |
| Disallow | /copyright/ |
| Disallow | /contacts/ |
| Disallow | /edit-news/ |
googlebot-images
| Rule | Path |
|---|---|
| Allow | /favicon/* |
| Allow | /static/css/* |
| Allow | /static/bootstrap/css/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/js/* |
| Allow | /static/toastr/* |
| Allow | /static/lightpick/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/images/* |
| Allow | /static/embed/* |
| Allow | /static/popularnews.ru/* |
| Disallow | *?search= |
| Disallow | *?page= |
| Disallow | /*.txt |
| Disallow | /*.mp4 |
| Disallow | /video/ |
| Disallow | /tmp/ |
| Disallow | /uploads/ |
| Disallow | /321/ |
| Disallow | /static/* |
| Disallow | /privacypolicy/ |
| Disallow | /copyright/ |
| Disallow | /contacts/ |
| Disallow | /edit-news/ |
*
| Rule | Path |
|---|---|
| Allow | /favicon/* |
| Allow | /static/css/* |
| Allow | /static/bootstrap/css/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/js/* |
| Allow | /static/toastr/* |
| Allow | /static/lightpick/* |
| Allow | /static/bootstrap/js/* |
| Allow | /static/images/* |
| Allow | /static/embed/* |
| Allow | /static/popularnews.ru/* |
| Disallow | *?search= |
| Disallow | *?page= |
| Disallow | /*.txt |
| Disallow | /*.mp4 |
| Disallow | /video/ |
| Disallow | /tmp/ |
| Disallow | /uploads/ |
| Disallow | /321/ |
| Disallow | /static/* |
| Disallow | /privacypolicy/ |
| Disallow | /copyright/ |
| Disallow | /contacts/ |
| Disallow | /edit-news/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://popularnews.ru/sitemap.xml |
| sitemap | https://popularnews.ru/sitemap-main.xml |
| sitemap | https://popularnews.ru/sitemap-video.xml |
| sitemap | https://popularnews.ru/sitemap1.xml |
| sitemap | https://popularnews.ru/sitemap2.xml |
| sitemap | https://popularnews.ru/sitemap-news1.xml |
Warnings
- `host` is not a known field.