seleb.fun
robots.txt
Robots Exclusion Standard data for seleb.fun
Resource Scan
Scan Details
Site Domain | seleb.fun |
Base Domain | seleb.fun |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-11-13T14:08:46+00:00 |
Next Scan | 2025-02-11T14:08:46+00:00 |
Last Successful Scan
Scanned | 2024-04-18T14:07:41+00:00 |
URL | http://seleb.fun/robots.txt |
Redirect | https://popularnews.ru/robots.txt |
Redirect Domain | popularnews.ru |
Redirect Base | popularnews.ru |
Domain IPs | 188.244.36.9 |
Response IP | 188.244.36.9 |
Found | Yes |
Hash | 4f4bbeca8cd8f89afe396e46c5d6257326e839224b59f41ebb93776b6776d1fb |
SimHash | 451fc27160f7 |
Groups
yandex
Rule | Path |
---|---|
Allow | /favicon/* |
Allow | /static/css/* |
Allow | /static/bootstrap/css/* |
Allow | /static/bootstrap/js/* |
Allow | /static/js/* |
Allow | /static/toastr/* |
Allow | /static/lightpick/* |
Allow | /static/bootstrap/js/* |
Allow | /static/images/* |
Allow | /static/embed/* |
Allow | /static/popularnews.ru/* |
Disallow | *?search= |
Disallow | *?page= |
Disallow | /*.txt |
Disallow | /*.mp4 |
Disallow | /video/ |
Disallow | /tmp/ |
Disallow | /uploads/ |
Disallow | /321/ |
Disallow | /static/admin/ |
Disallow | /static/grappelli/ |
Disallow | /privacypolicy/ |
Disallow | /copyright/ |
Disallow | /hashtag/ |
Disallow | /test/ |
Disallow | /edit-news/ |
googlebot
Rule | Path |
---|---|
Allow | /favicon/* |
Allow | /static/css/* |
Allow | /static/bootstrap/css/* |
Allow | /static/bootstrap/js/* |
Allow | /static/js/* |
Allow | /static/toastr/* |
Allow | /static/lightpick/* |
Allow | /static/bootstrap/js/* |
Allow | /static/images/* |
Allow | /static/embed/* |
Allow | /static/popularnews.ru/* |
Disallow | *?search= |
Disallow | *?page= |
Disallow | /*.txt |
Disallow | /*.mp4 |
Disallow | /video/ |
Disallow | /tmp/ |
Disallow | /uploads/ |
Disallow | /321/ |
Disallow | /static/admin/ |
Disallow | /static/grappelli/ |
Disallow | /privacypolicy/ |
Disallow | /copyright/ |
Disallow | /hashtag/ |
Disallow | /test/ |
Disallow | /edit-news/ |
googlebot-video
Rule | Path |
---|---|
Allow | /favicon/* |
Allow | /static/css/* |
Allow | /static/bootstrap/css/* |
Allow | /static/bootstrap/js/* |
Allow | /static/js/* |
Allow | /static/toastr/* |
Allow | /static/lightpick/* |
Allow | /static/bootstrap/js/* |
Allow | /static/images/* |
Allow | /static/embed/* |
Allow | /static/popularnews.ru/* |
Disallow | *?search= |
Disallow | *?page= |
Disallow | /*.txt |
Disallow | /*.mp4 |
Disallow | /video/ |
Disallow | /tmp/ |
Disallow | /uploads/ |
Disallow | /321/ |
Disallow | /static/admin/ |
Disallow | /static/grappelli/ |
Disallow | /privacypolicy/ |
Disallow | /copyright/ |
Disallow | /hashtag/ |
Disallow | /test/ |
Disallow | /edit-news/ |
googlebot-news
Rule | Path |
---|---|
Allow | /favicon/* |
Allow | /static/css/* |
Allow | /static/bootstrap/css/* |
Allow | /static/bootstrap/js/* |
Allow | /static/js/* |
Allow | /static/toastr/* |
Allow | /static/lightpick/* |
Allow | /static/bootstrap/js/* |
Allow | /static/images/* |
Allow | /static/embed/* |
Allow | /static/popularnews.ru/* |
Disallow | *?search= |
Disallow | *?page= |
Disallow | /*.txt |
Disallow | /*.mp4 |
Disallow | /video/ |
Disallow | /tmp/ |
Disallow | /uploads/ |
Disallow | /321/ |
Disallow | /static/admin/ |
Disallow | /static/grappelli/ |
Disallow | /privacypolicy/ |
Disallow | /copyright/ |
Disallow | /hashtag/ |
Disallow | /test/ |
Disallow | /edit-news/ |
googlebot-images
Rule | Path |
---|---|
Allow | /favicon/* |
Allow | /static/css/* |
Allow | /static/bootstrap/css/* |
Allow | /static/bootstrap/js/* |
Allow | /static/js/* |
Allow | /static/toastr/* |
Allow | /static/lightpick/* |
Allow | /static/bootstrap/js/* |
Allow | /static/images/* |
Allow | /static/embed/* |
Allow | /static/popularnews.ru/* |
Disallow | *?search= |
Disallow | *?page= |
Disallow | /*.txt |
Disallow | /*.mp4 |
Disallow | /video/ |
Disallow | /tmp/ |
Disallow | /uploads/ |
Disallow | /321/ |
Disallow | /static/admin/ |
Disallow | /static/grappelli/ |
Disallow | /privacypolicy/ |
Disallow | /copyright/ |
Disallow | /hashtag/ |
Disallow | /test/ |
Disallow | /edit-news/ |
*
Rule | Path |
---|---|
Allow | /favicon/* |
Allow | /static/css/* |
Allow | /static/bootstrap/css/* |
Allow | /static/bootstrap/js/* |
Allow | /static/js/* |
Allow | /static/toastr/* |
Allow | /static/lightpick/* |
Allow | /static/bootstrap/js/* |
Allow | /static/images/* |
Allow | /static/embed/* |
Allow | /static/popularnews.ru/* |
Disallow | *?search= |
Disallow | *?page= |
Disallow | /*.txt |
Disallow | /*.mp4 |
Disallow | /video/ |
Disallow | /tmp/ |
Disallow | /uploads/ |
Disallow | /321/ |
Disallow | /static/admin/ |
Disallow | /static/grappelli/ |
Disallow | /privacypolicy/ |
Disallow | /copyright/ |
Disallow | /hashtag/ |
Disallow | /test/ |
Disallow | /edit-news/ |
Other Records
Field | Value |
---|---|
sitemap | https://popularnews.ru/sitemap.xml |
sitemap | https://popularnews.ru/sitemap-main.xml |
sitemap | https://popularnews.ru/sitemap-video.xml |
sitemap | https://popularnews.ru/sitemap1.xml |
sitemap | https://popularnews.ru/sitemap2.xml |
Warnings
- `host` is not a known field.