nhl-news.ru
robots.txt
Robots Exclusion Standard data for nhl-news.ru
Resource Scan
Scan Details
Site Domain | nhl-news.ru |
Base Domain | nhl-news.ru |
Scan Status | Ok |
Last Scan | 2024-09-30T13:08:41+00:00 |
Next Scan | 2024-10-07T13:08:41+00:00 |
Last Scan
Scanned | 2024-09-30T13:08:41+00:00 |
URL | https://nhl-news.ru/robots.txt |
Domain IPs | 104.21.65.161, 172.67.147.38, 2606:4700:3032::ac43:9326, 2606:4700:3033::6815:41a1 |
Response IP | 172.67.147.38 |
Found | Yes |
Hash | 10e4519de8d598faf89eead86ed88f8ff859dfd18c7d4014ad867b34c0f7f8a2 |
SimHash | e996050babf0 |
Groups
mail.ru
Rule | Path |
---|---|
Disallow | / |
Allow | /content/* |
Allow | /caphits/* |
Allow | /all_about_team/* |
Allow | /highlights |
Allow | /all-* |
Allow | /all_about_team |
Allow | /broadcast |
Allow | /transfery |
Allow | /fights |
Allow | /blog/* |
Allow | /tagsforvideotax/matchi-v-zapisi |
Allow | /statistika |
Allow | /numbers |
Allow | /farms_ahl |
Other Records
Field | Value |
---|---|
crawl-delay | 900 |
*
Rule | Path |
---|---|
Allow | /sitemap.xml |
Allow | /tagsforvideotax/supermatchi |
Allow | /tagsforvideotax/matchi-v-zapisi |
Allow | /tags/het-trik-gordi-hou |
Allow | /tags/oceni-treyd |
Disallow | /tag/ |
Disallow | /*/tag/* |
Disallow | /tags/ |
Disallow | /*/tags/* |
Disallow | /taxonomy/ |
Disallow | /*/taxonomy/* |
Disallow | /term/ |
Disallow | /includes/ |
Disallow | /misc/ |
Disallow | /modules/ |
Disallow | /profiles/ |
Disallow | /scripts/ |
Disallow | /themes/ |
Disallow | /CHANGELOG.txt |
Disallow | /cron.php |
Disallow | /INSTALL.mysql.txt |
Disallow | /INSTALL.pgsql.txt |
Disallow | /INSTALL.sqlite.txt |
Disallow | /install.php |
Disallow | /INSTALL.txt |
Disallow | /LICENSE.txt |
Disallow | /MAINTAINERS.txt |
Disallow | /update.php |
Disallow | /UPGRADE.txt |
Disallow | /xmlrpc.php |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips/ |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /user/ |
Disallow | /user/register/ |
Disallow | /user/password/ |
Disallow | /user/login/ |
Disallow | /user/logout/ |
Disallow | /tag/ |
Disallow | /tags/ |
Disallow | /taxonomy/ |
Disallow | /term/ |
Disallow | /?q=admin%2F |
Disallow | /?q=comment%2Freply%2F |
Disallow | /?q=filter%2Ftips%2F |
Disallow | /?q=node%2Fadd%2F |
Disallow | /?q=search%2F |
Disallow | /?q=user%2Fpassword%2F |
Disallow | /?q=user%2Fregister%2F |
Disallow | /?q=user%2Flogin%2F |
Disallow | /?q=user%2Flogout%2F |
Disallow | /admin |
Disallow | /comment |
Disallow | /filter/tips |
Disallow | /node/add |
Disallow | /search |
Disallow | /user |
Disallow | /user/register |
Disallow | /user/password |
Disallow | /user/login |
Disallow | /user/logout |
Disallow | /tag |
Disallow | /tags |
Disallow | /taxonomy |
Disallow | /term |
Disallow | /%D* |
Disallow | /advstats?* |
Disallow | /tablenhl?* |
Disallow | /*?field* |
Disallow | /*page%3D* |
Disallow | /?page=* |
Disallow | /%26page* |
Disallow | /*?destination* |
Disallow | /?qt-maintabs |
Disallow | /*?option* |
Disallow | /*?tid* |
Disallow | /aggregator* |
Disallow | /?do* |
Disallow | /*rate%3D* |
Disallow | /node/* |
Disallow | /video/* |
Disallow | /Novosti-NHL/* |
Disallow | /Novosti-NHL |
Disallow | /novosti-NHL* |
Disallow | /dlya-igr/* |
Disallow | /games/* |
Disallow | /forstats/* |
Disallow | /*?feed* |
Disallow | /*?iframe* |
Disallow | /*?from* |
Disallow | /views/ajax* |
Disallow | /*?qt* |
Disallow | /contact* |
Disallow | /*?date* |
Disallow | /*?title* |
Disallow | /statistika/* |
Disallow | /*m%3D* |
Disallow | /transfery/* |
Disallow | /*?order=title&sort=desc |
Disallow | /*?order* |
Disallow | /*?cid=* |
Disallow | /*image_captcha* |
Disallow | /*?yili* |
Disallow | /*?m=* |
Disallow | /*?author=* |
Disallow | /sostavy-zvenev1/* |
Disallow | /caphits/free-agency |
Disallow | /Highlights |
Disallow | /?q=admin |
Disallow | /?q=comment |
Disallow | /?q=filter%2Ftips |
Disallow | /?q=node%2Fadd |
Disallow | /?q=search |
Disallow | /?q=user%2Fpassword |
Disallow | /?q=user%2Fregister |
Disallow | /?q=user%2Flogin |
Disallow | /?q=user%2Flogout |
Other Records
Field | Value |
---|---|
crawl-delay | 100 |
Other Records
Field | Value |
---|---|
sitemap | https://nhl-news.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments