tech.liga.net
robots.txt

Robots Exclusion Standard data for tech.liga.net

Resource Scan

Scan Details

Site Domain tech.liga.net
Base Domain liga.net
Scan Status Ok
Last Scan2025-12-21T22:07:41+00:00
Next Scan 2026-01-20T22:07:41+00:00

Last Scan

Scanned2025-12-21T22:07:41+00:00
URL https://tech.liga.net/robots.txt
Domain IPs 104.18.6.71, 104.18.7.71, 2606:4700::6812:647, 2606:4700::6812:747
Response IP 104.18.7.71
Found Yes
Hash 73d148b8daeb2bcad0436bad8a999838b8980a526d61692ab0503a1661d28a6c
SimHash 8aa6d402c001

Groups

meta-externalagent

Rule Path
Allow /
Disallow /cdn-cgi/
Disallow /preview-article/
Disallow /ua/preview-article/
Disallow /en/preview-article/
Disallow *index.php

facebookexternalhit

Rule Path
Allow /
Disallow /cdn-cgi/
Disallow /preview-article/
Disallow /ua/preview-article/
Disallow /en/preview-article/
Disallow *index.php

twitterbot

Rule Path
Allow /images
Allow *?*

*

Rule Path
Allow /design/
Allow /js/
Disallow /cdn-cgi/
Disallow /tag/
Disallow /editor/
Disallow *publishdate%3D*
Disallow /bitrix/
Disallow /search
Disallow /search/
Disallow /login
Disallow /profile
Disallow /login/
Disallow /preview-article/
Disallow /ua/preview-article/
Disallow /en/preview-article/
Disallow /management
Disallow /upload
Disallow /photonews/
Disallow /redirect?u=
Disallow *redirect?u=*
Disallow /section
Disallow /core
Disallow *?print=*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /print/
Disallow /files/
Disallow /rates/nal/date_*
Disallow /rates/nbu/date_*
Disallow /rates/metal/date_*
Disallow /banks/2015/9/1/interview/44767.htm
Disallow *_site%3D*
Disallow *htm?*
Disallow *aspx?*
Disallow /editor/%$
Disallow /rates/nbu/?$
Disallow *converter/?*
Disallow /rates/mb/*
Disallow *type*

Other Records

Field Value
sitemap https://tech.liga.net/sitemap-tech/sitemap-index.xml
sitemap https://tech.liga.net/sitemap-tech/sitemap-main.xml
sitemap https://tech.liga.net/sitemap-tech/sitemap-news.xml

Warnings

  • 1 invalid line.