optsig.ru
robots.txt

Robots Exclusion Standard data for optsig.ru

Resource Scan

Scan Details

Site Domain optsig.ru
Base Domain optsig.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan3/16/2025, 2:40:31 PM
Next Scan 6/14/2025, 2:40:31 PM

Last Successful Scan

Scanned4/28/2024, 10:15:41 AM
URL https://optsig.ru/robots.txt
Redirect https://optomsigi.com/robots.txt
Redirect Domain optomsigi.com
Redirect Base optomsigi.com
Domain IPs 104.21.2.226, 172.67.129.195, 2606:4700:3032::6815:2e2, 2606:4700:3035::ac43:81c3
Redirect IPs 104.21.82.171, 172.67.160.60, 2606:4700:3030::ac43:a03c, 2606:4700:3032::6815:52ab
Response IP 104.21.82.171
Found Yes
Hash 9cddbea0205221394fa6ed011fb3db2d6dfe9599cbd999ee325ac8f7aaa6f53f
SimHash 062dab636d93

Groups

*

Rule Path
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dcommon/
Disallow /*route%3Dproduct/compare
Disallow /*route%3Dproduct/search
Disallow /*route%3Dproduct/product*%26manufacturer_id%3D
Disallow /catalog/controller
Disallow /catalog/language
Disallow /catalog/model
Disallow /download
Disallow /system
Disallow /search
Disallow */storage/
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter=
Disallow /*%26filter%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*%26tag%3D*
Disallow /*?tag=*
Disallow /*?*search=*
Disallow /*?*page=*
Disallow /*?*path=*
Disallow /*?*route=*
Allow *.css
Allow *.js
Allow *.jpg
Allow *.jpeg
Allow *.gif
Allow *.png
Allow *.svg
Allow *.webp
Allow *.ttf
Allow *.woff
Allow *.woff2

Other Records

Field Value
sitemap https://optovtabak.ru/sitemap_index.xml

Warnings

  • `host` is not a known field.