azs-lukoil.ru
robots.txt

Robots Exclusion Standard data for azs-lukoil.ru

Resource Scan

Scan Details

Site Domain azs-lukoil.ru
Base Domain azs-lukoil.ru
Scan Status Ok
Last Scan2026-03-24T15:56:44+00:00
Next Scan 2026-03-31T15:56:44+00:00

Last Scan

Scanned2026-03-24T15:56:44+00:00
URL https://azs-lukoil.ru/robots.txt
Domain IPs 104.21.79.246, 172.67.150.82, 2606:4700:3035::ac43:9652, 2606:4700:3037::6815:4ff6
Response IP 172.67.150.82
Found Yes
Hash 455732282aabb419dcf791cc00f27d9aa15fce6a12b801632d3d0ad08c066945
SimHash ea311b360624

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-content/themes
Disallow /wp-includes
Disallow /wp-trackback
Disallow /author/*
Disallow */comments
Disallow /page/*
Allow /wp-admin/admin-ajax.php
Disallow */feed
Disallow /test
Disallow /4595-2
Disallow /wp-feed
Disallow /cgi-bin
Disallow /tmp/
Disallow /trackback/
Disallow */trackback
Disallow */trackback/
Disallow *?s=
Disallow /wp-comments
Disallow /wp-content/cache
Disallow /wp-content/plugins

lwp-trivial

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /wp-comments
Allow */trackback/
Allow */trackback
Allow /wp-content/cache
Allow */feed
Allow /cgi-bin
Allow /4595-2
Allow /tmp/
Allow *?s=
Allow /wp-admin/admin-ajax.php
Allow /test
Allow /trackback/
Allow /wp-trackback
Allow /wp-includes
Allow */comments
Allow /wp-admin
Allow /wp-content/plugins
Allow /wp-content/themes
Allow /author/*
Allow /page/*
Allow /wp-feed

sistrix

Rule Path
Disallow /

yandex

Rule Path
Disallow /wp-content/plugins
Disallow /wp-comments
Disallow /trackback/
Disallow /wp-content/cache
Disallow /test
Disallow /tmp/
Disallow /cgi-bin
Allow /wp-admin/admin-ajax.php
Disallow /wp-feed
Disallow *?s=
Disallow /wp-content/themes
Disallow /4595-2
Disallow /author/*
Disallow /wp-includes
Disallow /wp-trackback
Disallow /page/*
Disallow */comments
Disallow */trackback/
Disallow */feed
Disallow */trackback
Disallow /wp-admin

python-rcontainsuests

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

googlebot-image

Rule Path
Allow /

olecrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://azs-lukoil.ru/sitemap.xml