smak.ua
robots.txt

Robots Exclusion Standard data for smak.ua

Resource Scan

Scan Details

Site Domain smak.ua
Base Domain smak.ua
Scan Status Ok
Last Scan2024-11-13T19:39:26+00:00
Next Scan 2024-11-20T19:39:26+00:00

Last Scan

Scanned2024-11-13T19:39:26+00:00
URL https://smak.ua/robots.txt
Domain IPs 104.21.58.149, 172.67.204.128, 2606:4700:3031::ac43:cc80, 2606:4700:3032::6815:3a95
Response IP 104.21.58.149
Found Yes
Hash b854ce7840b80971793755cb02b38258d7326525dedf81820f9eab9d6f7fe248
SimHash 2c00d822a790

Groups

*

Rule Path
Disallow *tplmode%3Dprint
Disallow *tpl%3Dr_news_popular
Disallow */signin
Disallow */login
Disallow */share
Disallow */search
Disallow /click

slurp

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

Other Records

Field Value
sitemap https://smak.ua/sitemap.xml
sitemap https://smak.ua/sitemap.news.xml