mport.ua
robots.txt

Robots Exclusion Standard data for mport.ua

Resource Scan

Scan Details

Site Domain mport.ua
Base Domain mport.ua
Scan Status Ok
Last Scan2024-06-22T02:08:27+00:00
Next Scan 2024-06-29T02:08:27+00:00

Last Scan

Scanned2024-06-22T02:08:27+00:00
URL https://mport.ua/robots.txt
Domain IPs 104.21.81.109, 172.67.159.87, 2606:4700:3032::6815:516d, 2606:4700:3033::ac43:9f57
Response IP 172.67.159.87
Found Yes
Hash b3be28fdf9545b554a7c1079a03bac7de605a66b1ca2fc9890e979f2a1881918
SimHash 2c005832a711

Groups

*

Rule Path
Disallow *tplmode%3Dprint
Disallow *tpl%3Dr_news_popular
Disallow */signin
Disallow */login
Disallow */share
Disallow */search
Disallow /click

slurp

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mport.ua/sitemap.xml
sitemap https://mport.ua/sitemap.news.xml

Warnings

  • `host` is not a known field.