kivitu.com
robots.txt

Robots Exclusion Standard data for kivitu.com

Resource Scan

Scan Details

Site Domain kivitu.com
Base Domain kivitu.com
Scan Status Ok
Last Scan2024-09-27T10:13:40+00:00
Next Scan 2024-10-04T10:13:40+00:00

Last Scan

Scanned2024-09-27T10:13:40+00:00
URL https://kivitu.com/robots.txt
Domain IPs 23.106.126.135
Response IP 23.106.253.202
Found Yes
Hash e9c4d804c72b9c9a79a047f12653a5d58de06f47866c371c3453b6d3966bf688
SimHash 6d0eca4081b1

Groups

*

Rule Path
Disallow /*/search
Disallow /api
Disallow /settings
Disallow /g
Disallow /beta
Disallow *?quality
Disallow */tag-*/?page
Disallow */amp/?page
Disallow /*.xml

google

Rule Path
Disallow /*/search
Disallow /api
Disallow /settings
Disallow /g
Disallow /beta
Disallow *?quality
Disallow */tag-*/?page
Disallow */*/amp/?page
Disallow /*.xml

yandex

Rule Path
Disallow /*/search
Disallow /api
Disallow /settings
Disallow /g
Disallow /beta
Disallow *?quality
Disallow */tag-*/?page
Disallow */*/amp/

Other Records

Field Value
sitemap https://kivitu.com/sitemap.xml.gz
sitemap https://kivitu.com/sitemap-yandex.xml.gz

Warnings

  • `host` is not a known field.