vsthemes.org
robots.txt

Robots Exclusion Standard data for vsthemes.org

Resource Scan

Scan Details

Site Domain vsthemes.org
Base Domain vsthemes.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-18T18:56:23+00:00
Next Scan 2025-01-16T18:56:23+00:00

Last Successful Scan

Scanned2024-06-21T18:54:28+00:00
URL https://vsthemes.org/robots.txt
Domain IPs 194.67.78.197
Response IP 194.67.78.197
Found Yes
Hash ea01e0e9c20c61ba3b72116b75c91ea91d3e519fcee18a357ed2248ac1fde520
SimHash 4011b3a0a735

Groups

yandex
*

Rule Path
Disallow /dnew/
Disallow /*/dnew/
Disallow /user/
Disallow /*/user/
Disallow /page/
Disallow /*/page/
Disallow /page%2C*
Disallow /*/page%2C*
Disallow /ideas/
Disallow /*/ideas/
Disallow /null
Disallow /*/null
Disallow /undefined
Disallow /*/undefined
Disallow /*?
Disallow /*%26
Disallow /*%
Allow /uploads/*?
Allow /templates/*?
Disallow /amp/
Disallow /amp%3A*
Disallow /download/
Disallow /dpage/
Disallow /*/dpage/
Disallow /pm/
Disallow /qa/
Disallow /fonts/
Disallow /skins/vk-styles/
Disallow /xfsearch/
Disallow /remaining/
Disallow /icon/stickers/
Disallow /skins/xwidget/
Disallow /ru/download/
Disallow /balance/
Disallow /icon/tiles/
Disallow /uploads/akamai/
Disallow /uploads/fotos/
Disallow /pictures/*/*
Disallow /*/pictures/*/*
Disallow /livepeace-*
Disallow /*/livepeace-*
Disallow /akagi-*
Disallow /*/akagi-*
Disallow /kigurumi-*
Disallow /*/kigurumi-*
Disallow /happystart-*
Disallow /*/happystart-*
Disallow /166*
Disallow /167*
Disallow /168*
Disallow /169*

yandex

Rule Path
Disallow /en/

mediapartners-google
facebookexternalhit
dotbot
amazonbot
applebot
gptbot

Rule Path
Disallow /

googlebot-image
yandeximages

Rule Path
Disallow /uploads/fotos/*

Other Records

Field Value
sitemap https://vsthemes.org/sitemap.xml

Warnings

  • `host` is not a known field.