vera-italy.ro
robots.txt
Robots Exclusion Standard data for vera-italy.ro
Resource Scan
Scan Details
Site Domain | vera-italy.ro |
Base Domain | vera-italy.ro |
Scan Status | Ok |
Last Scan | 2024-09-17T05:41:57+00:00 |
Next Scan | 2024-10-17T05:41:57+00:00 |
Last Scan
Scanned | 2024-09-17T05:41:57+00:00 |
URL | https://vera-italy.ro/robots.txt |
Domain IPs | 185.123.190.211 |
Response IP | 185.123.190.211 |
Found | Yes |
Hash | 73df94132147e4cd2d253b58259207c26d62d14b85ba05751afbda5fd1608bb6 |
SimHash | 6a8ad4d0e3e1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
why-the-f-are-you-looking-at-this-list
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
blexbot
ccbot
dotbot
dotbot
dotbot/1.1
mj12bot
ahrefsbot
seokicks-robot
dotbot
dotbot
dotbot/1.1
semrushbot
semrushbot-sa
megaindex.ru
megaindex.ru/2.0
spbot
linguee
deusu
turnitinbot
yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
psbot
cliqzbot
mojeekbot
qwantify
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.vera-italy.ro/sitemap.xml |
Warnings
- 1 invalid line.
Comments