vera-italy.de
robots.txt
Robots Exclusion Standard data for vera-italy.de
Resource Scan
Scan Details
Site Domain | vera-italy.de |
Base Domain | vera-italy.de |
Scan Status | Ok |
Last Scan | 2024-09-17T05:32:57+00:00 |
Next Scan | 2024-10-17T05:32:57+00:00 |
Last Scan
Scanned | 2024-09-17T05:32:57+00:00 |
URL | https://vera-italy.de/robots.txt |
Domain IPs | 185.123.190.211 |
Response IP | 185.123.190.211 |
Found | Yes |
Hash | e97619624d89ab8f106bde3886af03d5a31e6047bcfa7c2e7440d51faaf24e4f |
SimHash | 7a8ad4d173e1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
why-the-f-are-you-looking-at-this-list
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
blexbot
ccbot
dotbot
dotbot
dotbot/1.1
mj12bot
ahrefsbot
seokicks-robot
dotbot
dotbot
dotbot/1.1
semrushbot
semrushbot-sa
megaindex.ru
megaindex.ru/2.0
spbot
linguee
deusu
turnitinbot
yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
psbot
cliqzbot
mojeekbot
qwantify
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.vera-italy.de/sitemap.xml |
Warnings
- 1 invalid line.
Comments