vera-italy.fr
robots.txt
Robots Exclusion Standard data for vera-italy.fr
Resource Scan
Scan Details
Site Domain | vera-italy.fr |
Base Domain | vera-italy.fr |
Scan Status | Ok |
Last Scan | 2024-09-17T05:32:57+00:00 |
Next Scan | 2024-10-17T05:32:57+00:00 |
Last Scan
Scanned | 2024-09-17T05:32:57+00:00 |
URL | https://vera-italy.fr/robots.txt |
Domain IPs | 185.123.190.211 |
Response IP | 185.123.190.211 |
Found | Yes |
Hash | c4e5e03c67025b22f1ec8c74cfe292f13516a4b085b1224c8a5d3171e88c3db6 |
SimHash | 6a8ad4d0e3e1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
why-the-f-are-you-looking-at-this-list
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
blexbot
ccbot
dotbot
dotbot
dotbot/1.1
mj12bot
ahrefsbot
seokicks-robot
dotbot
dotbot
dotbot/1.1
semrushbot
semrushbot-sa
megaindex.ru
megaindex.ru/2.0
spbot
linguee
deusu
turnitinbot
yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
psbot
cliqzbot
mojeekbot
qwantify
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.vera-italy.fr/sitemap.xml |
Warnings
- 1 invalid line.
Comments