Log In Sign Up

vera-italy.pl
robots.txt

Robots Exclusion Standard data for vera-italy.pl

Resource Scan

Scan Details

Site Domain vera-italy.pl
Base Domain vera-italy.pl
Scan Status Ok
Last Scan2024-09-17T04:32:08+00:00
Next Scan 2024-10-17T04:32:08+00:00

Last Scan

Scanned2024-09-17T04:32:08+00:00
URL https://vera-italy.pl/robots.txt
Domain IPs 185.123.190.211
Response IP 185.123.190.211
Found Yes
Hash 153e85d418329406fe7f43cbdee225d8bdbf2494b8170af5166d9b77d081709c
SimHash 6a8ad4d0f3e1

Groups

*

Rule Path
Allow /

velenpublicwebcrawler

Rule Path
Disallow /

why-the-f-are-you-looking-at-this-list
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
blexbot
ccbot
dotbot
dotbot
dotbot/1.1
mj12bot
ahrefsbot
seokicks-robot
dotbot
dotbot
dotbot/1.1
semrushbot
semrushbot-sa
megaindex.ru
megaindex.ru/2.0
spbot
linguee
deusu
turnitinbot
yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
psbot
cliqzbot
mojeekbot
qwantify

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://www.vera-italy.pl/sitemap.xml
Back to top

Comments

  • _____
  • | . . |
  • |_____|
  • ____ ___|_|___ ____
  • ()___) __ ()___)
  • // /| ____ |\ \\
  • // / | ____ | \ \\
  • (___) |___________| (___)
  • (___) (_______) (___)
  • (___) (___) (___)
  • (___) |_| (___)
  • (___) ___/___\___ | |
  • | | | . . . | |.|
  • |.| |___________| /___\
  • /___\ ||| ||| // \\
  • // \\ ||| ||| \\ //
  • \\ // ||| ||| \\ //
  • \\ // ()__) (__()
  • /// \\\
  • /// \\\
  • _///___ ___\\\_
  • |_______| |_______| robots.txt
Back to top

Warnings

  • 1 invalid line.
Back to top