corawine.be
robots.txt

Robots Exclusion Standard data for corawine.be

Resource Scan

Scan Details

Site Domain corawine.be
Base Domain corawine.be
Scan Status Ok
Last Scan2024-11-16T11:36:52+00:00
Next Scan 2024-12-16T11:36:52+00:00

Last Scan

Scanned2024-11-16T11:36:52+00:00
URL https://corawine.be/robots.txt
Domain IPs 20.105.216.33
Response IP 20.105.216.33
Found Yes
Hash e692cfa8362f09207cc54cb8145976a2273c681d72cab449fd5680fd08ce7a76
SimHash b01d9b48cce3

Groups

*

Rule Path
Allow /*filter%3D*~*
Disallow /*filter%3D*~*~
Disallow *?show_login=true
Disallow *?search=*
Disallow */signup*
Disallow */inscription*
Disallow */mon-compte*
Disallow */my-account*
Disallow */api*
Disallow */Primic%20Url%20Not%20Found
Disallow */customer*
Disallow */commander*
Disallow */checkout*

adequat

Rule Path
Disallow /

admantx bot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

corporama

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotmic dotbot

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grapeshot bot

Rule Path
Disallow /

houzzbot

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

leadbox

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

linko

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

opinion-tracker

Rule Path
Disallow /

proxem

Rule Path
Disallow /

proximic bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spotter

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

verticalsearch

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

winello

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://api.cora.apizr.io/v0/fr/sitemap.xml
sitemap https://api.cora.apizr.io/v0/nl/sitemap.xml

Comments

  • Blocage Robots indesirables