nivito.ch
robots.txt

Robots Exclusion Standard data for nivito.ch

Resource Scan

Scan Details

Site Domain nivito.ch
Base Domain nivito.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-11-18T05:51:51+00:00
Next Scan 2024-11-25T05:51:51+00:00

Last Successful Scan

Scanned2024-11-16T05:51:27+00:00
URL https://nivito.ch/robots.txt
Redirect https://www.nivito.ch/robots.txt
Redirect Domain www.nivito.ch
Redirect Base nivito.ch
Domain IPs 104.21.27.215, 172.67.169.195, 2606:4700:3031::ac43:a9c3, 2606:4700:3037::6815:1bd7
Redirect IPs 104.21.27.215, 172.67.169.195, 2606:4700:3031::ac43:a9c3, 2606:4700:3037::6815:1bd7
Response IP 104.21.27.215
Found Yes
Hash 98243c96004f9bb98509c1e1a7bdce5099c9aab5f9a251e169278d46e8275a9c
SimHash 4a364c40cc00

Groups

*

Rule Path
Disallow /

bingbot
googlebot

Rule Path
Disallow

gigabot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bspider

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

sogou

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

xyz

Rule Path
Disallow /

bl.uk_lddc_bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

*

Rule Path
Disallow /nogooglebot/
Disallow /app/
Disallow /.github/
Disallow /bin/
Disallow /db-backup/
Disallow /dev/
Disallow /generated/
Disallow /lib/
Disallow /phpserver/
Disallow /app/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://www.nivito.ch/pub/sitemap/de_CH.xml
sitemap https://www.nivito.ch/pub/sitemap/fr_DE.xml
sitemap https://www.nivito.ch/pub/sitemap/it_CH.xml