nivito.at
robots.txt

Robots Exclusion Standard data for nivito.at

Resource Scan

Scan Details

Site Domain nivito.at
Base Domain nivito.at
Scan Status Ok
Last Scan2024-11-17T05:32:45+00:00
Next Scan 2024-12-17T05:32:45+00:00

Last Scan

Scanned2024-11-17T05:32:45+00:00
URL https://nivito.at/robots.txt
Redirect https://www.nivito.at/robots.txt
Redirect Domain www.nivito.at
Redirect Base nivito.at
Domain IPs 104.21.72.177, 172.67.153.86, 2606:4700:3034::6815:48b1, 2606:4700:3037::ac43:9956
Redirect IPs 104.21.72.177, 172.67.153.86, 2606:4700:3034::6815:48b1, 2606:4700:3037::ac43:9956
Response IP 104.21.72.177
Found Yes
Hash 5ddd35ddf45de1665d89dddb25045ec2e22d67642fd9524b78a17a5bfef963fa
SimHash 4a32e440cc92

Groups

*

Rule Path
Disallow /

bingbot
googlebot

Rule Path
Disallow

gigabot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bspider

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

sogou

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

xyz

Rule Path
Disallow /

bl.uk_lddc_bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

*

Rule Path
Disallow /nogooglebot/
Disallow /app/
Disallow /.github/
Disallow /bin/
Disallow /db-backup/
Disallow /dev/
Disallow /generated/
Disallow /lib/
Disallow /phpserver/
Disallow /app/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://www.nivito.at/pub/sitemap/de_AT.xml