vidfb.com
robots.txt

Robots Exclusion Standard data for vidfb.com

Resource Scan

Scan Details

Site Domain vidfb.com
Base Domain vidfb.com
Scan Status Ok
Last Scan2026-02-14T08:56:53+00:00
Next Scan 2026-02-28T08:56:53+00:00

Last Scan

Scanned2026-02-14T08:56:53+00:00
URL https://vidfb.com/robots.txt
Domain IPs 104.21.52.8, 172.67.192.199, 2606:4700:3033::6815:3408, 2606:4700:3034::ac43:c0c7
Response IP 172.67.192.199
Found Yes
Hash c0836fcad73dfa655e81edb99dce78f8f91effcd85edc4bdcb24448fdd55f560
SimHash b243f0625e2b

Groups

*

Rule Path
Disallow /
Disallow /search?q=*
Disallow *?replytocom
Disallow */attachment/*
Disallow /images/
Disallow /chatbot*
Disallow /login
Disallow /register
Disallow /forgot-password
Disallow /api/
Allow /*.js$
Allow /*.css$

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

addthis.com (http://support.addthis.com/)

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

similarwebbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /