baovictoria.com.au
robots.txt

Robots Exclusion Standard data for baovictoria.com.au

Resource Scan

Scan Details

Site Domain baovictoria.com.au
Base Domain baovictoria.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-12T15:04:44+00:00
Next Scan 2024-12-11T15:04:44+00:00

Last Successful Scan

Scanned2021-12-17T13:11:44+00:00
URL https://baovictoria.com.au/robots.txt
Redirect https://vtimes.com.au/robots.txt
Redirect Domain vtimes.com.au
Redirect Base vtimes.com.au
Response IP 223.27.15.111
Found Yes
Hash deeb35866d526e76894041e3d17980f13a2e3ba04ecd7254d7e70057a6bf967a
SimHash 9703f14c4d55

Groups

*

Rule Path
Allow /
Disallow /admin
Disallow /26121109
Disallow /dp
Disallow /up/XEMTINTUC
Disallow /utility
Disallow /ajax
Disallow /continue
Disallow /epub/norobot
Disallow /counter
Disallow /hcache

coccocbot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /