thehinhvip.com
robots.txt
Robots Exclusion Standard data for thehinhvip.com
Resource Scan
Scan Details
| Site Domain | thehinhvip.com |
| Base Domain | thehinhvip.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-23T05:03:02+00:00 |
| Next Scan | 2025-01-21T05:03:02+00:00 |
Last Successful Scan
| Scanned | 2023-09-07T04:20:24+00:00 |
| URL | https://thehinhvip.com/robots.txt |
| Redirect | https://www.thehinhvip.com/robots.txt |
| Redirect Domain | www.thehinhvip.com |
| Redirect Base | thehinhvip.com |
| Domain IPs | 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21 |
| Redirect IPs | 2404:6800:4003:c05::79, 74.125.200.121 |
| Response IP | 74.125.68.121 |
| Found | Yes |
| Hash | e34ce1855a513ee0ce641f8818905fc84502ac4450887bec5cb3278fd6777f76 |
| SimHash | 135f7353c706 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search* |
| Disallow | *search/label* |
| Disallow | /?q=* |
| Disallow | /*?updated-max=* |
| Disallow | /?url=* |
| Disallow | *?id=* |
| Disallow | *?source* |
| Disallow | *?fbclid=* |
| Disallow | *undefined* |
| Disallow | *content-wrapper* |
| Disallow | */default/0* |
| Disallow | */default/1* |
| Disallow | */default/2* |
| Disallow | */default/3* |
| Disallow | */default/4* |
| Disallow | */default/5* |
| Disallow | */default/6* |
| Disallow | */default/7* |
| Disallow | */default/8* |
| Disallow | */default/9* |
| Disallow | *osts/summary?* |
aboundexbot
adbeat bot
addthis.com
admantx crawler
alexibot
antbot
applebot
applenewsbot
autoemailspider
awario crawler
backlinkcrawler
backlink-check.de
blackwidow
blekkobo
blexbot
bot\ mailto:craftbot@yahoo.com
botify
buzzsumo
ccbot
cognitiveseo
custo
chinaclaw
disco
domainsdb.net metacrawler
domainsigmacrawler
domainstatsbot
download\ demon
dsearch
ecatch
eirgrabber
emailsiphon
emailwolf
etaospider
exabot
express\ webpictures
extractorpro
eyenetie
ezooms
feedly
flashget
fyberspider
getright
getweb!
go!zilla
go-ahead-got-it
grabnet
grafula
grapheshot
gigabot
hmview
httrack
image\ stripper
image\ sucker
imagefetcher
indy\ library
interget
internet\ ninja
jamesbot
jetcar
joc\ web\ spider
larbin
leechftp
lycos
mail.ru_bot
mass\ downloader
masscan
meanpathbot
mediatoolkitbot
midown\ tool
mister\ pix
mj12bot
mojeekbot
navroad
ncbot
nearsite
net\ vampire
netants
netspider
netzip
niki-bot
ninjabot
npbot
nutch
octopus
offline\ explorer
offline\ navigator
oncrawl
online domain tools
pagegrabber
pagesinventory
papa\ foto
partyflocklinkchecker
pavuk
pcbrowser
petalbot
prerender
printfriendly.com
proximic
psbot
phpcrawl
realdownload
reget
scoutjet
screaming frog seo spider
searchmetricsbot
seokicks
seokicks-robot
seo-powersuite-bot
seositecheckup
serpstatbot
sirdatabot
sistrix
sistrix crawler
sistrix optimizer
sitebot
sitecheckerbot
sitecheckerbotcrawler
sitesnagger
smartdownload
sosospider
sp_auditbot
spbot
splash
spyfu
superbot
superhttp
surfbot
takeout
technicalseodotcom
teleport\ pro
turnitinbot
twiceler
trendkite-akashic-crawler
trovitbot
voideye
wappalyzer
web\ image\ collector
web\ sucker
webauto
webcopier
webfetch
webgo\ is
webleacher
webreaper
websauger
website\ extractor
website\ quester
webstripper
webwhacker
webzip
wget
widow
wwwoffle
xaldon\ webspider
xenu
xovibot
yisouspider
yodaobot
zeus
zoominfo bot
semrushbot
semrushbot-ba
semrushbot-bm
semrushbot-ct
semrushbot-lbt
semrushbot-sa
semrushbot-seoab
semrushbot-si
semrushbot-swa
siteauditbot
mbcrawler
mbcrawler/1.0
se ranking gentle bot
serankingpageauditbot
ahrefsbot
ahrefssiteaudit
dotbot
rogerbot
megaindex.ru
megaindex.com
dataprovider
lipperhey-kaus-australis
lippershey
lipperhey spider
dataprovider site explorer
lipperhey link explorer
seekbot
seekport crawler
linkdexbot
cocolyzebot
domcopbot
weborama
weborama-fetcher
woobot
woorankreview
hexometer
hexometer.com crawler
ubersuggestbot
rsiteauditor
seobilitybot
seobility
seznambot
homepagebot rss reader 1.0
homepagebot downloader 1.0
tineye
tineye-bot
baiduspider
baiduspider-render
baiduspider-ads
baiduspider-image
sogou web spider
sogou spider
hubspot crawler
hubspot connect 2.0
hubspot url validation check
alexabot
alexa site audit
ia_archiver
archive.org_bot
special_archiver
yandex
yandexbot
yandeximages
yandexmobilebot
yandexaccessibilitybot
yandexfavicons
yandexmedia
trendictionbot
trendictionbot0.5.0
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thehinhvip.com/sitemap.xml |
Warnings
- 2 invalid lines.