invantive.com
robots.txt
Robots Exclusion Standard data for invantive.com
Resource Scan
Scan Details
| Site Domain | invantive.com |
| Base Domain | invantive.com |
| Scan Status | Ok |
| Last Scan | 2024-07-01T03:28:16+00:00 |
| Next Scan | 2024-07-08T03:28:16+00:00 |
Last Scan
| Scanned | 2024-07-01T03:28:16+00:00 |
| URL | https://invantive.com/robots.txt |
| Domain IPs | 54.192.18.106, 54.192.18.107, 54.192.18.34, 54.192.18.63 |
| Response IP | 108.157.254.95 |
| Found | Yes |
| Hash | b013da0c596a34fd3cf491edcd4c1b6f26fb2fd34190db436939a80cca705682 |
| SimHash | 9371b3574b43 |
Groups
ahrefsbot
blackwidow
baiduspider
chinaclaw
custo
disco
dotbot
download\ demon
eirgrabber
emailsiphon
emailwolf
exabot
express\ webpictures
extractorpro
eyenetie
flashget
getright
getweb!
gigabot
go!zilla
go-ahead-got-it
grabnet
grafula
hmview
httrack
image\ stripper
image\ sucker
indy\ library
interget
internet\ ninja
joc\ web\ spider
jetcar
leechftp
megaindexbot
midown\ tool
mj12bot
mass\ downloader
mister\ pix
navroad
nearsite
netants
netspider
netzip
net\ vampire
octopus
offline\ explorer
offline\ navigator
pagegrabber
papa\ foto
reget
realdownload
rogerbot
siteauditbot
semrushbot
semrushbot-ba
semrushbot-bm
semrushbot-ct
semrushbot-sa
semrushbot-si
semrushbot-swa
seo-powersuite-bot
serpstatbot
sitesnagger
smartdownload
splitsignalbot
superbot
superhttp
surfbot
teleport\ pro
voideye
wwwoffle
webauto
webcopier
webfetch
webgo\ is
webleacher
webreaper
websauger
webstripper
webwhacker
webzip
web\ image\ collector
web\ sucker
website\ quester
website\ extractor
wget
widow
xaldon\ webspider
yandexbot
zeus
ecatch
ia_archiver
larbin
pavuk
pcbrowser
takeout
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
bingbot
slurp
duckduckbot
exalead
elastic crawler
gptbot
google-extended
chatgpt-user
ccbot
googleother
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://invantive.com/sitemap.xml |