gameophage.com
robots.txt
Robots Exclusion Standard data for gameophage.com
Resource Scan
Scan Details
Site Domain | gameophage.com |
Base Domain | gameophage.com |
Scan Status | Ok |
Last Scan | 2024-11-10T06:55:24+00:00 |
Next Scan | 2024-11-17T06:55:24+00:00 |
Last Scan
Scanned | 2024-11-10T06:55:24+00:00 |
URL | https://gameophage.com/robots.txt |
Redirect | https://www.gameophage.com/robots.txt |
Redirect Domain | www.gameophage.com |
Redirect Base | gameophage.com |
Domain IPs | 213.186.33.2 |
Redirect IPs | 213.186.33.2 |
Response IP | 213.186.33.2 |
Found | Yes |
Hash | 3de25d4c20f51a7d9538450de730483dbc8d840b9ba5eee9b1dc56fe23d08ab1 |
SimHash | 5693fa268cb9 |
Groups
alexibot
alvinetspider
ansearchbot
ansearchbot/1.0
anonymization.net
anonymization.net vivaldi
antenne hatena
apocalxexplorerbot
arachnophilia
aspider/0.09
asterias
auresys/1.0
Rule | Path |
---|---|
Disallow | / |
b2w/0.1
backdoorbot
backdoorbot/1.0
backrub/.
baiduspider
baiduspider-video
bayspider
bspider
big brother
bizbot003
bizbot04 kirk.overleaf.com
black hole
blackwidow
blowfish/1.0
blexbot
bullseye/1.0
botalot
bunnyslippers
builtbottough
becomebot/1.23
Rule | Path |
---|---|
Disallow | / |
cazoodlebot
crescent
crescent internet toolpak http ole control
cherrypickerse
cherrypickerelite
cerberian
custo
customexchangebrowser
christcrawler
converacrawler
check&get
copyrightcheck
cherrypicker
cheesebot
cosmos
calif univ tools
cegbfeieh
Rule | Path |
---|---|
Disallow | / |
ecatch
e-societyrobot
edgeio-retriever
echo!
eirgrabber
emailcollector
enigmabot
emailsiphon
emailwolf
entrieva
erocrawler
explorersearch
exabot
express webpictures
extractorpro
eyenetie
Rule | Path |
---|---|
Disallow | / |
factbot
filangy
findlinks
flamingo_searchengine
foobot
furl search
furlbot
f-bot test pilot
franklin locator 1.8
Rule | Path |
---|---|
Disallow | / |
linguee
larbin
larbin_2.6.3
lexibot
linkwalker
linklooker
linkscan/8.1a unix
linkextractorpro
libweb/clshttp
lnspiderguy
lwp-trivial
lwp-trivial/1.34
Rule | Path |
---|---|
Disallow | / |
mail.ru
mvaclient
missigua locator
minirank/2.0
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
mlbot
moget
moget/2.1
ms search 4.0 robot
ms search 5.0 robot
mata hari
msnptc/1.0
msproxy/2.0
mozilla/picgrabber
mozilla/3.0 (compatible; indy library)
Rule | Path |
---|---|
Disallow | / |
naverbot
naverbot-1.0
nasa search
netants
netattache
netmechanic
newsblur
nextgensearchbot
noxtrumbot
nicerspro
nicebot
nhsewalker
nomad
npbot
Rule | Path |
---|---|
Disallow | / |
offline explorer
omniexplorer_bot
openbot
openfind
openfind data gathere
outfoxbot
outfoxmelonbot
opendns domain crawler
openindexspider
Rule | Path |
---|---|
Disallow | / |
prowebwalker
propowerbot/2.14
psbot
program shareware
port huron labs
phantom-bot
poe-component-client-http
Rule | Path |
---|---|
Disallow | / |
safetynet robot 0.1
scooter
scooter-3.0.fs
scoutjet
semrushbot
searchpreview
seznambot
shopwiki
sitesnagger
sitesucker
sosospider
smartdownload
snooper/b97_01
sootle
speedy
speedy spider
spankbot
spanner
sproose
suggybot
sumeetbot
superbot
superbot/2.6
superhttp
surfbot
surveybot
suzuran
szukacz/1.4
Rule | Path |
---|---|
Disallow | / |
trackback
twiceler
titan
teleport
teleportpro
telesoft
turingos
thenomad
tocrawl/urldispatcher
turnitinbot
the intraformant
true_robot
true_robot/1.0
tighttwatbot
Rule | Path |
---|---|
Disallow | / |
wwwster
wells search ii
webmasterworldforumbot
walhello appie
webstripper
website quester
web image collector
wget
webzip
websauger
webcopier
webreaper
webauto
webcapture
webster pro
wikiofeedbot
wikiwix-bot
wikiwix-bot-3.0
winhttrack
wisenutbot
wbdbot
wep search 00
wotbox
www-collector-e
wysigot
webenhancer
webbandit
Rule | Path |
---|---|
Disallow | / |
Warnings
- 4 invalid lines.