goldengooseworld.com
robots.txt
Robots Exclusion Standard data for goldengooseworld.com
Resource Scan
Scan Details
| Site Domain | goldengooseworld.com |
| Base Domain | goldengooseworld.com |
| Scan Status | Ok |
| Last Scan | 2025-09-25T14:12:55+00:00 |
| Next Scan | 2025-10-25T14:12:55+00:00 |
Last Scan
| Scanned | 2025-09-25T14:12:55+00:00 |
| URL | https://goldengooseworld.com/robots.txt |
| Domain IPs | 104.21.55.150, 172.67.149.44, 2606:4700:3036::6815:3796, 2606:4700:3037::ac43:952c |
| Response IP | 172.67.149.44 |
| Found | Yes |
| Hash | 6f5e9f734b0145f0c17e1a8a0c7f8ee82730143a186f020e234acd784f8c7658 |
| SimHash | 619f52fbcfb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
xenu's link sleuth 1.1c
ahrefsbot
teleport
b2w/0.1
larbin
alexibot
gigabot
copyrightcheck
netmechanic
webcopier
openfind
mozilla/4.0 (compatible; msie 4.0; windows xp)
emailsiphon
tocrawl/urldispatcher
fairad client
infonavirobot
cosmos
libweb/clshttp
web image collector
jetbot/1.0
suzuran
dumbot
blowfish/1.0
vci webviewer vci webviewer win32
httplib
foobot
stanford compclub
nicerspro
lwp-trivial
keyword density/0.9
miixpc/4.2
xenu's
humanlinks
miixpc
dotbot
hatena antenna
emailcollector
botalot
getright/4.2
searchpreview
moget
repomonkey bait & tackle/v1.01
www-collector-e
szukacz/1.4
bunnyslippers
wget
builtbottough
crescent
extractorpro
msiecrawler
zeus 32297 webster pro v2.9 win32
blekkobot
microsoft url control - 5.01.4511
backdoorbot/1.0
mozilla/4.0 (compatible; msie 4.0; windows 95)
oracle ultra search
mister pix
scooter
gaisbot
thenomad
linkextractorpro
es
spankbot
sitesnagger
linkwalker
repomonkey
vci
mozilla/4.0 (compatible; msie 4.0; windows 98)
zeus
stanford
mozilla/4.0 (compatible; bullseye; windows 95)
flaming attackbot
linkscan/8.1a unix
enterprise_search
mozilla
mata hari
lwp-trivial/1.34
nutch
asterias
cherrypickerse/1.0
becomebot
webstripper
url control
webauto
webvac
mozilla/5
webzip
blexbot
copernic
moget/2.1
hloader
propowerbot/2.14
stanford spiderboys
mozilla
semrushbot
sootle
webzip/4.0
netants
crescent internet toolpak http ole control v.1.0
lexibot
the intraformant
mozilla/4.0 (compatible; msie 4.0; windows 2000)
perman
websauger
jetbot
webbandit/3.50
webbandit
microsoft url control - 6.00.8169
urly warning
harvest/1.5
grub
zeus link scout
dittospyder
bookmark search tool
aqua_products
radiation retriever 1.1
telesoft
exabot
teleportpro
openbot
stanford compsciclub
webenhancer
turingos
rogerbot
looksmart
wget/1.5.3
wget/1.6
http://www.webmasterworld.com bot
true_robot/1.0
mj12bot
erocrawler
cheesebot
mozilla/4
url_spider_pro
python-urllib
kenjin spider
http://www.searchengineworld.com bot
teoma
enterprise_search/1.0
openfind data gathere
microsoft url control
stanford comp sci
cherrypicker
true_robot
webmasterworldforumbot
offline explorer
ia_archiver/1.6
naver
cherrypickerelite/1.0
bullseye/1.0
webmasterworld extractor
emailwolf
rma
grub-client
mozilla/3
queryn metasearch
lnspiderguy
iron33/1.0.2
jennybot
mozilla/4.0 (compatible; msie 4.0; windows nt)
psbot
website quester
webster pro
spanner
prowebwalker
ia_archiver
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.goldengooseworld.com/sitemap_index.xml |