cookingwithpeachy.com
robots.txt

Robots Exclusion Standard data for cookingwithpeachy.com

Resource Scan

Scan Details

Site Domain cookingwithpeachy.com
Base Domain cookingwithpeachy.com
Scan Status Ok
Last Scan2024-11-10T00:01:08+00:00
Next Scan 2024-11-17T00:01:08+00:00

Last Scan

Scanned2024-11-10T00:01:08+00:00
URL https://www.cookingwithpeachy.com/robots.txt
Domain IPs 89.46.110.76
Response IP 89.46.110.76
Found Yes
Hash 072f475cb926057713f241cbc081d44b23f2adf63a602f5e087d0f978aea7b87
SimHash e28eca4305a7

Groups

abonti
aggregator
ahrefsbot
asterias
baiduspider
bdcbot
black hole
blexbot
builtbottough
bullseye
bullseye/1.0
bunnyslippers
ca-crawler
ccbot
cegbfeieh
cheesebot
cherrypicker
coccoc
copyrightcheck
cosmos
crescent
disco pump 3.1
discobot
dittospyder
dittospyder
dotbot
download ninja
easouspider
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
fasterfox
feedbooster
foobot
genieo
grub-client
harvest
hloader
httplib
httrack
humanlinks
ieautodiscovery
incutio
infonavirobot
istellabot
java/1.
jennybot
k2spider
kenjin spider
keyword density/0.9
larbin
lexibot
libweb
libwww
linkextractorprouser-agent: linko
linkscan/8.1a unix
linkwalker
lmspider
lnspiderguy
lwp-trivial
magpie
mata hari
maxpointcrawler
megaindex
memorybot
microsoft url
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
mippin
missigua locator
mister pix
mj12bot
moget
msiecrawler
netants
netattache
netattache light 1.1
netmechanic
nicerspro
niki-bot
npbot
nutch
offline explorer
openfind
panscient.com
php/5.{
propowerbot/2.14
prowebwalker
python-urllib
queryn metasearch
repomonkey
rma
semrushbot
serf
seznambot
sistrix
sitecheck.internetseer.com
sitesnagger
snappreviewbot
sogou
spankbot
spanner
spbot
spinn3r
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
turingos
turnitinbot
ubicrawler
unisterbot
unknown
uptime files
urly warning
vci
wbsearchbot
web downloader/6.9
web image collector
webauto
webbandit
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webzip
winhttrack
wotbox
wsr-agent
www-collector-e
xenu
zao
zeus
zyborg

Rule Path
Disallow /

*

Rule Path
Allow /wordpress/wp-admin/admin-ajax.php
Disallow */wp-statistics-honey-pot-page-2015-03-13-190710/*
Disallow */cgi-bin/*
Disallow */wordpress/wp-admin/*
Disallow */BackWpUp/*
Disallow */*.zip$
Disallow */*.rar$
Disallow */xmlrpc.php$
Disallow */wp-login.php$
Disallow */wp-config.php$
Disallow */*%26Itemid*
Disallow */tag/*
Disallow */category/*
Disallow */wordpress/20*/*
Disallow */?s=*
Disallow */comment-page-*/$
Disallow */*-1/*
Disallow */*-2/*
Disallow */*-3/*
Disallow */*-4/*
Allow */contact-form-7/*
Disallow */*-7/*

Other Records

Field Value
sitemap https://www.cookingwithpeachy.com/wordpress/sitemap.xml

Warnings

  • `host` is not a known field.