cookingwithpeachy.com
robots.txt
Robots Exclusion Standard data for cookingwithpeachy.com
Resource Scan
Scan Details
Site Domain | cookingwithpeachy.com |
Base Domain | cookingwithpeachy.com |
Scan Status | Ok |
Last Scan | 2024-11-10T00:01:08+00:00 |
Next Scan | 2024-11-17T00:01:08+00:00 |
Last Scan
Scanned | 2024-11-10T00:01:08+00:00 |
URL | https://www.cookingwithpeachy.com/robots.txt |
Domain IPs | 89.46.110.76 |
Response IP | 89.46.110.76 |
Found | Yes |
Hash | 072f475cb926057713f241cbc081d44b23f2adf63a602f5e087d0f978aea7b87 |
SimHash | e28eca4305a7 |
Groups
abonti
aggregator
ahrefsbot
asterias
baiduspider
bdcbot
black hole
blexbot
builtbottough
bullseye
bullseye/1.0
bunnyslippers
ca-crawler
ccbot
cegbfeieh
cheesebot
cherrypicker
coccoc
copyrightcheck
cosmos
crescent
disco pump 3.1
discobot
dittospyder
dittospyder
dotbot
download ninja
easouspider
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
fasterfox
feedbooster
foobot
genieo
grub-client
harvest
hloader
httplib
httrack
humanlinks
ieautodiscovery
incutio
infonavirobot
istellabot
java/1.
jennybot
k2spider
kenjin spider
keyword density/0.9
larbin
lexibot
libweb
libwww
linkextractorprouser-agent: linko
linkscan/8.1a unix
linkwalker
lmspider
lnspiderguy
lwp-trivial
magpie
mata hari
maxpointcrawler
megaindex
memorybot
microsoft url
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
mippin
missigua locator
mister pix
mj12bot
moget
msiecrawler
netants
netattache
netattache light 1.1
netmechanic
nicerspro
niki-bot
npbot
nutch
offline explorer
openfind
panscient.com
php/5.{
propowerbot/2.14
prowebwalker
python-urllib
queryn metasearch
repomonkey
rma
semrushbot
serf
seznambot
sistrix
sitecheck.internetseer.com
sitesnagger
snappreviewbot
sogou
spankbot
spanner
spbot
spinn3r
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
turingos
turnitinbot
ubicrawler
unisterbot
unknown
uptime files
urly warning
vci
wbsearchbot
web downloader/6.9
web image collector
webauto
webbandit
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webzip
winhttrack
wotbox
wsr-agent
www-collector-e
xenu
zao
zeus
zyborg
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Allow | /wordpress/wp-admin/admin-ajax.php |
Disallow | */wp-statistics-honey-pot-page-2015-03-13-190710/* |
Disallow | */cgi-bin/* |
Disallow | */wordpress/wp-admin/* |
Disallow | */BackWpUp/* |
Disallow | */*.zip$ |
Disallow | */*.rar$ |
Disallow | */xmlrpc.php$ |
Disallow | */wp-login.php$ |
Disallow | */wp-config.php$ |
Disallow | */*%26Itemid* |
Disallow | */tag/* |
Disallow | */category/* |
Disallow | */wordpress/20*/* |
Disallow | */?s=* |
Disallow | */comment-page-*/$ |
Disallow | */*-1/* |
Disallow | */*-2/* |
Disallow | */*-3/* |
Disallow | */*-4/* |
Allow | */contact-form-7/* |
Disallow | */*-7/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.cookingwithpeachy.com/wordpress/sitemap.xml |
Warnings
- `host` is not a known field.