cookingwithpeachy.com
robots.txt
Robots Exclusion Standard data for cookingwithpeachy.com
Resource Scan
Scan Details
| Site Domain | cookingwithpeachy.com |
| Base Domain | cookingwithpeachy.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-21T23:53:30+00:00 |
| Next Scan | 2024-10-05T23:53:30+00:00 |
Last Successful Scan
| Scanned | 2024-09-06T08:51:22+00:00 |
| URL | https://www.cookingwithpeachy.com/robots.txt |
| Domain IPs | 89.46.110.76 |
| Response IP | 89.46.110.76 |
| Found | Yes |
| Hash | 072f475cb926057713f241cbc081d44b23f2adf63a602f5e087d0f978aea7b87 |
| SimHash | e28eca4305a7 |
Groups
abonti
aggregator
ahrefsbot
asterias
baiduspider
bdcbot
black hole
blexbot
builtbottough
bullseye
bullseye/1.0
bunnyslippers
ca-crawler
ccbot
cegbfeieh
cheesebot
cherrypicker
coccoc
copyrightcheck
cosmos
crescent
disco pump 3.1
discobot
dittospyder
dittospyder
dotbot
download ninja
easouspider
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
fasterfox
feedbooster
foobot
genieo
grub-client
harvest
hloader
httplib
httrack
humanlinks
ieautodiscovery
incutio
infonavirobot
istellabot
java/1.
jennybot
k2spider
kenjin spider
keyword density/0.9
larbin
lexibot
libweb
libwww
linkextractorprouser-agent: linko
linkscan/8.1a unix
linkwalker
lmspider
lnspiderguy
lwp-trivial
magpie
mata hari
maxpointcrawler
megaindex
memorybot
microsoft url
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
mippin
missigua locator
mister pix
mj12bot
moget
msiecrawler
netants
netattache
netattache light 1.1
netmechanic
nicerspro
niki-bot
npbot
nutch
offline explorer
openfind
panscient.com
php/5.{
propowerbot/2.14
prowebwalker
python-urllib
queryn metasearch
repomonkey
rma
semrushbot
serf
seznambot
sistrix
sitecheck.internetseer.com
sitesnagger
snappreviewbot
sogou
spankbot
spanner
spbot
spinn3r
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
turingos
turnitinbot
ubicrawler
unisterbot
unknown
uptime files
urly warning
vci
wbsearchbot
web downloader/6.9
web image collector
webauto
webbandit
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webzip
winhttrack
wotbox
wsr-agent
www-collector-e
xenu
zao
zeus
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | /wordpress/wp-admin/admin-ajax.php |
| Disallow | */wp-statistics-honey-pot-page-2015-03-13-190710/* |
| Disallow | */cgi-bin/* |
| Disallow | */wordpress/wp-admin/* |
| Disallow | */BackWpUp/* |
| Disallow | */*.zip$ |
| Disallow | */*.rar$ |
| Disallow | */xmlrpc.php$ |
| Disallow | */wp-login.php$ |
| Disallow | */wp-config.php$ |
| Disallow | */*%26Itemid* |
| Disallow | */tag/* |
| Disallow | */category/* |
| Disallow | */wordpress/20*/* |
| Disallow | */?s=* |
| Disallow | */comment-page-*/$ |
| Disallow | */*-1/* |
| Disallow | */*-2/* |
| Disallow | */*-3/* |
| Disallow | */*-4/* |
| Allow | */contact-form-7/* |
| Disallow | */*-7/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cookingwithpeachy.com/wordpress/sitemap.xml |
Warnings
- `host` is not a known field.