onedayarecipe.com
robots.txt
Robots Exclusion Standard data for onedayarecipe.com
Resource Scan
Scan Details
| Site Domain | onedayarecipe.com |
| Base Domain | onedayarecipe.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-05-25T01:22:34+00:00 |
| Next Scan | 2024-07-24T01:22:34+00:00 |
Last Successful Scan
| Scanned | 2024-03-27T01:11:12+00:00 |
| URL | https://onedayarecipe.com/robots.txt |
| Redirect | https://www.onedayarecipe.com/robots.txt |
| Redirect Domain | www.onedayarecipe.com |
| Redirect Base | onedayarecipe.com |
| Domain IPs | 92.222.8.45 |
| Redirect IPs | 92.222.8.45 |
| Response IP | 92.222.8.45 |
| Found | Yes |
| Hash | 597877903f617190aaaa6ca2ab8d6efcee94a8feaf3455da7895bed0fcdd348f |
| SimHash | 20e260c24a30 |
Groups
ahrefsbot
amisoftware
apercite
ask n read
augure
bdcbot
blexbot
boardreader
ccbot
cubot
changedetection
cision
cliqzbot
comodo-webinspector-crawler
converacrawler
corporama
dazoobot
deusu
digimind
dotbot
ebuzzingfeedbot
europresse
exabot
fetch
flamingo_searchengine
flipboardproxy
james bot
jetbot
kik
knowings
kraken
linkpadbot
livelapbot
loadtimebot
msiecrawler
mail.ru_bot
meltawer
meltwater
mixbot
mojeekbot
mojeekbot
moreover
mpdmpra-search-bot
nerdybot
newsnow
newzbin
nextgensearchbot
offline explorer
pagesinventory
plukkie
prooxibot
quepasacreep
queryseekerspider
qwam content intelligence
rssingbot
rhemabot
seokicks-robot
scooperbot
screenerbot
seznambot
shopwiki
showyoubot
sindup
sitesnagger
siteliner
socialradarbot
surveybot
synthesio
talkwater
teleport
teleportpro
tjoosbot
turnitinbot
unisterbot
wasalive-bot
wbsearchbot
webcopier
webstripper
wotbox
xovibot
yeti
youmag
zealbot
zite
adequat
adequat-systems
aihitbot
asknread.com
auramundi
coexel
ellisphere
eureka
eureka.cc
flipboard
grub-client
ia_archiver
ia_archiver-web.archive.org
infoseek
k2spider
kbcrawl
leadbox
libwww
linkdexbot
linkfluence
meanpathbot
mention
mytwip
niki-bot
opinion-tracker
proxem
proximic
readability.com
rogerbot
scoop.it
score3
sitecheck.internetseer.com
spbot
special_archiver
spotter
trendeo
trendictionbot
trendictionbot
trendybuzz
vecteurplus
verticalsearch
vsw
wget
winello
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*path_ |
| Disallow | /forum/search- |
| Disallow | /forum/user |
| Disallow | /images/*jpg%3D |
| Disallow | /images/*jpg~ |
| Allow | /images/*jpg~301%26nwm%3D1$ |
| Allow | /images/*jpg~301 |
| Disallow | /js/simili.js |
| Disallow | /recherche.php |
| Disallow | /chercher.php |
| Disallow | /carnet.php |
| Disallow | /commenter.php |
| Disallow | /comment.php |
| Disallow | /chercher.php |
| Disallow | /blog/wp-content/ |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-includes/ |
| Disallow | /fixcom |
| Disallow | /testm |
| Disallow | /recette-no-photo |
| Disallow | /chercher/es$ |
| Disallow | /chercher/kilo-de$ |
| Disallow | /par-ingredients.php$ |
| Disallow | *MTIZ* |
| Disallow | *undefined* |
| Disallow | *?nogdpr* |
Warnings
- 2 invalid lines.