onedayarecipe.com
robots.txt

Robots Exclusion Standard data for onedayarecipe.com

Resource Scan

Scan Details

Site Domain onedayarecipe.com
Base Domain onedayarecipe.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-22T01:22:59+00:00
Next Scan 2025-01-20T01:22:59+00:00

Last Successful Scan

Scanned2024-03-27T01:11:12+00:00
URL https://onedayarecipe.com/robots.txt
Redirect https://www.onedayarecipe.com/robots.txt
Redirect Domain www.onedayarecipe.com
Redirect Base onedayarecipe.com
Domain IPs 92.222.8.45
Redirect IPs 92.222.8.45
Response IP 92.222.8.45
Found Yes
Hash 597877903f617190aaaa6ca2ab8d6efcee94a8feaf3455da7895bed0fcdd348f
SimHash 20e260c24a30

Groups

mediapartners-google

Rule Path
Disallow

ahrefsbot
amisoftware
apercite
ask n read
augure
bdcbot
blexbot
boardreader
ccbot
cubot
changedetection
cision
cliqzbot
comodo-webinspector-crawler
converacrawler
corporama
dazoobot
deusu
digimind
dotbot
ebuzzingfeedbot
europresse
exabot
fetch
flamingo_searchengine
flipboardproxy
james bot
jetbot
kik
knowings
kraken
linkpadbot
livelapbot
loadtimebot
msiecrawler
mail.ru_bot
meltawer
meltwater
mixbot
mojeekbot
mojeekbot
moreover
mpdmpra-search-bot
nerdybot
newsnow
newzbin
nextgensearchbot
offline explorer
pagesinventory
plukkie
prooxibot
quepasacreep
queryseekerspider
qwam content intelligence
rssingbot
rhemabot
seokicks-robot
scooperbot
screenerbot
seznambot
shopwiki
showyoubot
sindup
sitesnagger
siteliner
socialradarbot
surveybot
synthesio
talkwater
teleport
teleportpro
tjoosbot
turnitinbot
unisterbot
wasalive-bot
wbsearchbot
webcopier
webstripper
wotbox
xovibot
yeti
youmag
zealbot
zite
adequat
adequat-systems
aihitbot
asknread.com
auramundi
coexel
ellisphere
eureka
eureka.cc
flipboard
grub-client
ia_archiver
ia_archiver-web.archive.org
infoseek
k2spider
kbcrawl
leadbox
libwww
linkdexbot
linkfluence
meanpathbot
mention
mytwip
niki-bot
opinion-tracker
proxem
proximic
readability.com
rogerbot
scoop.it
score3
sitecheck.internetseer.com
spbot
special_archiver
spotter
trendeo
trendictionbot
trendictionbot
trendybuzz
vecteurplus
verticalsearch
vsw
wget
winello

Rule Path
Disallow /

*

Rule Path
Disallow /*path_
Disallow /forum/search-
Disallow /forum/user
Disallow /images/*jpg%3D
Disallow /images/*jpg~
Allow /images/*jpg~301%26nwm%3D1$
Allow /images/*jpg~301
Disallow /js/simili.js
Disallow /recherche.php
Disallow /chercher.php
Disallow /carnet.php
Disallow /commenter.php
Disallow /comment.php
Disallow /chercher.php
Disallow /blog/wp-content/
Disallow /blog/wp-admin/
Disallow /blog/wp-includes/
Disallow /fixcom
Disallow /testm
Disallow /recette-no-photo
Disallow /chercher/es$
Disallow /chercher/kilo-de$
Disallow /par-ingredients.php$
Disallow *MTIZ*
Disallow *undefined*
Disallow *?nogdpr*

Warnings

  • 2 invalid lines.