onedayarecipe.com
robots.txt
Robots Exclusion Standard data for onedayarecipe.com
Resource Scan
Scan Details
Site Domain | onedayarecipe.com |
Base Domain | onedayarecipe.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-22T01:22:59+00:00 |
Next Scan | 2025-01-20T01:22:59+00:00 |
Last Successful Scan
Scanned | 2024-03-27T01:11:12+00:00 |
URL | https://onedayarecipe.com/robots.txt |
Redirect | https://www.onedayarecipe.com/robots.txt |
Redirect Domain | www.onedayarecipe.com |
Redirect Base | onedayarecipe.com |
Domain IPs | 92.222.8.45 |
Redirect IPs | 92.222.8.45 |
Response IP | 92.222.8.45 |
Found | Yes |
Hash | 597877903f617190aaaa6ca2ab8d6efcee94a8feaf3455da7895bed0fcdd348f |
SimHash | 20e260c24a30 |
Groups
ahrefsbot
amisoftware
apercite
ask n read
augure
bdcbot
blexbot
boardreader
ccbot
cubot
changedetection
cision
cliqzbot
comodo-webinspector-crawler
converacrawler
corporama
dazoobot
deusu
digimind
dotbot
ebuzzingfeedbot
europresse
exabot
fetch
flamingo_searchengine
flipboardproxy
james bot
jetbot
kik
knowings
kraken
linkpadbot
livelapbot
loadtimebot
msiecrawler
mail.ru_bot
meltawer
meltwater
mixbot
mojeekbot
mojeekbot
moreover
mpdmpra-search-bot
nerdybot
newsnow
newzbin
nextgensearchbot
offline explorer
pagesinventory
plukkie
prooxibot
quepasacreep
queryseekerspider
qwam content intelligence
rssingbot
rhemabot
seokicks-robot
scooperbot
screenerbot
seznambot
shopwiki
showyoubot
sindup
sitesnagger
siteliner
socialradarbot
surveybot
synthesio
talkwater
teleport
teleportpro
tjoosbot
turnitinbot
unisterbot
wasalive-bot
wbsearchbot
webcopier
webstripper
wotbox
xovibot
yeti
youmag
zealbot
zite
adequat
adequat-systems
aihitbot
asknread.com
auramundi
coexel
ellisphere
eureka
eureka.cc
flipboard
grub-client
ia_archiver
ia_archiver-web.archive.org
infoseek
k2spider
kbcrawl
leadbox
libwww
linkdexbot
linkfluence
meanpathbot
mention
mytwip
niki-bot
opinion-tracker
proxem
proximic
readability.com
rogerbot
scoop.it
score3
sitecheck.internetseer.com
spbot
special_archiver
spotter
trendeo
trendictionbot
trendictionbot
trendybuzz
vecteurplus
verticalsearch
vsw
wget
winello
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /*path_ |
Disallow | /forum/search- |
Disallow | /forum/user |
Disallow | /images/*jpg%3D |
Disallow | /images/*jpg~ |
Allow | /images/*jpg~301%26nwm%3D1$ |
Allow | /images/*jpg~301 |
Disallow | /js/simili.js |
Disallow | /recherche.php |
Disallow | /chercher.php |
Disallow | /carnet.php |
Disallow | /commenter.php |
Disallow | /comment.php |
Disallow | /chercher.php |
Disallow | /blog/wp-content/ |
Disallow | /blog/wp-admin/ |
Disallow | /blog/wp-includes/ |
Disallow | /fixcom |
Disallow | /testm |
Disallow | /recette-no-photo |
Disallow | /chercher/es$ |
Disallow | /chercher/kilo-de$ |
Disallow | /par-ingredients.php$ |
Disallow | *MTIZ* |
Disallow | *undefined* |
Disallow | *?nogdpr* |
Warnings
- 2 invalid lines.