Log In Sign Up

restaurant-annam.com
robots.txt

Robots Exclusion Standard data for restaurant-annam.com

Resource Scan

Scan Details

Site Domain restaurant-annam.com
Base Domain restaurant-annam.com
Scan Status Ok
Last Scan2026-02-05T03:01:28+00:00
Next Scan 2026-02-12T03:01:28+00:00

Last Scan

Scanned2026-02-05T03:01:28+00:00
URL https://restaurant-annam.com/robots.txt
Domain IPs 2001:41d0:1:1b00:213:186:33:19, 213.186.33.19
Response IP 213.186.33.19
Found Yes
Hash 2d523ec4704f7f2abd00e99fd3e805f7da7fa01a4fad2e4028d59f32284d9356
SimHash 885ed9524d3b

Groups

boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
fasterfox
gigabot
heritrix
httrack
huaweisymantecspider
ichiro
irlbot
kalooga
lexxebot
mj12bot
mlbot
msiecrawler
nutch
ocelli
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
shopwiki
snapbot
turnitinbot
twiceler
woozweb-monitoring
woriobot
yacybit
yeti
yodaobot
zeus
zyborg
mj12bot
ahrefsbot
semrushbot
yandexbot
dotbot
baiduspider
httrack
wget
screaming frog seo spider
turnitinbot
blexbot
siteexplorer
jakarta
surveybot
zyborg
emailcollector
spambot
exabot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandex

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

slurp

Rule Path
Allow /

qwantify

Rule Path
Allow /

mozilla/5.0 (compatible; ecosiabot/1.0; +http://ecosia.org)

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.restaurant-annam.com/sitemap.xml
Back to top

Comments

  • Groupe 1 : Robots d'indexation indésirables
  • Groupe 2 : Robots populaires autorisés
  • Googlebot
  • Bingbot
  • Baidu Spider
  • Yandex
  • DuckDuckGo
  • Applebot (utilisé par Siri et Spotlight)
  • Yahoo Slurp
  • Qwant
  • Ecosia
  • Specify your sitemap
Back to top

Warnings

  • 1 invalid line.
Back to top