Log In Sign Up

alloweekend.com
robots.txt

Robots Exclusion Standard data for alloweekend.com

Resource Scan

Scan Details

Site Domain alloweekend.com
Base Domain alloweekend.com
Scan Status Ok
Last Scan2025-12-28T07:19:17+00:00
Next Scan 2026-01-04T07:19:17+00:00

Last Scan

Scanned2025-12-28T07:19:17+00:00
URL https://alloweekend.com/robots.txt
Domain IPs 213.186.33.87
Response IP 213.186.33.87
Found Yes
Hash 6920bad175950e80fb7d356a06cd716c28f4d91aae442d5b8c678c7f5a0e150a
SimHash 805ed9526d3b

Groups

boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
fasterfox
gigabot
heritrix
httrack
huaweisymantecspider
ichiro
irlbot
kalooga
lexxebot
mj12bot
mlbot
msiecrawler
nutch
ocelli
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
shopwiki
snapbot
turnitinbot
twiceler
woozweb-monitoring
woriobot
yacybit
yeti
yodaobot
zeus
zyborg
mj12bot
ahrefsbot
semrushbot
yandexbot
dotbot
baiduspider
httrack
wget
screaming frog seo spider
turnitinbot
blexbot
siteexplorer
jakarta
surveybot
zyborg
emailcollector
spambot
exabot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandex

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

slurp

Rule Path
Allow /

qwantify

Rule Path
Allow /

mozilla/5.0 (compatible; ecosiabot/1.0; +http://ecosia.org)

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.alloweekend.com/sitemap_index.xml
Back to top

Comments

  • Groupe 1 : Robots d'indexation indésirables
  • Groupe 2 : Robots populaires autorisés
  • Googlebot
  • Bingbot
  • Baidu Spider
  • Yandex
  • DuckDuckGo
  • Applebot (utilisé par Siri et Spotlight)
  • Yahoo Slurp
  • Qwant
  • Ecosia
  • Specify your sitemap
Back to top

Warnings

  • 1 invalid line.
Back to top