sso.cuisineaz.com
robots.txt

Robots Exclusion Standard data for sso.cuisineaz.com

Resource Scan

Scan Details

Site Domain sso.cuisineaz.com
Base Domain cuisineaz.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-02-06T11:24:44+00:00
Next Scan 2025-04-07T11:24:44+00:00

Last Successful Scan

Scanned2024-12-02T07:14:38+00:00
URL https://sso.cuisineaz.com/robots.txt
Domain IPs 2a0a:1580:2000:2e00::25, 89.248.208.228
Response IP 89.248.208.228
Found Yes
Hash 87a3aaf9bd56bdd5da2b5e642b877447f99c7927fef0ab37521514e4e057d6fb
SimHash 731dca720d23

Groups

ahrefsbot

Rule Path
Disallow /

atomic_email_hunter

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bender

Rule Path
Disallow /

birubot

Rule Path
Disallow /

blogpulselive

Rule Path
Disallow /

botw spider

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

docomo

Rule Path
Disallow /

exabot

Rule Path
Disallow /

expo9

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

feedtrace

Rule Path
Disallow /

fairshare

Rule Path
Disallow /

ginxbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

gosospider

Rule Path
Disallow /

knowaboutbot

Rule Path
Disallow /

metauri

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

moreoverbot

Rule Path
Disallow /

mxbot

Rule Path
Disallow /

my6sense

Rule Path
Disallow /

netseer

Rule Path
Disallow /

nhn corp

Rule Path
Disallow /

njuicebot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

oneriot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

percbotspider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

purebot

Rule Path
Disallow /

radian6

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

semiocast

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

summify

Rule Path
Disallow /

tanner

Rule Path
Disallow /

tagoobot

Rule Path
Disallow /

thingfetcher

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tweetedtimes bot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

twingly recon

Rule Path
Disallow /

twitmatic

Rule Path
Disallow /

twitturly

Rule Path
Disallow /

twitturls

Rule Path
Disallow /

typhoeus

Rule Path
Disallow /

viralheat

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

*

Rule Path
Disallow /*?*
Disallow /authentication/
Disallow /facebook/
Disallow /google
Disallow /signin/

Other Records

Field Value
crawl-delay 10

Comments

  • User-agent: *
  • User-agent: DeepCrawl
  • Disallow: /
  • User-agent: Screaming Frog SEO Spider
  • Disallow: /
  • Dynamic URLs