starofservice.com.br
robots.txt

Robots Exclusion Standard data for starofservice.com.br

Resource Scan

Scan Details

Site Domain starofservice.com.br
Base Domain starofservice.com.br
Scan Status Ok
Last Scan2024-09-20T08:01:57+00:00
Next Scan 2024-10-20T08:01:57+00:00

Last Scan

Scanned2024-09-20T08:01:57+00:00
URL https://starofservice.com.br/robots.txt
Redirect https://www.starofservice.com.br/robots.txt
Redirect Domain www.starofservice.com.br
Redirect Base starofservice.com.br
Domain IPs 13.35.238.41, 13.35.238.46, 13.35.238.55, 13.35.238.66
Redirect IPs 108.157.254.17, 108.157.254.44, 108.157.254.91, 108.157.254.94
Response IP 108.157.254.17
Found Yes
Hash 12223583cfd79876e48ea47de2fc9903fc4ff7a33422de61e8a7fa600ba22a7f
SimHash 601411448da0

Groups

*

Rule Path
Disallow
Disallow /api*
Disallow /_next/data/*
Disallow /default/frommail/*
Disallow /?login=1
Disallow /validation/validateEmail
Disallow /validation/validatePassword
Disallow /region/ile-de-france
Disallow /region/ile-de-france/
Disallow /offre/faireoffre2*
Disallow /service/find
Disallow /service/evaluer/*
Disallow /service/*
Disallow /specialistes/*
Disallow /pro/recommandations*
Disallow /annuaire/*
Disallow /annonce/*
Disallow /widget/*
Disallow /formgen/*
Disallow /diffuser/*
Disallow /gerer/*
Disallow *?postalCode=*
Disallow *?demikhov=*
Disallow /images/home/*.png
Disallow /images/deal/*.png
Disallow /images/mail/*.jpg
Disallow /images/widgets/*.png
Disallow /inv/*
Disallow /keyword_landing_pages/*
Disallow /service_configurations/*
Disallow /autobid_configs/*
Allow /service/presse
Allow /service/qui-sommes-nous
Allow /service/mentions-legales

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bilbo

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

elefent

Rule Path
Disallow /

elefent/elefent

Rule Path
Disallow /

feosey mohk crawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

karriereatbot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

monetoringbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

netseer

Rule Path
Disallow /

obot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.starofservice.com.br/sitemap.xml