starofservice.pl
robots.txt

Robots Exclusion Standard data for starofservice.pl

Resource Scan

Scan Details

Site Domain starofservice.pl
Base Domain starofservice.pl
Scan Status Ok
Last Scan2024-11-14T19:35:36+00:00
Next Scan 2024-12-14T19:35:36+00:00

Last Scan

Scanned2024-11-14T19:35:36+00:00
URL https://starofservice.pl/robots.txt
Redirect https://www.starofservice.pl/robots.txt
Redirect Domain www.starofservice.pl
Redirect Base starofservice.pl
Domain IPs 108.157.254.17, 108.157.254.44, 108.157.254.91, 108.157.254.94
Redirect IPs 108.157.254.17, 108.157.254.44, 108.157.254.91, 108.157.254.94
Response IP 108.157.254.91
Found Yes
Hash 375f6d7aeb668c1d02ca4a45fd5570ec8285c1e18b0f47aa68134700f5f6ab17
SimHash 221c0145cda0

Groups

*

Rule Path
Allow /service/presse
Allow /service/qui-sommes-nous
Allow /service/mentions-legales
Disallow
Disallow /api*
Disallow /_next/data/*
Disallow /default/frommail/*
Disallow /?login=1
Disallow /validation/validateEmail
Disallow /validation/validatePassword
Disallow /region/ile-de-france
Disallow /region/ile-de-france/
Disallow /offre/faireoffre2*
Disallow /service/find
Disallow /service/evaluer/*
Disallow /service/*
Disallow /specialistes/*
Disallow /pro/recommandations*
Disallow /annuaire/*
Disallow /annonce/*
Disallow /widget/*
Disallow /formgen/*
Disallow /diffuser/*
Disallow /gerer/*
Disallow *?postalCode=*
Disallow *?demikhov=*
Disallow /images/home/*.png
Disallow /images/deal/*.png
Disallow /images/mail/*.jpg
Disallow /images/widgets/*.png
Disallow /inv/*
Disallow /keyword_landing_pages/*
Disallow /service_configurations/*
Disallow /autobid_configs/*
Disallow /businesses/*
Disallow /cities/*
Disallow /customer_categories/*
Disallow /customer_category_keywords/*
Disallow /departments/*
Disallow /pro_profiles/*
Disallow /regions/*
Disallow /services/*
Disallow /work_schedule/*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

amazonbot
applebot
bilbo
blexbot
bytespider
ccbot
crazywebcrawler-spider
dataforseobot
deusu
dotbot
elefent
elefent/elefent
feosey mohk crawler
gptbot
grapeshot
ia_archiver
imagesiftbot
jamesbot
karriereatbot
metajobbot
mj12bot
monetoringbot
msiecrawler
netseer
obot
steeler
timpibot
tineye
vagabondo
eesti rahvusraamatukogu/national library of estonia

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.starofservice.pl/sitemap.xml