masterstudies.pl
robots.txt

Robots Exclusion Standard data for masterstudies.pl

Resource Scan

Scan Details

Site Domain masterstudies.pl
Base Domain masterstudies.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-14T13:29:58+00:00
Next Scan 2025-11-28T13:29:58+00:00

Last Successful Scan

Scanned2025-10-05T00:44:46+00:00
URL https://masterstudies.pl/robots.txt
Redirect https://pl.educations.com/robots.txt
Redirect Domain pl.educations.com
Redirect Base educations.com
Domain IPs 104.21.90.69, 172.67.153.177, 2606:4700:3032::6815:5a45, 2606:4700:3036::ac43:99b1
Redirect IPs 65.9.112.48, 65.9.112.64, 65.9.112.67, 65.9.112.70
Response IP 18.244.87.33
Found Yes
Hash c506c181f403adeb0f66aa7513df778d0544dcd933d5118f91420f51b1b171a1
SimHash c554dc40e290

Groups

mj12bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

coccocbot-web/1.0

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

*

Rule Path
Disallow /api/auth
Disallow /api/growthbook

Other Records

Field Value
sitemap https://pl.educations.com/sitemap-index.xml

Warnings

  • `host` is not a known field.