br.bitdegree.org
robots.txt

Robots Exclusion Standard data for br.bitdegree.org

Resource Scan

Scan Details

Site Domain br.bitdegree.org
Base Domain bitdegree.org
Scan Status Ok
Last Scan2026-02-18T17:01:19+00:00
Next Scan 2026-03-04T17:01:19+00:00

Last Scan

Scanned2026-02-18T17:01:19+00:00
URL https://br.bitdegree.org/robots.txt
Domain IPs 172.66.40.154, 172.66.43.102, 2606:4700:3108::ac42:289a, 2606:4700:3108::ac42:2b66
Response IP 172.66.43.102
Found Yes
Hash ec2d21e737eb3cebc8fc9414312f6bb919d8894cd1b1b90889340f37cd38ac8c
SimHash 04054450c053

Groups

ia_archiver
gptbot
meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /courses/api
Disallow /api
Disallow /courses/user
Disallow /courses/certificates/*
Disallow */orders
Disallow */goon/
Disallow /crypto/crypto-compare-widget
Disallow /crypto/trading-view-chart
Disallow /crypto/app/get
Disallow *?domain=
Disallow *?bd_ref=
Disallow /livewire/update

Other Records

Field Value
sitemap https://br.bitdegree.org/sitemaps/br/sitemap.xml
sitemap https://br.bitdegree.org/courses/sitemap.xml