bitdegree.org
robots.txt
Robots Exclusion Standard data for bitdegree.org
Resource Scan
Scan Details
| Site Domain | bitdegree.org |
| Base Domain | bitdegree.org |
| Scan Status | Ok |
| Last Scan | 2024-06-04T22:27:13+00:00 |
| Next Scan | 2024-06-18T22:27:13+00:00 |
Last Scan
| Scanned | 2024-06-04T22:27:13+00:00 |
| URL | https://bitdegree.org/robots.txt |
| Redirect | https://www.bitdegree.org/robots.txt |
| Redirect Domain | www.bitdegree.org |
| Redirect Base | bitdegree.org |
| Domain IPs | 104.26.2.80, 104.26.3.80, 172.67.69.161, 2606:4700:20::681a:250, 2606:4700:20::681a:350, 2606:4700:20::ac43:45a1 |
| Redirect IPs | 104.26.2.80, 104.26.3.80, 172.67.69.161, 2606:4700:20::681a:250, 2606:4700:20::681a:350, 2606:4700:20::ac43:45a1 |
| Response IP | 172.67.69.161 |
| Found | Yes |
| Hash | 55114e98e3c612eda1c67847f9ff648aeb692193a06b61e1a275010f2d8e96a9 |
| SimHash | 681544f2d1f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /courses/api |
| Disallow | /courses/user |
| Disallow | */orders |
| Disallow | */goon/ |
| Disallow | /learn/livesearch.php |
| Disallow | /learn/sse_demo.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bitdegree.org/sitemaps/en/sitemap.xml |
| sitemap | https://www.bitdegree.org/online-learning-platforms/sitemap.xml |
| sitemap | https://www.bitdegree.org/online-learning-platforms/sitemap-comparisons.xml |
| sitemap | https://www.bitdegree.org/courses/sitemap.xml |
| sitemap | https://www.bitdegree.org/learn/sitemap.xml |