begalileo.com
robots.txt
Robots Exclusion Standard data for begalileo.com
Resource Scan
Scan Details
| Site Domain | begalileo.com |
| Base Domain | begalileo.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T07:30:00+00:00 |
| Next Scan | 2024-12-12T07:30:00+00:00 |
Last Scan
| Scanned | 2024-11-12T07:30:00+00:00 |
| URL | https://begalileo.com/robots.txt |
| Domain IPs | 108.156.133.111, 108.156.133.19, 108.156.133.35, 108.156.133.73, 2600:9000:2755:2e00:d:dea:ff40:93a1, 2600:9000:2755:6600:d:dea:ff40:93a1, 2600:9000:2755:8800:d:dea:ff40:93a1, 2600:9000:2755:8e00:d:dea:ff40:93a1, 2600:9000:2755:a400:d:dea:ff40:93a1, 2600:9000:2755:ac00:d:dea:ff40:93a1, 2600:9000:2755:c400:d:dea:ff40:93a1, 2600:9000:2755:ec00:d:dea:ff40:93a1 |
| Response IP | 108.156.133.19 |
| Found | Yes |
| Hash | 39c1d1205dcd8ac5cd7cad350974bb1515dc2fc46424ae9783b6c8b5b104f2c1 |
| SimHash | e96185082990 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /blog/ |
| Disallow | /program/mathbox |
| Disallow | /auth/facebook?user_type=trial |
| Disallow | /auth/google_oauth2?user_type=trial |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.begalileo.com/sitemaps/sitemap-index.xml |
| sitemap | https://www.begalileo.com/sitemaps/blog-sitemap.xml |
| sitemap | https://www.begalileo.com/sitemaps/calculators-sitemap.xml |
| sitemap | https://www.begalileo.com/sitemaps/concepts-sitemap.xml |
| sitemap | https://www.begalileo.com/sitemaps/generic-sitemap.xml |
| sitemap | https://www.begalileo.com/sitemaps/math-games-sitemap.xml |
| sitemap | https://www.begalileo.com/sitemaps/worksheets-sitemap.xml |
Warnings
- 2 invalid lines.