begalileo.com
robots.txt
Robots Exclusion Standard data for begalileo.com
Resource Scan
Scan Details
Site Domain | begalileo.com |
Base Domain | begalileo.com |
Scan Status | Ok |
Last Scan | 2024-09-13T00:24:01+00:00 |
Next Scan | 2024-10-13T00:24:01+00:00 |
Last Scan
Scanned | 2024-09-13T00:24:01+00:00 |
URL | https://begalileo.com/robots.txt |
Domain IPs | 108.156.133.111, 108.156.133.19, 108.156.133.35, 108.156.133.73, 2600:9000:2755:7200:d:dea:ff40:93a1, 2600:9000:2755:7400:d:dea:ff40:93a1, 2600:9000:2755:800:d:dea:ff40:93a1, 2600:9000:2755:9200:d:dea:ff40:93a1, 2600:9000:2755:9c00:d:dea:ff40:93a1, 2600:9000:2755:a800:d:dea:ff40:93a1, 2600:9000:2755:b400:d:dea:ff40:93a1, 2600:9000:2755:c200:d:dea:ff40:93a1 |
Response IP | 108.156.133.111 |
Found | Yes |
Hash | 39c1d1205dcd8ac5cd7cad350974bb1515dc2fc46424ae9783b6c8b5b104f2c1 |
SimHash | e96185082990 |
Groups
*
Rule | Path |
---|---|
Disallow | /blog/ |
Disallow | /program/mathbox |
Disallow | /auth/facebook?user_type=trial |
Disallow | /auth/google_oauth2?user_type=trial |
Other Records
Field | Value |
---|---|
sitemap | https://www.begalileo.com/sitemaps/sitemap-index.xml |
sitemap | https://www.begalileo.com/sitemaps/blog-sitemap.xml |
sitemap | https://www.begalileo.com/sitemaps/calculators-sitemap.xml |
sitemap | https://www.begalileo.com/sitemaps/concepts-sitemap.xml |
sitemap | https://www.begalileo.com/sitemaps/generic-sitemap.xml |
sitemap | https://www.begalileo.com/sitemaps/math-games-sitemap.xml |
sitemap | https://www.begalileo.com/sitemaps/worksheets-sitemap.xml |
Warnings
- 2 invalid lines.