begalileo.com
robots.txt

Robots Exclusion Standard data for begalileo.com

Resource Scan

Scan Details

Site Domain begalileo.com
Base Domain begalileo.com
Scan Status Ok
Last Scan2024-09-13T00:24:01+00:00
Next Scan 2024-10-13T00:24:01+00:00

Last Scan

Scanned2024-09-13T00:24:01+00:00
URL https://begalileo.com/robots.txt
Domain IPs 108.156.133.111, 108.156.133.19, 108.156.133.35, 108.156.133.73, 2600:9000:2755:7200:d:dea:ff40:93a1, 2600:9000:2755:7400:d:dea:ff40:93a1, 2600:9000:2755:800:d:dea:ff40:93a1, 2600:9000:2755:9200:d:dea:ff40:93a1, 2600:9000:2755:9c00:d:dea:ff40:93a1, 2600:9000:2755:a800:d:dea:ff40:93a1, 2600:9000:2755:b400:d:dea:ff40:93a1, 2600:9000:2755:c200:d:dea:ff40:93a1
Response IP 108.156.133.111
Found Yes
Hash 39c1d1205dcd8ac5cd7cad350974bb1515dc2fc46424ae9783b6c8b5b104f2c1
SimHash e96185082990

Groups

*

Rule Path
Disallow /blog/
Disallow /program/mathbox
Disallow /auth/facebook?user_type=trial
Disallow /auth/google_oauth2?user_type=trial

Other Records

Field Value
sitemap https://www.begalileo.com/sitemaps/sitemap-index.xml
sitemap https://www.begalileo.com/sitemaps/blog-sitemap.xml
sitemap https://www.begalileo.com/sitemaps/calculators-sitemap.xml
sitemap https://www.begalileo.com/sitemaps/concepts-sitemap.xml
sitemap https://www.begalileo.com/sitemaps/generic-sitemap.xml
sitemap https://www.begalileo.com/sitemaps/math-games-sitemap.xml
sitemap https://www.begalileo.com/sitemaps/worksheets-sitemap.xml

Warnings

  • 2 invalid lines.