cdn.sciencebuddies.org
robots.txt

Robots Exclusion Standard data for cdn.sciencebuddies.org

Resource Scan

Scan Details

Site Domain cdn.sciencebuddies.org
Base Domain sciencebuddies.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-02T01:15:43+00:00
Next Scan 2024-05-31T01:15:43+00:00

Last Successful Scan

Scanned2023-07-14T01:00:09+00:00
URL https://cdn.sciencebuddies.org/robots.txt
Redirect https://www.sciencebuddies.org/robots.txt
Redirect Domain www.sciencebuddies.org
Redirect Base sciencebuddies.org
Domain IPs 18.216.42.187
Redirect IPs 18.155.68.16, 18.155.68.31, 18.155.68.50, 18.155.68.75
Response IP 54.230.112.77
Found Yes
Hash a039e9a7b8792120d31b6e3be2c1f80917e0784a31ca63f291d6b178db0fad86
SimHash fa113354bc82

Groups

*

Rule Path
Disallow /science-fair-projects/ask-an-expert/search.php
Disallow /science-fair-projects/ask-an-expert/search
Disallow /search
Disallow /error/
Disallow /store-send
Disallow /track
Disallow /account/login
Disallow /17748645/
Disallow /mt/
Disallow /science-fair-projects/recommender_mark_favorite.php
Disallow /content/pdfs/

Other Records

Field Value
sitemap https://www.sciencebuddies.org/sitemap.xml

Comments

  • AAE
  • Search
  • Error pages
  • Redirects/Passthroughs
  • Other