sciencebuddies.org
robots.txt
Robots Exclusion Standard data for sciencebuddies.org
Resource Scan
Scan Details
| Site Domain | sciencebuddies.org |
| Base Domain | sciencebuddies.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-19T06:33:57+00:00 |
| Next Scan | 2024-06-02T06:33:57+00:00 |
Last Successful Scan
| Scanned | 2024-05-04T06:33:16+00:00 |
| URL | https://sciencebuddies.org/robots.txt |
| Redirect | https://www.sciencebuddies.org/robots.txt |
| Redirect Domain | www.sciencebuddies.org |
| Redirect Base | sciencebuddies.org |
| Domain IPs | 18.216.42.187 |
| Redirect IPs | 18.155.68.16, 18.155.68.31, 18.155.68.50, 18.155.68.75 |
| Response IP | 18.155.68.16 |
| Found | Yes |
| Hash | a039e9a7b8792120d31b6e3be2c1f80917e0784a31ca63f291d6b178db0fad86 |
| SimHash | fa113354bc82 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /science-fair-projects/ask-an-expert/search.php |
| Disallow | /science-fair-projects/ask-an-expert/search |
| Disallow | /search |
| Disallow | /error/ |
| Disallow | /store-send |
| Disallow | /track |
| Disallow | /account/login |
| Disallow | /17748645/ |
| Disallow | /mt/ |
| Disallow | /science-fair-projects/recommender_mark_favorite.php |
| Disallow | /content/pdfs/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sciencebuddies.org/sitemap.xml |
Comments