mysteryscience.com
robots.txt
Robots Exclusion Standard data for mysteryscience.com
Resource Scan
Scan Details
| Site Domain | mysteryscience.com |
| Base Domain | mysteryscience.com |
| Scan Status | Ok |
| Last Scan | 2024-05-12T12:13:31+00:00 |
| Next Scan | 2024-06-11T12:13:31+00:00 |
Last Scan
| Scanned | 2024-05-12T12:13:31+00:00 |
| URL | https://mysteryscience.com/robots.txt |
| Domain IPs | 18.205.36.100, 52.204.242.176, 54.157.58.70, 54.162.128.250 |
| Response IP | 52.204.242.176 |
| Found | Yes |
| Hash | dfd9e19806de42ce935de8b845446250db59aa1b4e7a03ee774f8642e053c0a5 |
| SimHash | 005129cde5c5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /print/ |
| Disallow | /usage/ |
| Disallow | /mini-lessons/why-is-the-sky-blue.html |
| Disallow | /mini-lessons/what-is-the-most-dangerous-animal-in-the-world.html |
| Disallow | /mini-lessons/why-do-leaves-change-color-in-the-fall.html |
| Disallow | /start* |
| Disallow | /orders/quotes/new* |
| Disallow | /orders/district_quotes* |
| Disallow | /order/ |
| Disallow | /order |
Comments