rubegoldberg.com
robots.txt

Robots Exclusion Standard data for rubegoldberg.com

Resource Scan

Scan Details

Site Domain rubegoldberg.com
Base Domain rubegoldberg.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-04-01T08:43:36+00:00
Next Scan 2024-06-30T08:43:36+00:00

Last Successful Scan

Scanned2022-11-13T11:02:50+00:00
URL http://rubegoldberg.com/robots.txt
Redirect https://www.rubegoldberg.org/robots.txt
Redirect Domain www.rubegoldberg.org
Redirect Base rubegoldberg.org
Response IP 3.226.182.14, 23.22.5.68, 52.21.227.162, 54.237.159.171
Found Yes
Hash 232c681cafe26850e0e838ef5c6628a84f0574e2c0fc490d9a2456b53a7b78b3
SimHash a4004ac6e3b2

Groups

*

Rule Path
Disallow /private/
Disallow /junk/