automasterly.com
robots.txt

Robots Exclusion Standard data for automasterly.com

Resource Scan

Scan Details

Site Domain automasterly.com
Base Domain automasterly.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-11T16:28:34+00:00
Next Scan 2025-07-18T16:28:34+00:00

Last Successful Scan

Scanned2025-06-10T16:27:34+00:00
URL https://automasterly.com/robots.txt
Domain IPs 45.41.235.33
Response IP 45.41.235.33
Found Yes
Hash 49dbcfadbb7849b561966ddd52500acf8e62a1b12c20995dd24510330f7db950
SimHash 6558c4c4c595

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30