aztinylife.com
robots.txt

Robots Exclusion Standard data for aztinylife.com

Resource Scan

Scan Details

Site Domain aztinylife.com
Base Domain aztinylife.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-22T02:57:26+00:00
Next Scan 2025-11-21T02:57:26+00:00

Last Successful Scan

Scanned2025-07-24T23:53:55+00:00
URL https://aztinylife.com/robots.txt
Domain IPs 2a02:4780:84:28a5:ca6c:fe10:4a21:35d3, 2a02:4780:84:9205:1a91:8d64:d57e:2306, 84.32.84.160, 84.32.84.96
Response IP 91.108.100.226
Found Yes
Hash e67ebded9023000539f0dbde49c09188bf33d59fc3d3a7f282f2332c3cb6ff55
SimHash 4314dc52cb13

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

nutch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://aztinylife.com/sitemap_index.xml

Warnings

  • 1 invalid line.