byte1ife.com
robots.txt

Robots Exclusion Standard data for byte1ife.com

Resource Scan

Scan Details

Site Domain byte1ife.com
Base Domain byte1ife.com
Scan Status Ok
Last Scan2026-01-11T03:28:10+00:00
Next Scan 2026-01-18T03:28:10+00:00

Last Scan

Scanned2026-01-11T03:28:10+00:00
URL https://byte1ife.com/robots.txt
Redirect https://www.byte1ife.com/robots.txt
Redirect Domain www.byte1ife.com
Redirect Base byte1ife.com
Domain IPs 5.161.212.170
Redirect IPs 5.161.212.170
Response IP 5.161.212.170
Found Yes
Hash e8ea200bab66e994203c8366c1491379fbd0a6a3707726cf1b6cdf819b67d1e0
SimHash 695a5c74cac3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /temp/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

applebot-extended

Rule Path
Disallow /

serankingbacklinksbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10