bitby.live
robots.txt

Robots Exclusion Standard data for bitby.live

Resource Scan

Scan Details

Site Domain bitby.live
Base Domain bitby.live
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-04T12:55:46+00:00
Next Scan 2025-12-03T12:55:46+00:00

Last Successful Scan

Scanned2025-04-15T11:58:35+00:00
URL https://bitby.live/robots.txt
Domain IPs 104.21.20.95, 172.67.192.12, 2606:4700:3035::6815:145f, 2606:4700:3035::ac43:c00c
Response IP 172.67.192.12
Found Yes
Hash 03b6e772775448bcc565c30396c23e7005fb46985e3d2f08e980c89ed94b1627
SimHash 6c15dd157793

Groups

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://bitby.live/sitemap.xml