geekbite.sg
robots.txt

Robots Exclusion Standard data for geekbite.sg

Resource Scan

Scan Details

Site Domain geekbite.sg
Base Domain geekbite.sg
Scan Status Ok
Last Scan2025-10-05T16:39:59+00:00
Next Scan 2025-11-04T16:39:59+00:00

Last Scan

Scanned2025-10-05T16:39:59+00:00
URL https://geekbite.sg/robots.txt
Redirect https://www.geekbite.sg/robots.txt
Redirect Domain www.geekbite.sg
Redirect Base geekbite.sg
Domain IPs 104.21.96.108, 172.67.177.22, 2606:4700:3031::ac43:b116, 2606:4700:3033::6815:606c
Redirect IPs 104.21.96.108, 172.67.177.22, 2606:4700:3031::ac43:b116, 2606:4700:3033::6815:606c
Response IP 104.21.96.108
Found Yes
Hash dfd95a912ce660641e2b032a69153a30063cd3e9090027db803628d8af95b26f
SimHash 2bd6da7663f1

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /bloomboxguide.html
Disallow /ledgerguide.html
Disallow /kindle-access.html
Disallow /googleguide.html
Disallow /fitbitguide.html
Disallow /gameboxguide.html
Disallow /dl300ebooks.html
Disallow /lazada-access.html
Disallow /review.html
Disallow /submit.html
Disallow /dl8400ebooks.html
Disallow /loudimage.html
Disallow /png.html
Disallow /nyps.html
Disallow /maneuver.html
Disallow /buzzwatch-990638.html
Disallow /testvidbg.html

Other Records

Field Value
sitemap http://www.geekbite.sg/sitemap.xml