starruby.in
robots.txt

Robots Exclusion Standard data for starruby.in

Resource Scan

Scan Details

Site Domain starruby.in
Base Domain starruby.in
Scan Status Ok
Last Scan2025-11-03T17:37:42+00:00
Next Scan 2025-12-03T17:37:42+00:00

Last Scan

Scanned2025-11-03T17:37:42+00:00
URL https://starruby.in/robots.txt
Domain IPs 104.26.12.111, 104.26.13.111, 172.67.68.126, 2606:4700:20::681a:c6f, 2606:4700:20::681a:d6f, 2606:4700:20::ac43:447e
Response IP 172.67.68.126
Found Yes
Hash 51e53b3ac38330d36008de08f5c81e2f4cc67972bbe113cab98950a70224a1db
SimHash e1316260c6b2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /*zenid%3D
Disallow /dev/
Disallow /staging/

Other Records

Field Value
crawl-delay 100

Other Records

Field Value
sitemap http://www.starruby.in/store/sitemap.xml