admin.bsp-prod.kw.com
robots.txt

Robots Exclusion Standard data for admin.bsp-prod.kw.com

Resource Scan

Scan Details

Site Domain admin.bsp-prod.kw.com
Base Domain kw.com
Scan Status Ok
Last Scan2025-08-23T13:23:58+00:00
Next Scan 2025-09-22T13:23:58+00:00

Last Scan

Scanned2025-08-23T13:23:58+00:00
URL https://admin.bsp-prod.kw.com/robots.txt
Domain IPs 104.18.0.106, 104.18.1.106, 2606:4700::6812:16a, 2606:4700::6812:6a
Response IP 104.18.1.106
Found Yes
Hash dc2f08337f914b83104b1cc09a2e273eec7d4003cc6fd7046411db9500c6056f
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10