Log In Sign Up

keengas.com
robots.txt

Robots Exclusion Standard data for keengas.com

Resource Scan

Scan Details

Site Domain keengas.com
Base Domain keengas.com
Scan Status Ok
Last Scan2025-10-02T21:04:36+00:00
Next Scan 2025-11-01T21:04:36+00:00

Last Scan

Scanned2025-10-02T21:04:36+00:00
URL https://keengas.com/robots.txt
Redirect https://www.keengas.com/robots.txt
Redirect Domain www.keengas.com
Redirect Base keengas.com
Domain IPs 70.39.233.243
Redirect IPs 3.175.86.120, 3.175.86.45, 3.175.86.76, 3.175.86.88
Response IP 65.9.112.16
Found Yes
Hash 2a89d7dd94fe781dedf15075cdad55824664395aecde95b6990bbb391db97ee0
SimHash 66009830d23a

Groups

mj12bot

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adsbot-google

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$

*

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$

Other Records

Field Value
crawl-delay 10
Back to top