wengers.com
robots.txt

Robots Exclusion Standard data for wengers.com

Resource Scan

Scan Details

Site Domain wengers.com
Base Domain wengers.com
Scan Status Ok
Last Scan2024-10-21T11:09:45+00:00
Next Scan 2024-11-20T11:09:45+00:00

Last Scan

Scanned2024-10-21T11:09:45+00:00
URL https://wengers.com/robots.txt
Redirect https://www.wengers.com/robots.txt
Redirect Domain www.wengers.com
Redirect Base wengers.com
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 159aefa1a2fff8b9f3473df5a49127c4d63daaf61e494201bbb29ef21106088c
SimHash 6415d0004e14

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow *

seekport crawler

Rule Path
Disallow *

*

Rule Path
Disallow /checkout/
Disallow /customer/
Disallow /wengers_panel/