lwphomepro.com
robots.txt

Robots Exclusion Standard data for lwphomepro.com

Resource Scan

Scan Details

Site Domain lwphomepro.com
Base Domain lwphomepro.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-22T16:35:17+00:00
Next Scan 2025-07-06T16:35:17+00:00

Last Successful Scan

Scanned2025-05-15T16:34:20+00:00
URL https://lwphomepro.com/robots.txt
Domain IPs 104.21.15.103, 172.67.162.42, 2606:4700:3030::6815:f67, 2606:4700:3032::ac43:a22a
Response IP 104.21.15.103
Found Yes
Hash 471db6cd0fbd8aad4a8a1b075fea7ceee19370f8f96bdfb35515ff46a1d556fe
SimHash 0f149e43d592

Groups

*

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /shoppingcart
Disallow /checkout
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

adsbot-google

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /checkout
Disallow /shoppingcart
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /shoppingcart
Disallow /checkout
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /shoppingcart
Disallow /checkout
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap /sitemap.xml
sitemap /sitemap.xml
sitemap /sitemap.xml
sitemap /sitemap.xml

Comments

  • This is Rencommerce platform
  • Google adsbot ignores robots.txt unless specifically named!