supplementler.com
robots.txt

Robots Exclusion Standard data for supplementler.com

Resource Scan

Scan Details

Site Domain supplementler.com
Base Domain supplementler.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-15T04:44:05+00:00
Next Scan 2024-12-14T04:44:05+00:00

Last Successful Scan

Scanned2023-08-13T23:08:30+00:00
URL https://supplementler.com/robots.txt
Redirect https://www.supplementler.com/robots.txt
Redirect Domain www.supplementler.com
Redirect Base supplementler.com
Domain IPs 104.20.132.14, 104.20.133.14, 172.67.18.52, 2606:4700:10::6814:840e, 2606:4700:10::6814:850e, 2606:4700:10::ac43:1234
Redirect IPs 104.20.132.14, 104.20.133.14, 172.67.18.52, 2606:4700:10::6814:840e, 2606:4700:10::6814:850e, 2606:4700:10::ac43:1234
Response IP 172.67.18.52
Found Yes
Hash ad709bc6473d3d7b74808a0e4988f0ff011ce297c112d398b8d198e8907615f2
SimHash 01e64af8463b

Groups

*

Rule Path
Disallow /bin/
Disallow /content/files/
Disallow /install
Disallow /compareproducts
Disallow /clearcomparelist
Disallow /logout
Disallow /cart
Disallow /wishlist
Disallow /emailwishlist
Disallow /checkout
Disallow /onepagecheckout
Disallow /cart
Disallow /checkout/billingaddress
Disallow /checkout/pay
Disallow /checkout/shippingaddress
Disallow /checkout/billingaddress
Disallow /checkout/shippingmethod
Disallow /checkout/paymentmethod
Disallow /checkout/paymentinfo
Disallow /checkout/confirm
Disallow /checkout/completed
Disallow /orderdetails
Disallow /returnrequest
Disallow /passwordrecovery/confirm
Disallow /newsletter/subscriptionactivation
Disallow /customer/activation
Disallow /customer/forumsubscriptions
Disallow /customer/info
Disallow /emailwishlist
Disallow /boards/postedit
Disallow /boards/postdelete
Disallow /boards/postcreate
Disallow /boards/topicedit
Disallow /boards/topicdelete
Disallow /boards/topiccreate
Disallow /boards/topicmove
Disallow /boards/topicwatch
Disallow /boards/forumwatch
Disallow /privatemessages
Disallow /inboxupdate
Disallow /sentupdate
Disallow /sendpm
Disallow /viewpm
Disallow /deletepm
Disallow /cs/
Disallow /markalar/
Disallow /hedefler/
Disallow /sporlar/
Disallow /kampanyalar/
Disallow /urunler/
Disallow /Cache.aspx
Disallow /shop/
Disallow /Catalog/
Disallow /m/
Disallow /*?orderby=*
Disallow /*specs%3D*
Disallow /*?ref=*

etaospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.supplementler.com/sitemapseo