semperlite.com
robots.txt

Robots Exclusion Standard data for semperlite.com

Resource Scan

Scan Details

Site Domain semperlite.com
Base Domain semperlite.com
Scan Status Ok
Last Scan2025-09-02T00:10:04+00:00
Next Scan 2025-09-09T00:10:04+00:00

Last Scan

Scanned2025-09-02T00:10:04+00:00
URL https://semperlite.com/robots.txt
Domain IPs 104.21.13.132, 172.67.132.214, 2606:4700:3030::ac43:84d6, 2606:4700:3033::6815:d84
Response IP 104.21.13.132
Found Yes
Hash 87bbe37425ace00f50e97d7491690963c9a9cf4d1edb0051c4d2f1c9a145675f
SimHash 71152954cb82

Groups

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

*

Rule Path
Disallow /Admin/
Disallow /App_Browser/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /Config/
Disallow /Controls/
Disallow /DesktopModules/
Disallow /Documentation/
Disallow /fullThread.aspx
Disallow /Install/
Disallow /mesRead.aspx
Disallow /Providers/
Disallow /Resources/
Disallow /showHTMLReceipt.aspx
Disallow /showproductimage.aspx
Disallow /ajaxproductchoices.aspx
Disallow /ajaxproductinfo.aspx
Disallow /ajaxproductpromote.aspx
Disallow /ajaxproductquickview.aspx
Disallow /ajaxsearchresult.aspx
Disallow /ajaxsearchresultproducts.aspx
Disallow /showarticleimage.aspx
Disallow /showbrandimage.aspx
Disallow /showcategoryimage.aspx
Disallow /showshippinglabel.aspx
Disallow /showattachment.aspx
Disallow /ajaxnewsletterregister.aspx
Disallow /ajaxaddtocart.aspx
Disallow /ajaxloginbox.aspx
Disallow /mimg.aspx
Disallow /fonts.aspx