mysleepyhead.com
robots.txt

Robots Exclusion Standard data for mysleepyhead.com

Resource Scan

Scan Details

Site Domain mysleepyhead.com
Base Domain mysleepyhead.com
Scan Status Ok
Last Scan2025-09-13T19:05:51+00:00
Next Scan 2025-10-13T19:05:51+00:00

Last Scan

Scanned2025-09-13T19:05:51+00:00
URL https://mysleepyhead.com/robots.txt
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 151.101.129.124
Found Yes
Hash aea46c7cfa829ed138190df4871f5372fdc0282554faab1c9ed503eeb9aab2ac
SimHash 41203c0ac7fa

Groups

*

Rule Path
Allow /
Disallow /search?amp%3Bq=
Disallow /404?
Disallow /styles/
Disallow /products?
Disallow /noresults?
Disallow /cart
Disallow /account
Disallow /wishlist
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /favorites/
Disallow /wiki-offers/
Disallow /myorders/
Disallow /*SID%3D
Disallow /?utm
Disallow /terms-conditions?page=1
Disallow /warranty-policy?page=1
Disallow /return-policy?page=1
Disallow /about-us?page=1
Disallow /*%3Dmaterial*
Disallow /*amp*
Disallow /*source*
Disallow /?attribute
Disallow /?order
Disallow /?srsltid=AfmB
Disallow /admin
Disallow shipping-return-policy?
Disallow /*size%3D*
Disallow /?ga_action
Disallow /?action=
Disallow /?quantity=
Disallow /sh-login
Disallow /sign-in
Disallow /faq?page=1
Disallow /easyemi-hdfc/?page=1
Disallow /customer-reviews?page=1
Disallow /contact-us?page=1
Disallow /checkout?page=1
Disallow /track-order?page=1
Disallow /instantdiscount-ibd?page=1
Disallow /home-64ba3788c1143?page=1
Disallow /privacy-policy?page=1
Disallow /blog/republic-day-sale?page=1
Disallow /blog/tag/order-online/?page=1

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://mysleepyhead.com/sitemap.xml

Comments

  • Explicit Allow for AI and Search Bots

Warnings

  • 5 invalid lines.