thesadowl.com
robots.txt

Robots Exclusion Standard data for thesadowl.com

Resource Scan

Scan Details

Site Domain thesadowl.com
Base Domain thesadowl.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-08T04:35:42+00:00
Next Scan 2025-10-06T04:35:42+00:00

Last Successful Scan

Scanned2023-02-26T06:25:52+00:00
URL https://thesadowl.com/robots.txt
Redirect https://www.thesadowl.com/robots.txt
Redirect Domain www.thesadowl.com
Redirect Base thesadowl.com
Domain IPs 104.21.36.3, 172.67.182.148, 2606:4700:3033::ac43:b694, 2606:4700:3037::6815:2403
Redirect IPs 104.21.36.3, 172.67.182.148, 2606:4700:3033::ac43:b694, 2606:4700:3037::6815:2403
Response IP 104.21.36.3
Found Yes
Hash 00b222e8adaddabc64eeb96b12863a8ca6843adc66f7573c68beea0e8d65e2c5
SimHash 4c5ce9825756

Groups

*

Rule Path
Disallow /*?sort
Disallow /*?route=checkout%2F
Disallow /*?route=account%2F
Disallow /*?route=product%2F
Disallow /*?page=1
Disallow /*%26create%3D1
Disallow /*?route=information%2F*
Disallow /*?route=*
Disallow /*?route=product%2Fproduct*&manufacturer_id=
Disallow /*?route=account%2Freturn%2Fadd
Disallow /*?route=information%2Fcontact
Disallow /CPDnjM0Y/
Disallow /admin/
Disallow /system/
Disallow /.well-known/
Disallow /cgi-bin/
Disallow /privacy.html
Disallow /gv_faq.html
Disallow /shippinginfo.html
Disallow /conditions.html
Disallow /about_us.html
Disallow /about_us
Disallow /frequently_asked_questions.html
Disallow /contact_us.html
Disallow /contact
Disallow /shopping_cart.html
Disallow /account.html
Disallow /privacy-policy
Disallow /create_account.html
Disallow /discount_coupon.html
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Allow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin/
Disallow /CPDnjM0Y/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/

googlebot-image

Rule Path
Disallow /admin/
Disallow /CPDnjM0Y/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Disallow /.well-known/
Disallow /cgi-bin/

Warnings

  • 1 invalid line.