rashidayn.com
robots.txt

Robots Exclusion Standard data for rashidayn.com

Resource Scan

Scan Details

Site Domain rashidayn.com
Base Domain rashidayn.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-30T12:24:10+00:00
Next Scan 2025-04-30T12:24:10+00:00

Last Successful Scan

Scanned2023-06-18T11:15:10+00:00
URL https://rashidayn.com/robots.txt
Redirect https://www.rashidayn.com/robots.txt
Redirect Domain www.rashidayn.com
Redirect Base rashidayn.com
Domain IPs 104.21.11.132, 172.67.149.62, 2606:4700:3030::ac43:953e, 2606:4700:3036::6815:b84
Redirect IPs 104.21.11.132, 172.67.149.62, 2606:4700:3030::ac43:953e, 2606:4700:3036::6815:b84
Response IP 104.21.11.132
Found Yes
Hash 4b45ca0eb37c705c3c44c39d6a8e548739a41c5b7b3f138ee00fa6544b68fcc2
SimHash 485c69a24752

Groups

*

Rule Path
Disallow /*?sort
Disallow /*?route=checkout%2F
Disallow /*?route=account%2F
Disallow /*?route=product%2F
Disallow /*?page=1
Disallow /*%26create%3D1
Disallow /*?route=information%2F*
Disallow /*?route=*
Disallow /*?route=product%2Fproduct*&manufacturer_id=
Disallow /*?route=account%2Freturn%2Fadd
Disallow /*?route=information%2Fcontact
Disallow /admin/
Disallow /system/
Disallow /.well-known/
Disallow /cgi-bin/
Disallow /privacy.html
Disallow /gv_faq.html
Disallow /shippinginfo.html
Disallow /conditions.html
Disallow /about_us.html
Disallow /about_us
Disallow /frequently_asked_questions.html
Disallow /contact_us.html
Disallow /contact
Disallow /shopping_cart.html
Disallow /account.html
Disallow /privacy-policy
Disallow /create_account.html
Disallow /discount_coupon.html
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Allow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/

googlebot-image

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Disallow /.well-known/
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.rashidayn.com/site_map.xml

Warnings

  • 1 invalid line.