youngspecialties.com
robots.txt

Robots Exclusion Standard data for youngspecialties.com

Resource Scan

Scan Details

Site Domain youngspecialties.com
Base Domain youngspecialties.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-26T18:19:55+00:00
Next Scan 2025-12-25T18:19:55+00:00

Last Successful Scan

Scanned2023-08-15T16:51:58+00:00
URL https://youngspecialties.com/robots.txt
Redirect https://www.youngspecialties.com/robots.txt
Redirect Domain www.youngspecialties.com
Redirect Base youngspecialties.com
Domain IPs 104.26.0.238, 104.26.1.238, 172.67.70.148, 2606:4700:20::681a:1ee, 2606:4700:20::681a:ee, 2606:4700:20::ac43:4694
Redirect IPs 104.26.0.238, 104.26.1.238, 172.67.70.148, 2606:4700:20::681a:1ee, 2606:4700:20::681a:ee, 2606:4700:20::ac43:4694
Response IP 104.26.1.238
Found Yes
Hash ce164a5db92ee40315a5997eb38c7890d0321ca2105007d09da8886cec6017f0
SimHash 8000cba22323

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /customer_pricelists/

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /