gwclogistics.com
robots.txt

Robots Exclusion Standard data for gwclogistics.com

Resource Scan

Scan Details

Site Domain gwclogistics.com
Base Domain gwclogistics.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-17T00:36:51+00:00
Next Scan 2025-11-15T00:36:51+00:00

Last Successful Scan

Scanned2023-04-07T18:45:01+00:00
URL https://www.gwclogistics.com/robots.txt
Domain IPs 118.214.167.64, 118.214.167.81, 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bde
Response IP 118.214.167.64
Found Yes
Hash 935ccce20534a63bb64ba5ad6909024ef181361aeb28b798448c4e8f90c0432f
SimHash f12448cac192

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-includes/*/*.css
Allow /wp-includes/*/*.js
Disallow /wp-includes/
Disallow /wp-content/cache/
Disallow /wp-content/languages/
Allow /wp-content/plugins/*/*.css
Allow /wp-content/plugins/*/*.js
Disallow /wp-content/plugins/
Disallow /wp-content/upgrade/
Allow /wp-content/themes/*/*.css
Allow /wp-content/themes/*/*.js
Allow /wp-content/themes/*/*.eot
Allow /wp-content/themes/*/*.svg
Allow /wp-content/themes/*/*.ttf
Allow /wp-content/themes/*/*.woff
Allow /wp-content/themes/*/*.woff2
Allow /wp-content/themes/*/*.gif
Allow /wp-content/themes/*/*.jpg
Allow /wp-content/themes/*/*.jpeg
Allow /wp-content/themes/*/*.png
Disallow /wp-content/themes/
Disallow *?replytocom
Disallow /archives/
Disallow /comments/feed/