web4u.li
robots.txt

Robots Exclusion Standard data for web4u.li

Resource Scan

Scan Details

Site Domain web4u.li
Base Domain web4u.li
Scan Status Ok
Last Scan2025-06-06T09:15:00+00:00
Next Scan 2025-06-13T09:15:00+00:00

Last Scan

Scanned2025-06-06T09:15:00+00:00
URL https://web4u.li/robots.txt
Domain IPs 217.26.51.247, 2a00:d70:0:b:2002:0:d91a:33f7
Response IP 217.26.51.247
Found Yes
Hash 894fc9e34260bc523db6f319a9e7984ac5808b258b534c920e4e7c5bff47b9e3
SimHash 6b0888024e83

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://web4u.li/sitemap.xml
sitemap https://web4u.li/sitemap.rss