usama.dev
robots.txt

Robots Exclusion Standard data for usama.dev

Resource Scan

Scan Details

Site Domain usama.dev
Base Domain usama.dev
Scan Status Ok
Last Scan2025-11-22T13:02:31+00:00
Next Scan 2025-11-29T13:02:31+00:00

Last Scan

Scanned2025-11-22T13:02:31+00:00
URL https://usama.dev/robots.txt
Redirect https://www.usama.dev/robots.txt
Redirect Domain www.usama.dev
Redirect Base usama.dev
Domain IPs 209.74.67.60
Redirect IPs 209.74.67.60
Response IP 209.74.67.60
Found Yes
Hash f5d2084630e32671909bfd634edf7cc1bbe098fe1ac64d96950281e3de3e4427
SimHash 7d4818066db1

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /*?add-to-cart=
Disallow /*?*add-to-cart=
Disallow /wp-admin/

Other Records

Field Value
sitemap https://www.usama.dev/sitemap.xml
sitemap https://www.usama.dev/news-sitemap.xml

Warnings

  • 3 invalid lines.
  • `*** this site runs wp super minify plugin v2.0.1 - http` is not a known field.
  • `*** total size saved` is not a known field.