drwilliamli.com
robots.txt

Robots Exclusion Standard data for drwilliamli.com

Resource Scan

Scan Details

Site Domain drwilliamli.com
Base Domain drwilliamli.com
Scan Status Ok
Last Scan2025-06-28T01:35:55+00:00
Next Scan 2025-07-28T01:35:55+00:00

Last Scan

Scanned2025-06-28T01:35:55+00:00
URL https://drwilliamli.com/robots.txt
Domain IPs 192.124.249.108
Response IP 192.124.249.108
Found Yes
Hash 6d90379d19e66e89afc8190e4f4cf258dad49416ad2f9e1e19d5f67a953bca2d
SimHash 3d154844a09b

Groups

*

Rule Path
Disallow

*

Rule Path
Disallow /wp-content/uploads/2019/04/Shopping-Guide_Mobile_Icon.pdf
Disallow /wp-content/uploads/2019/03/5X5X5-Mediterranean-Limited-Ed-2019-min.pdf
Disallow /wp-content/uploads/2019/01/A-Plant-Based-Approach-to-Eating-To-Beat-Disease.pdf

Other Records

Field Value
sitemap http://drwilliamli.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • Block search engines from indexing specific PDF files