thechelsealaboratory.com
robots.txt

Robots Exclusion Standard data for thechelsealaboratory.com

Resource Scan

Scan Details

Site Domain thechelsealaboratory.com
Base Domain thechelsealaboratory.com
Scan Status Ok
Last Scan2025-08-20T15:27:41+00:00
Next Scan 2025-09-03T15:27:41+00:00

Last Scan

Scanned2025-08-20T15:27:41+00:00
URL https://thechelsealaboratory.com/robots.txt
Domain IPs 104.26.14.179, 104.26.15.179, 172.67.75.65, 2606:4700:20::681a:eb3, 2606:4700:20::681a:fb3, 2606:4700:20::ac43:4b41
Response IP 104.26.14.179
Found Yes
Hash 83d27d0527de5205350bfd4a1133c14a34a4b43d765715a0f99c7c22d6a41d79
SimHash 4a609a204793

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value Comment
crawl-delay 10 Delay all bots by 10 seconds

adsbot-google-mobile

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

applebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

inetdex-bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thechelsealaboratory.com/wp-sitemap.xml

Comments

  • General Rules
  • Block Less Useful Bots
  • Sitemap