bwcdd.com
robots.txt

Robots Exclusion Standard data for bwcdd.com

Resource Scan

Scan Details

Site Domain bwcdd.com
Base Domain bwcdd.com
Scan Status Ok
Last Scan2024-08-31T22:21:01+00:00
Next Scan 2024-09-30T22:21:01+00:00

Last Scan

Scanned2024-08-31T22:21:01+00:00
URL https://bwcdd.com/robots.txt
Redirect https://www.bwcdd.com/robots.txt
Redirect Domain www.bwcdd.com
Redirect Base bwcdd.com
Domain IPs 52.32.196.230, 52.70.155.240
Redirect IPs 34.214.250.249, 52.32.196.230
Response IP 52.32.196.230
Found Yes
Hash 6058c528c48cedab6e402b480f5f854b46d7382d0beffb441aad3a7e3a748d2c
SimHash 2b1d82404bb1

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bwcdd.com/sitemap.xml

Comments

  • All other robots allowed
  • Sitemap files