Shannon Entropy
X(i) = 0 1 1 1 1 1 1 0 0 0
Y(j) = 0 0 0 1 1 0 0 1 1 1
H(X) = - 4/10 log 4/10 - 6/10 log 6/10 = 0.97
H(Y) = - 5/10 log 5/20 - 5/10 log 5/10 = 1
UPR High Performance Computing facility - PO Box 23334 - San Juan PR 00931-3334
E-mail : humberto@hpcf.upr.edu - Telephone : (787) 758-3054 - Fax : (787) 758-3058
- 15 -
![[Previous]](../images/prev.png){kind=small}
![[Next]](../images/next.png){kind=small}
UPR High Performance Computing facility - PO Box 23334 - San Juan PR 00931-3334
X(i) = 0 1 1 1 1 1 1 0 0 0