SYNOPSIS
Expectation Maximisation (EM) assigns a probability distribution to each instance which indicates the probability of it belonging to each of the clusters. EM can decide
how many clusters to create by cross validation, or you may specify apriori how many clusters to generate.
The cross validation performed to determine the number of clusters is done in the following steps:
- The number of clusters is set to 1
- The training set is split randomly into 10 folds.
- EM is performed 10 times using the 10 folds the usual CV way.
- The loglikelihood is averaged over all 10 results.
- If loglikelihood has increased the number of clusters is increased by 1 and the program continues at step 2.
The number of folds is fixed to 10, as long as the number of instances in the training set is not smaller 10. If this is the case the number of folds is set equal to
the number of instances.
OPTIONS
-
displayModelInOldFormat -- Use old format for model output. The old format is better when there are many clusters. The new format is better when there are fewer
clusters and many attributes.
-
maxIterations -- maximum number of iterations
-
minStdDev -- set minimum allowable standard deviation
-
numClusters -- set number of clusters. -1 to select number of clusters automatically by cross validation.