- Research
- Open Open Peer Review
- Published:

# A Normalized Tree Index for identification of correlated clinical parameters in microarray experiments

*BioData Mining***volume 4**, Article number: 2 (2011)

## Abstract

### Background

Measurements on gene level are widely used to gain new insights in complex diseases e.g. cancer. A promising approach to understand basic biological mechanisms is to combine gene expression profiles and classical clinical parameters. However, the computation of a correlation coefficient between high-dimensional data and such parameters is not covered by traditional statistical methods.

### Methods

We propose a novel index, the Normalized Tree Index (NTI), to compute a correlation coefficient between the clustering result of high-dimensional microarray data and nominal clinical parameters. The NTI detects correlations between hierarchically clustered microarray data and nominal clinical parameters (labels) and gives a measurement of significance in terms of an empiric *p*-value of the identified correlations. Therefore, the microarray data is clustered by hierarchical agglomerative clustering using standard settings. In a second step, the computed cluster tree is evaluated. For each label, a NTI is computed measuring the correlation between that label and the clustered microarray data.

### Results

The NTI successfully identifies correlated clinical parameters at different levels of significance when applied on two real-world microarray breast cancer data sets. Some of the identified highly correlated labels confirm the actual state of knowledge whereas others help to identify new risk factors and provide a good basis to formulate new hypothesis.

### Conclusions

The NTI is a valuable tool in the domain of biomedical data analysis. It allows the identification of correlations between high-dimensional data and nominal labels, while at the same time a *p*-value measures the level of significance of the detected correlations.

## Background

Hierarchical agglomerative clustering is the basis for most visual data mining tasks in microarray applications [1–3]. Compared to non-hierarchical cluster algorithms, it has the advantage that the number of clusters does not have to be specified in advance. This property is of utmost importance since the number of clusters is usually unknown making a precise a priori prediction of the number of clusters impossible. A second reason for the frequent application of hierarchical agglomerative clustering is its visualization ability [4]. The intrinsic hierarchical cluster structure of the data becomes visually accessible at once in the computed cluster tree. The visualization ability of computed cluster trees is especially valuable to analyze complex biomedical data, consisting of *primary data* and *secondary data*. The primary data is obtained in the main experiment whereas the secondary data includes all supplementary data about the analyzed subjects. In the context of gene expression analysis, the primary data is the gene expression data from the microarray experiments. The corresponding secondary data consists of clinical data, disease outcome, information about the applied treatments and therapies, as well as gene annotations. It is common practice to visualize the computed cluster tree in combination with the clustered microarray data (the primary data) and the secondary data available for the clustered samples (Figure 1).

Microarray technology is currently entering the field of medicine [5, 6]. In order to identify molecular factors for macroscopic observations and diseases, recent medical studies often incorporate both gene expression data as well as a high number of clinical parameters [7]. Most mechanisms for development and proliferation of complex diseases (e.g., cancer) are still unknown. It is supposed that many new insights into the mechanisms of diseases can be obtained when the microarray data (primary data) is analyzed in combination with the clinical data (secondary data) consisting of master data, vital data, laboratory data and outcomes (with respect to diseases of interest) that is available for each subject. In few cases, a single gene directly determines the macroscopic phenotype (e.g., eye color). However, most macroscopic phenotypes originate from a set of genes, denoted as gene profiles or metagenes [8]. Clinical data can be considered as a set of observations on the phenotypic level. There are observations on the molecular level (e.g., protein expression), macroscopic observations (e.g., skin color, tumor size, outcome) as well as behavioral observations (e.g., nutrition, alcohol consumption, sport). One issue of interest to the researcher is the identification of clinical parameters (labels) that are correlated with the microarray data. A high correlation between a label and the microarray data indicates that there might be a common underlying mechanism or pathway. This provides a good basis to formulate new hypothesis and to obtain new insights into the complex mechanisms of diseases.

The visual inspection of cluster trees allows the estimation of the correlation between the label and the clustered microarray data. However, this approach becomes infeasible for studies with large numbers of samples and a high number of different labels. Furthermore, the number of labels available for each subject is continuously increasing, since hospital information systems store large amounts of laboratory and vital data as well as radiological and microbiological findings in huge databases [9]. Therefore, an automated and objective computation of the correlation between labels and microarray data is needed to identify correlated clinical parameters.

The canonical way to compute the correlation between a label and the microarray data is to compute the correlation between the label (first variable) and every single gene (second variable), and to combine the results in a final correlation coefficient. Depending on the type of variables, statistics provides various methods to compute the correlation between two variables. For interval data, Pearson's correlation coefficient *r*[10] computes the correlation between two variables whereas each variable is normalized to zero mean and unit variance beforehand. For ordinal data, the correlation between two variables can be computed using Spearman's rank correlation coefficient *ρ*[11]. This robust measure can even be applied on small sample sizes, but it requires that the original data of any two successive ranks has to be approximately equidistant. In cases where this can not be assumed, Kendall's *τ*[12] should be used instead. For nominal data, the chi-square test, Pearson's contingency coefficient, or the corrected contingency coefficient measure the correlation between any two variables [11].

A major drawback of the different correlation and contingency coefficients is that they can only be used to compute the correlation between a label and a single gene. Information contained in metagenes or gene profiles cannot be assessed this way. Thus, a direct computation of the correlation between a label and single genes in order to identify correlated labels does not capture the major trend of information hidden in the data. Microarray data rather has to be considered in its entirety, and an analysis always has to be done in an holistic way.

In this paper, we propose a novel index, the Normalized Tree Index (NTI), which is an extension of the Tree Index (TI) proposed in [13]. The NTI computes a correlation coefficient between the clustering result (tree structure) of high-dimensional primary data (here: microarray data) and associated nominal labels of secondary data (here: clinical parameters). Due to a normalization procedure it is bounded by [0, 1]. A high NTI indicates a high correlation between the label and the clustered data and vice versa.

Furthermore, an empirical *p*-value is derived which measures the level of significance of the detected correlations between labels and clustered microarray data. In a first step, the microarray data is clustered by hierarchical agglomerative clustering using standard settings (Figure 2). Thereby, the complete microarray data is taken into account. In a second step, the computed cluster tree is evaluated using the NTI. For each label, one NTI is computed measuring the correlation between that label and the clustered microarray data. By this approach the microarray data is considered in its entirety and labels that are correlated with the microarray data can be identified. The NTI extends the TI in many respects: First, the normalization procedure increases the interpretability of the correlation result considerably. The TI has been biased with respect to the number of classes of the label, the number of elements of each class, and the number of missing values. This unwanted feature prevents an objective correlation analysis with different labels whose number of classes vary. Second, the computation of the *p*-value: The *p*-value is a valuable parameter for the biomedical researcher since it measures the level of significance of any detected correlation. Both the normalization and the *p*-value enables us to automatically detect correlations between clustered genomic data (primary data) and many different clinical parameters (secondary data). Thus, the scope of this paper is far beyond that of [13], which was to improve the clustering process for one fixed clinical parameter by detecting the most appropriate parametric setting to obtain the best clustering result. In this paper, we aim to discover new relationships between genomic data and macroscopic observations. We rather focus on knowledge discovery in data bases (KDD) than on a pure data mining task.

The NTI is successfully applied on two breast cancer data sets to compute correlations between microarray data and clinical data. Some of the identified highly correlated labels confirm the actual state of knowledge in breast cancer research (i.e. progesterone IHC, estrogen IHC). Others are helpful to identify new risk factors and provide a good basis to formulate new hypothesis and to obtain new insights into the complex mechanisms and pathways of diseases.

## Methods

Cluster indices are cluster validation techniques that provide an objective measure of a clustering result. They can be grouped into *internal* and *external* ones [14–16]. Internal cluster indices evaluate the quality of a clustering result by using only intrinsic information of the data. In contrast to that, external cluster indices permit an entirely objective evaluation by making use of the knowledge of an external class label, denoted as *label* in the following. The Tree Index (TI) is an external cluster index for cluster trees [13]. It is used to identify the algorithm and parameterization yielding the clustering that is best suited for visualization. However, the TI has the drawback that it is biased with respect to the number of classes of the label, the number of elements of each class, and the number of missing values. This unwanted feature prevents an objective correlation analysis with different labels whose number of classes vary. To overcome this problem, an extension to the TI, the Normalized Tree Index (NTI), is developed. The Normalized Tree Index (NTI) computes a normalized correlation coefficient between hierarchically clustered primary data (microarray data) and nominal labels of secondary data (clinical parameters). Furthermore, a *p*-value is derived that measures the level of significance of the detected correlation between labels and clustered data. The NTI and the corresponding *p*-value are computed for each label of the secondary data.

### The Tree Index (TI)

Let the primary data be a dataset $\mathcal{X}$ of *d* samples of length *g*: $\mathcal{X}$ = {**x**
_{1}, ..., **x** _{
i
}, ..., **x** _{
d
}}, length (**x** _{
i
}) = *g*. In the context of microarray data analysis, $\mathcal{X}$ can be a preprocessed microarray data set with *d* tissue samples and *g* genes. A label **c** (dim (*c*) = *d*) is selected from the secondary data for correlation analysis (e.g., grading), with ${c}_{i}\in \{{\mathcal{C}}_{1},\mathrm{....},{\mathcal{C}}_{k}\}$, *i* = 1, ..., *d* and *κ* the number of classes (e.g., the number of gradings). Let $\mathcal{X}$ be clustered by hierarchical agglomerative clustering. After the clustering, the TI is computed for each label on the resulting cluster tree.

The *Tree Index* *(TI)* considers the cluster tree as a result of a statistical splitting process. It is based on the evaluation of probabilities of every single split in the tree starting from the root (i.e. the entire dataset is one cluster). In a first step, a *splitting score* is computed for every single split in the tree based on the probability of the split. In a second step, all splitting scores are combined to compute the final TI.

*Step 1* Let the cluster of the *r*-th split (the splits are numbered arbitrarily) contain *N* elements. Let the cluster be split into *l* (usually *l* = 2) smaller subclusters. The elements of the main cluster belong to *κ* different categories whereas *n*
_{λ}, λ ∈ {1, ..., *κ*} specifies the number of elements belonging to class ${\mathcal{C}}_{\lambda}$. The *i*-th subcluster contains *m*
_{
i
} elements with *m*
_{
iλ
}elements belonging to class ${\mathcal{C}}_{\lambda}$. The primary objective is to compute the probability of such a particular split by taking the observed class distributions in the clusters into account. It is assumed that *m*
_{
i,}
*i* ∈ {1, ..., *l*} elements are drawn from the *N* elements by sampling without replacement. Thereby each element is drawn with the same probability. The probability of the observed class distribution in the splitted clusters is given by a generalized form of the *polyhypergeometric distribution* or *multivariate hypergeometric distribution*[17]. Let **M** = {*m*
_{
iλ
}}, **n** = {*n*
_{λ}}, and **m** = {*m*
_{
i
} } with 1 ≤ *i ≤ l* and 1 ≤ λ *≤ κ*.

*p*(**M**; *N*, **n**, **m**) decreases with the size of the cluster that is split and with the homogeneity of the subclusters. The splitting score *S*
_{
r
} of the *r*-th split is defined by its negative logarithmic probability.

*Step 2* The TI combines the complete set of splitting scores to a parameter-free index by computing the standard deviation of splitting scores:

and *R* being the number of splits in the cluster tree. The higher the index for a given label, the higher the correlation between that label and the clustered primary data (Figure 3). As stated earlier in this section, the TI is biased with respect to the number of classes of the label. If the number of classes of the label increases, the TI also increases. This is due to the fact, that *p*(**M**; *N*, **n**, **m**) decreases if the number of classes and thus the number of possible class distributions increases. This leads to higher splitting scores and thus a higher TI. For a more detailed description of the TI, please refer to [13].

### The Normalized Tree Index (NTI)

The Normalized Tree Index (NTI) computes a normalized correlation coefficient between nominal parameters and hierarchically clustered data. In order to avoid biases with respect to the number of classes and the distribution of cluster sizes [14, 15], the TI is normalized as suggested in [15]. It should be noted that this normalization procedure does not lead to an unbiased correlation coefficient in a strong statistical sense. The distribution of the TI for different number of classes and cluster sizes is not taken into account. After the normalization, the expectation *E*[NTI] is still unknown. We propose to empirically calculate TI_{min} and (TI_{max}) for each considered label by using a Monte Carlo simulation (Figure 4):

To compute TI_{min}, the labels are permuted *r* ≥ 10000 times (Figure 4b), whereas the cluster tree remains unchanged. For each randomly permuted label and each random cluster tree, a TI is computed. The lowest TI is an empirical estimation for TI_{min}.

To compute TI_{max}, *r* ≥ 10000 ordered labels and ordered cluster trees are generated (Figure 4c). An ordered cluster tree consists of *κ* pure subtrees, each one containing all items belonging to one class. The internal structure of each pure subtree is of no importance and is chosen arbitrary. Based on the *κ* pure subtrees, the ordered tree is constructed by merging two randomly selected subtrees in *κ* - 1 agglomerative steps. The ordered label is constructed respectively. For each ordered label and each ordered cluster tree, a TI is computed. The highest TI is an empirical estimation for TI_{max}. With the estimations for TI_{min} and TI_{max}, the NTI is defined by

The NTI is bounded by [0, 1]. However, the empirical computation of TI_{min} and TI_{max} implies that there might be a TI < TI_{min} or a TI > TI_{max}. In such a case, the NTI should be set to 0 or 1, respectively. To reduce the probability for such events, *r* should be set sufficiently large.

A high NTI indicates a high correlation between the label and the clustered data and vice versa.

### Computation of *p*-value

Natural fluctuation in the data can lead to constellations in which the clustered data seems to be correlated with external labels, but in fact the correlation has occurred by chance. The computation of a *p*-value allows the detection of such false identifications of correlations. This approach has already been successfully applied for the biological homogeneity index (BHI) and the biological stability index (BSI) [18].

Let *H*
_{0} be the null hypothesis that there is no correlation between the microarray data and a clinical parameter. A *p*-value lower than a significance level of 5%, 1%, or 0.1% means a rejection of *H*
_{0}. The *p*-value can either be derived analytically or empirically. Here, a Monte Carlo simulation is used to compute an empirical *p*-value for the TI and NTI. For simplicity, the computation of the *p*-value is derived for the TI.

Let *t* be the TI of the tree obtained by a hierarchical cluster algorithm (e.g., hierarchical agglomerative clustering). The empirical *p*-value is defined by the fraction of TIs obtained from trees with randomly permuted labels (Figure 4b) that is equal or higher than *t* (Figure 5):

For practical use, *p* can be approximated by

with *t*
_{
i
} being the TI of the clustered tree with the *i*-th randomly permuted label. A *p* ≥ 0.05 means that *H*
_{0} (no correlation) cannot be rejected. A *p* < 0.05 (0.01, 0.001) means that the rejection of *H*
_{0} is statistically significant at the 5% (1%, 0.1%) level. The number *r* of randomly permuted labels has to be sufficiently large to obtain a statistical significant rejection of *H*
_{0} at the 5% (1%, 0.1%) level. *r* > 1000 random trees are required to theoretically achieve a statistical significant rejection of *H*
_{0} at the 0.1% level. Therefore consider the extreme example that *r* random trees are computed and that each *t*
_{
i
} is lower than *t*. This results in the empirical *p*-value of 1/*r*. Thus, *r* > 1000 random trees are required to achieve a *p*-value of less than 0.001 and a rejection of *H*
_{0} at the 0.1% level.

There is no need to use random trees instead of the clustered tree when computing the *p-* value. If random trees *and* randomly permuted labels were used, two variables would be randomized at the same time. This would lead to an artificially inflated search space. With the computation of the *p*-value, we measure the significance of the correlation between the clustering and the categorical clinical classes. The intention is not to determine if there is both a significant correlation between the clustering and the categorical clinical classes *and* a significant clustering.

The *p*-value is not altered by the normalization. It is equal for the TI and the NTI. This is due to the fact that the tree indices are only shifted and scaled in Equation 4. Thereby, the fraction of *t*
_{
i
} > *t* remains unchanged.

*Example* Let us assume that hierarchical agglomerative clustering of some primary data leads to a TI of *t* = 0.688 (Figure 5). Let us further assume that the Monte Carlo simulation reveals that 18.46% of TIs obtained from ordered cluster trees and randomly permuted labels are higher than *t*. The resulting *p*-value of 0.1846 indicates that *H*
_{0} (no correlation) cannot be rejected at the 5% level of significance.

## Results

The NTI and *p*-value is applied on two microarray breast cancer data sets. The first data set is the breast cancer data set of van de Vijver [19] (downloadable at [20]), which is an extension to the study of van't Veer [7]. For each of the 295 subjects, 24496 genes are analyzed and six nominal clinical parameters are available (Table 1). The clustering of subjects is performed on logarithms of a set of 231 marker genes (identified in [7]). The second data set is a preliminary data set taken from the Bielefeld breast cancer project (BBCP) [21, 22]. In the BBCP, a set of 201 marker genes is analyzed for 87 samples taken from 49 patients. One main feature of the BBCP, in contrast to other microarray breast cancer studies, is the high number of clinical parameters that has been collected for each of the patients. As summarized in Table 2 (left column), 29 clinical parameters are selected for correlation analysis. Some of these parameters are interval parameters. To apply the NTI, they have to be converted to nominal parameters by parameter-specific transformations (e.g., the values of the *body mass index* (BMI) are divided into the three categories *normal* (18.5 to 25), *overweight* (25 to 30), and *obese* (> 30). Moreover, if reasonable, the categories of some nominal variable are merged (e.g., the categories of the parameter *progesterone receptor IHC* are transformed to the categories *negative* (for values 0 to 1), *intermediate* (for values 2 to 8) and *high positive* (for values 9 to 12)). All specific transformations are listed in Table 2 (right column).

In this paper, the entire molecular expression signature is used to demonstrate the merits of the NTI and its *p*-value. Available knowledge about the analyzed genes, i.e. information about marker genes, is used anyway since this helps to create well-structured cluster trees. Both data sets (van de Vijver and BBCP) are preprocessed and clustered as follows: The logarithms of ratios between the respective gene expression to reference sample are scaled to [-1, 1]. Let **x**
_{
st
} be the scaled logarithm of sample *s* and gene *t*. The expression profiles **x**
_{
s
} are clustered by hierarchical agglomerative clustering using average linkage and a distance metric (dissimilarity measure) based on the correlation between a pair of subjects. This correlation distance metric *d*
_{
ij
} ∈ [0, 1] of two expression profiles **x**
_{
i
} and **x**
_{
j
} of length *g* is defined as

By applying the NTI on cluster trees obtained from real-world data sets, we simulate the scenario where a biomedical researcher is looking for clinical parameters that are correlated with the microarray data. The NTI and *p*-value are computed for each clinical parameter listed in Tables 1 and 2. This enables the detection of even unexpected relations between the variables. By this approach, huge data collections can be screened without the requirement to manually pre-select the clinical parameters. Nevertheless, the insight gained depends on the parameter, e.g. the parameter *intended operation* rather reveals an unexpected relationship than any insight into a biomedical process.

A summary of all results is shown in Figure 6. For both data sets, the highest NTI is obtained for the estrogen receptor. The number of asterisks indicates the level of significance of the correlation. One asterisk means that the rejection of *H*
_{0} (no correlation) is statistically significant at the 5% level, two asterisks at the 1% level, and three asterisks at the 0.1% level. No asterisk means that *H*
_{0} cannot be rejected.

On the left of Figure 6, the results for the van de Vijver breast cancer data set are shown. The highest NTI is obtained for the clinical parameter *estrogen receptor* *(ESR1)*. The correlation between the clinical parameters *metastasis*, *event death*, and *estrogen receptor* *(ESR1)* and the microarray data is statistically significant at the 0.1% level. The *StGallen consensus* *criteria* is statistically significant at the 1% level. On the right of Figure 6, the results for the BBCP data set are shown. The highest NTI is obtained for *estrogen receptor IHC*. The correlations between *age*, *BMI, native country, grading, progesterone receptor IHC*, and *estrogen receptor IHC* and the microarray data are statistically significant at the 0.1% level. The correlations of the parameters *menopause, smoking*, *T* (*tumor dimension*), and *intended operation* are statistically significant at the 1% level. The correlations of the parameters *ethnic group, nursing period, alcohol, sleep, N* *(lymph nodes)*, *Her2-new, inspection, tumor size (mammogramm*) and *chemoregime* are statistically significant at the 5% level.

The cluster tree of the van de Vijver data set is displayed in Figure 7. It is colored and evaluated with respect to the clinical parameters *positive lymph nodes* and *estrogen receptor* (*ESR1*). No correlation is detected between the microarray data and *positive lymph nodes*. In contrast to that, the microarray data is highly correlated with *estrogen receptor* *(ESR1)*, since the rejection of *H*
_{0} is statistically significant at the 0.1% level. The cluster tree of the BBCP data set is displayed in Figure 8. It is colored and evaluated with respect to the clinical parameters *estrogen receptor IHC*, *progesterone receptor IHC*, *grading*, and *nursing*. The *p*-values < 0.001 indicate that the microarray data is highly correlated with the first three parameters, whereas there is no correlation with *nursing*.

## Discussion

A novel index, the Normalized Tree Index (NTI), is developed to compute a normalized correlation coefficient between hierarchically clustered primary data (microarray data) and nominal labels of secondary data (clinical parameters). The NTI is an extension to the TI as described in [13], but it is bounded by [0, 1]. A high NTI indicates a high correlation between the label and the clustered data and vice versa. Furthermore, an empirical *p*-value is derived which measures the level of significance of the detected correlations between labels and primary data.

Some of the detected correlations reflect common knowledge: The clinical relevance of the *estrogen receptor* and the *progesterone receptor* is unquestioned [23–25]. The gene expression of these receptors are main criteria to differentiate between genetic profiles [26–28]. Also, a correlation to *metastasis* and *event death* is shown in [7], and a correlation to *grading* is reported in [22]. For other detected correlations there is no clear evidence provided in the literature: The parameters *age, BMI, native country, menopause, smoking, T (tumor dimension)* are highly correlated with the genomic data. These high correlations indicate that there might be common underlying mechanisms or pathways. The linkages between the phenotypes (the clinical parameters) and the genotypes (the microarray data) help to formulate new hypothesis and aid to obtain new insights into the complex mechanisms of diseases. Some of the detected correlations are harder to interpret: The correlations between *intended operation*, *and* *chemoregime* and the microarray data are probably not based on direct causal relationships. Interestingly, no significant correlation is reported between the parameters *familial breast cancer, histology, lateral acoustical shadow, dorsal acoustic attenuation* and the microarray data - an indicator that the genomic information offers a new approach to access and thus improve the diagnoses of breast cancer.

Even though applied to microarray data in a medical setting, the NTI can be applied to any complex data, in whose context a cluster analysis of the primary data is reasonable. Whenever there is the slightest assumption that the internal structure of the primary data might be correlated with a given label of the secondary data, the NTI provides an objective measure for this structural relationship.

The Normalized Tree Index (NTI) is developed to compute a correlation coefficient between primary data and nominal labels of secondary data. Ordinal and interval labels have to be converted to nominal labels by label-specific transformations (Table 2). The correlation result depends on the specific transformation set up by the researcher. Even though different categorizations for the labels could be tested this way, background knowledge is required for this step. The transformations also imply a loss of information. However, a reduction of the data of an ordinal or interval parameter to a few biological relevant categories can also help to avoid over fitting. In Table 2, the interval-scaled clinical labels *progesterone receptor IHC* and *estrogen receptor IHC* have been transformed to nominal labels with three categories: negative (0 to 1), intermediate (2 to 8) and high positive (9 to 12). Nevertheless, strategies for a direct application of the NTI on ordinal and interval labels need to be developed.

Hierarchical agglomerative clustering and the computation of the NTI are advantageous compared to the following method that is sometimes used to obtain a correlation coefficient: A classifier is trained on the microarray data. A selected label is used to rate the correlation depending on the ability of a classifier to predict the correct label in a leave-one-out setting. The higher the classification rate, the higher the correlation between the primary data and the label. The major drawback of this approach is that a visualization is not provided this way. A high classification rate indicates a high correlation, but there is no way to retrace how the specific classification rate has been obtained. Homogeneous clusters, outliers, and other significant patterns cannot be identified this way.

## Conclusion

The Normalized Tree Index (NTI) is the first cluster index that uses the structure of the hierarchical clustering tree to compute a normalized correlation coefficient between nominal labels and high-dimensional primary data. Its normalization feature enables the easy identification of labels that are correlated with the primary data, while at the same time a *p*-value measures the level of significance of the detected correlations. Even though applied to microarray data in a medical setting, the NTI can be applied to any complex data. This general applicability makes it a powerful tool in diverse domains.

## References

- 1.
Eisen MB, Spellman PT, Brown PO, Botstein D: Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci USA. 1998, 95: 14863-8. 10.1073/pnas.95.25.14863.

- 2.
Perou CM, Sorlie T, Eisen MB, van de Rijn M, Jeffrey SS, Rees CA, Pollack JR, Ross DT, Johnsen H, Akslen LA, Fluge O, Pergamenschikov A, Williams C, Zhu SX, Lonning PE, Borresen-Dale AL, Brown PO, Botstein D: Molecular Portraits of Human Breast Tumours. Nature. 2000, 406: 747-752. 10.1038/35021093.

- 3.
Wang J: Computational biology of genome expression and regulation - a review of microarray bioinformatics. J Environ Pathol Toxicol Oncol. 2008, 27 (3): 157-79.

- 4.
Pavlopoulos GA, Soldatos TG, Barbosa-Silva A, Schneider R: A reference guide for tree analysis and visualization. Biodata Mining. 2010, 3: 1-10.1186/1756-0381-3-1.

- 5.
Quackenbush J: Computational Analysis of Microarray Data. Nat Rev Genet. 2001, 2 (6): 418-27. 10.1038/35076576.

- 6.
Ochs MF: Microarrays in Cancer: Research and Applications. Biotechn. 2003, 34: 4-15.

- 7.
van't Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AA, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, Schreiber GJ, Kerkhoven RM, Roberts C, Linsley PS, Bernards R, Friend SH: Gene expression profiling predicts clinical outcome of breast cancer. Nature. 2002, 415: 530-6.

- 8.
Huang E, Cheng SH, Dressman H, Pittman J, Tsou MH, Horng CF, Bild A, Iversen ES, Liao M, Chen CM, West M, Nevins JR, Huang AT: Gene expression predictors of breast cancer outcomes. The Lancet. 2003, 361 (9369): 1590-6. 10.1016/S0140-6736(03)13308-9.

- 9.
Tsumoto S: Clinical Knowledge Discovery in Hospital Information Systems: Two Case Studies. Lecture Notes in Computer Science. 2000, Springer, 1910/2000: 43-332.

- 10.
Fisher RA: Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika. 1915, 10 (4): 507-521.

- 11.
Sachs L: Angewandte Statistik. 2002, Heidelberg: Springer

- 12.
Kendall: A New Measure of Rank Correlation. Biometrika. 1938, 30: 81-89.

- 13.
Martin C, Nattkemper TW: A Tree Index to Support Clustering Based Exploratory Data Analysis. Communications in Computer and Information Science, Bioinformatics Research and Development edition. Edited by: Elloumi M. 2008, Heidelberg: Springer, 13: 1-15. full_text.

- 14.
Halkidi M, Batistakis Y, Vazirgiannis M: On Clustering Validation Techniques. Journal of Intelligent Information Systems. 2001, 17 (2-3): 107-145. 10.1023/A:1012801612483. [http://citeseer.ist.psu.edu/article/halkidi01clustering.html]

- 15.
Handl J, Knowles J, Kell DB: Computational cluster validation in post-genomic data analysis. Bioinformatics. 2005, 21 (15): 3201-3212. 10.1093/bioinformatics/bti517.

- 16.
Wang H, Zheng H, Azuaje F: Clustering-based approaches to SAGE data mining. BioData Mining. 2008, 1: 5-10.1186/1756-0381-1-5.

- 17.
Johnson NL, Kotz S, Balakrishnan N: Discrete multivariate distributions. 1997, Hoboken, NJ: Wiley

- 18.
Datta S, Datta S: Methods for evaluating clustering algorithms for gene expression data using a reference set of functional classes. BMC Bioinformatics. 2006, 7: 397-10.1186/1471-2105-7-397.

- 19.
van de Vijver MJ, He YD, van't Veer LJ, Dai H, Hart AAM, Voskuil DW, Schreiber GJ, Peterse JL, Roberts C, Marton MJ, Parrish M, Atsma D, Witteveen A, Glas A, Delahaye L, van der Velde T, Bartelink H, Rodenhuis S, Rutgers ET, Friend SH, Bernards R: A gene-expression signature as a predictor of survival in breast cancer. The New Eng J Med. 2002, 347 (25): 1999-2009. 10.1056/NEJMoa021967.

- 20.
Rosetta Inpharmatics. [http://www.rii.com/publications/2002/nejm.html]

- 21.
Tauchen A, Becker A, Faas-Fehervary P, Hornberg C, Volz J: Target-oriented microarray analysis for detailed characterization of high-risk breast tumors. 6th European Breast Cancer Conference, EJC Supplements. 2008, 6: 7-

- 22.
Tauchen A: Genexpressionsanalysen zur Charakterisierung primaerer Mammatumoren im neoadjuvanten Setting. PhD thesis. 2009, Faculty of Biology, Bielefeld University, Germany

- 23.
Samaan NA, Buzdar AU, Aldinger KA, Schultz PN, Yang KP, Romsdahl MM, Martin R: Estrogen receptor: a prognostic factor in breast cancer. Cancer. 1981, 47 (3): 554-560. 10.1002/1097-0142(19810201)47:3<554::AID-CNCR2820470322>3.0.CO;2-W.

- 24.
Goldhirsch A, Glick JH, Gelber RD, Coates AS, Thuerlimann B, Senn HJ, members P: Meeting highlights: international expert consensus on the primary therapy of early breast cancer. Ann Oncol. 2005, 16 (10): 1554-1560. 10.1093/annonc/mdi326.

- 25.
Decker T, Hungermann D, Boecker W: Prognostische und praediktive Faktoren invasiver Mammakarzinome: Update 2009. Pathologe. 2009, 30: 49-55. 10.1007/s00292-008-1105-0.

- 26.
Loi S, Desmedt C, Cardoso F, Piccart M, Sotiriou C: Breast cancer gene expression profiling: clinical trial and practice implications. Pharmacogenomics. 2005, 6: 49-58. 10.1517/14622416.6.1.49.

- 27.
Sotiriou C, Wirapati P, Loi S, Harris A, Fox S, Smeds J, Nordgren H, Farmer P, Praz V, Haibe-Kains B, Desmedt C, Larsimont D, Cardoso F, Peterse H, Nuyten D, Buyse M, de Vijver MJV, Bergh J, Piccart M, Delorenzi M: Gene expression profiling in breast cancer: understanding the molecular basis of histologic grade to improve prognosis. J Natl Cancer Inst. 2006, 98 (4): 262-272. 10.1093/jnci/djj052.

- 28.
Sorlie T, Wang Y, Xiao C, Johnsen H, Naume B, Samaha RR, Borresen-Dale AL: Distinct molecular mechanisms underlying clinically relevant subtypes of breast cancer: gene expression analyses across three different platforms. BMC Genomics. 2006, 7: 127-10.1186/1471-2164-7-127.

## Acknowledgements

This research is supported by the International Graduate School for Bioinformatics and Genome Research at Bielefeld University, Germany as well as by the Technical Faculty of Bielefeld University, Germany. We thank Rosetta Inpharmatics and the Broad Institute who made available gene expression data as well as clinical data from cancer patients accessible via the internet.

## Author information

## Additional information

### Competing interests

The authors declare that they have no competing interests.

### Authors' contributions

CM conceived of and carried out the study and the statistical analysis and drafted the manuscript. AT carried out the expression profiling experiments and the primary data analysis. AB contributed to the design of the experiments and constructed the microarray. TN participated in the design and coordination of the study and in drafting the manuscript. All authors read and approved the final manuscript.

## Authors’ original submitted files for images

## Rights and permissions

## About this article

#### Received

#### Accepted

#### Published

#### DOI

### Keywords

- Microarray Data
- Clinical Parameter
- Primary Data
- Secondary Data
- Cluster Tree