- Open Access
- Open Peer Review
Clustering-based approaches to SAGE data mining
BioData Miningvolume 1, Article number: 5 (2008)
Serial analysis of gene expression (SAGE) is one of the most powerful tools for global gene expression profiling. It has led to several biological discoveries and biomedical applications, such as the prediction of new gene functions and the identification of biomarkers in human cancer research. Clustering techniques have become fundamental approaches in these applications. This paper reviews relevant clustering techniques specifically designed for this type of data. It places an emphasis on current limitations and opportunities in this area for supporting biologically-meaningful data mining and visualisation.
Serial analysis of gene expression (SAGE)  is one of the most powerful, high-throughput tools available for global gene expression profiling at mRNA level. It allows quantitative, simultaneous analysis of thousands of transcript profile in a cell or tissue under specific biological conditions without requiring prior, complete functional knowledge of the genes to be analysed. Basically, the technique of SAGE relies upon on two fundamental principles : (1) a short nucleotide sequence, or SAGE tag, isolated from a defined position within an mRNA transcript is assumed to include sufficient information to uniquely represent the transcript and; (2) the end-to-end concatenation of tags into long DNA molecular allows rapid, efficient sequencing analysis of multiple transcripts. It has been shown that SAGE has several advantages over other gene expression analysis techniques. For example, unlike RNA blotting and RT-PCR, SAGE is able to examine thousands of transcript profiling at the same time. Unlike DNA microarray technologies, which is limited to the analysis of genes previously characterised and assigned to an array, the SAGE approach allows for the detailed analysis of expression patterns of uncharacterised genes as well as of known genes. Furthermore, the output of SAGE-based analysis is the digital measurement of absolute RNA abundance levels, greatly facilitating direct and reliable comparison of expression profiles produced by different experiments and laboratories [3, 4]. Such unique features have led to many important applications in a wide variety of studies, such as the discovery of potential transcriptional regulators and construction of biological networks , the identification of novel molecular tumour markers and therapeutic targets , the study of the molecular profile of gastroesophageal junction carcinomas  and the genomic analysis of mouse retinal development . Computational pattern discovery and classification based on data clustering plays an important role in these applications. However, due to the unique characteristics of SAGE data, mining this type of data poses a great challenge to the bio-data mining community.
Characteristics of SAGE data
As a result of global expression profiling, SAGE data are characterised by the presence of large amounts of high-dimensional data and the absence of functional and structural knowledge of many derived tags. For example, the result of a SAGE experiment, known as a SAGE library, is usually composed of many thousands of sequenced tags. Each tag is associated with a discrete value representing the expression level of a transcript in a particular tissue sample under selected physiological conditions. Furthermore, the generation of SAGE data does not rely on known gene sequence information. As a consequence, biological functions of many derived SAGE tags may remain largely unknown. For instance, in a study conducted by El-Meanawy et al. , a SAGE library generated from mouse kidney was constructed. It consisted of 3,868 sequence tags, in which only 42 percent of the transcripts matched mRNA sequence entries with known functions. Biological functions of 58 % of the transcripts were unknown.
Raw SAGE data may come in a variety of noisy representations and may include artifact sequences resulting from various sources of errors that are inherent in the experimental processes involved in the generation of data . It is estimated that the number of tags containing artificial counts caused by sequencing errors counts to be between 5% and 15% of the total number of tags [11, 12]. A study carried out by Akmaev and Wang  suggested that 3.5% of 21 bp (base pairs) SAGE tag, generated by a enhanced SAGE protocol (LongSAGE) , tags have errors inherited from the polymerise chain reaction (PCR) amplification and 17.3% of the tags in LongSAGE libraries have errors resulting from sequencing errors. It has been shown that the occurrences of these errors could lead to significant biases in the observed results produced by SAGE . The techniques used to remove sequence errors and correct relevant artefacts can be found in [10, 11], and . Due to the inherent nature of their data acquisition procedure, SAGE data are governed by different statistical models from those of array-based gene expression analysis. Let p(x) be the probability of observing x counts of a given tag in a specific SAGE library and λ be the expected count for a given tag, it has been suggested that the number of sampled transcripts of a particular type observed in a given SAGE library closely follows a Poisson distribution , i.e.
Moreover, such distributions are independent of each other across different SAGE tags and SAGE libraries as pointed out by Cai et al. .
SAGE data analysis: An overview
In recent years there has been an accumulation of significant amounts of SAGE data generated from different tissues and cell lines across different species such as human and mouse. However, such vast collections of data are not in themselves useful. In an attempt to extract useful knowledge encoded in the data, different data mining techniques have been developed and applied to analyze SAGE data. For example, several statistical tests have been used to study differential expression of genes based on the pairwise comparisons of SAGE libraries. Examples include Fisher's Exact test , Monte Carlo simulation-based test  and Bayesian statistics-based approaches . A comparative review of these applications can be found in .
To identify differential expression in multiple SAGE libraries, several statistical models were proposed to account for both between-library and within-library variation. Based on a hierarchical beta-binomial model, Baggerly et al.  introduced a statistic test, t w , for two-group comparisons. To simultaneously model multiple types of variance and deal with multiple groups, a model based logistic regression with over-dispersion was introduced in . A comparative evaluation of these approaches was conducted by Lu et al. .
Apart from these statistical test-based methods, other data mining techniques based on machine learning approaches (e.g. artificial neural networks) have also been applied to make SAGE data meaningful. Becquet et al.  utilized the association-rules discovery technique to reveal strong association rules hidden in large-scale human SAGE data. Rioult et al.  proposed an inductive database approach for mining biologically meaningful concepts from large SAGE expression data. Jin et al.  studied the performance of four supervised classification models, i.e. Support Vector Machine (SVM), Naïve Bayes (NB), Nearest Neighbour and C4.5 for cancer classification based on SAGE data, with SVM and NB achieving the best prediction performance. A Chi-square-based feature selection was used to deal with the high dimensional problem inherent in SAGE data. To support the identification of photoreceptor enriched genes based on SAGE expression data, Wang et al.  investigated three machine learning-based models (KStar, C4.5 decision tree, and multilayer perceptron neural network) for inferring functional associations from the SAGE data. Surprisingly, KStar, a relatively simple instance-based model performed significantly better than more complex algorithms, e.g. neural networks.
Being capable of detecting potentially novel and significant transcript or gene groups, clustering-based approaches have received great attention. For instance, based on hierarchical clustering analysis of 88 human cancer SAGE libraries, Ng et al.  presented a method to detect similarities between different types of cancer at the sub-cellular level. By modelling SAGE data with a Poisson distribution, Cai et al.  proposed a new K-means clustering technique to analyse SAGE data. More recently, Zheng et al.  introduced a novel self-adaptive neural network to supporting pattern discovery and visualization in SAGE data.
This paper places an emphasis on clustering-based approaches to SAGE data mining. Applications of traditional clustering techniques to analyse SAGE data are introduced in the next section, followed by a review of current advances in clustering analysis of SAGE data. The assessment of the quality of clustering techniques will also be investigated.
Clustering-based approaches to SAGE data mining: traditional techniques and their applications
A typical SAGE library consists of a list of thousands of tags and the number of times each tag is observed in a particular tissue sample obtained from different physiological conditions. A SAGE dataset can be summarized by a matrix, in which each horizontal row represents a sequenced SAGE tag and vertical columns contain various SAGE libraries corresponding to either serial time points taken from different development stages of a biological process or to various biological conditions. After data preprocessing, such as removal of sequencing and sampling errors, this matrix can then be analyzed by various clustering techniques. The main objectives are to cluster tags or libraries into classes that can be differentiated on the basis of their expression patterns and to identify groups of tags (or libraries) sharing similar expression patterns. This can be achieved by a two-way cluster analysis of the matrix: (1) clustering of SAGE tags based on expression profiles of each individual tag; and (2) clustering of SAGE libraries based on the expression profiles of each library.
Similarity measure between pairs of patterns is essential in most of clustering techniques. In the context of SAGE data analysis, the popular measure is based on the calculation of Pearson correlation across different libraries (or tags). Recently, based on the consideration of statistical nature of SAGE data, several Poisson-based similarity measures have been proposed, which will be further discussed in the next section.
The quality of the clustering outcomes can be assessed using different clustering validation techniques . Mapping SAGE tags to kown genes  can also be used to support the estimate of the quality of SAGE cluster analysis. Figure 1 summarises the basic steps involved in clustering analysis of SAGE data.
Based on the observation that genes exhibiting similar expression patterns are more likely to be co-regulated and share similar biological functions , clustering-based SAGE data analysis has found different applications, for example, the identification of biomarkers in human cancer research , the discovery of cell- specific promoters modules , and the better understanding of transcriptional networks [35, 36]. Such applications mainly rely on the following traditional clustering techniques.
By being able to construct a hierarchy of clusters and diagrammatically summarise the clustering process in a tree form, i.e. dendrogram, hierarchical clustering has become one of the most widely used clustering techniques in SAGE data analysis. It can be implemented by using agglomerative and divisive approaches. Starting from each tag assigned to its own cluster, an agglomerative technique forms the cluster structure in a bottom-up fashion until all SAGE tags belong to the same cluster. Depending on the way of defining similarity between clusters, such an approach has several variations such as single linkage, average linkage and complete linkage methods. A divisive method takes a top-down approach. It begins with the whole dataset as a single cluster, and iteratively splits up existing clusters into smaller clusters until each cluster only contains one data sample. Examples of hierarchical clustering for SAGE data analysis include a recent study conducted by Lee et al. , who clustered SAGE data obtained from the transcriptome of mouse type A spermatogonia, pachytene spermatocytes, and round spermatids to support the identification and discovery of potential transcriptional regulators and pathways involved in different stages of spermatogenesis. Based on the hierarchical clustering of 88 SAGE libraries derived from cancerous and normal tissues, as well as cell line material, Sander et al.  systematically studied cancer expression profiling. They found that based on SAGE expression data, brain and breast cancer samples could be clearly discriminated from their normal counterparts, but not in the case of prostate and ovarian cancers. To identify molecular alterations involved in the initiation and progression of breast carcinomas, Porter et al.  applied hierarchical clustering to analyze eight SAGE libraries generated from normal and cancerous human breast tissues.
The dendrogram is a graphical representation of hierarchical clustering, in which each step of the clustering process is illustrated by a tree joint, and each tree node represents a subset of expression data provides. It provides an intuitive platform for biologists to visualize basic relationships between all the tags or libraries, as illustrated in Figure 2. This example shows a two-way hierarchical clustering of 1118 SAGE tags highly expressed in the mouse microdissected outer nuclear layer (ONL) published by Blackshaw et al. . However, such a representation does not directly produce explicit partitions of the data. Given the sheer number of the data possibly involved in the analysis of SAGE studies, it is usually not obvious how to define clusters from the tree. For example, it could be a complex task for users to determine the optimal number of clusters and obtain meaningful partitions solely based on the dendrogram shown in Figure 2.
The k-means method is perhaps one of the simplest, best known clustering techniques. It partitions a dataset into k clusters iteratively, such that (1) each sample is assigned to its closest centroid, and (2) the dispersion within k clusters is minimised. Mechaly et al.  applied k-means clustering to study transcriptional networks involved in the mouse adult peripheral nerve repair program. Four SAGE libraries taken from mouse dorsal root ganglia at embryonic day E13, neonatal day P0, adult and adult 3 days post-axotomy were analysed. A k-means clustering with k = 50 was performed on 5400 SAGE tags. This analysis led to the identification of candidate genes, such as DDIT3, TIMM8B, and OAZIN, as potential injury-induced molecular actors involved in a stress response pathway.
K-means clustering exhibits several limitations that hinder its performance. One of its fundamental disadvantages is that the output of the k-means procedure is an unorganised collection of clusters that is not always conductive to biological and physiological interpretation . Nevertheless, the simplicity and scalability among large datasets still make k-means clustering technique an attractive alternative when dealing with large SAGE datasets.
Self-organizing map (SOM)
The basic idea of the SOM  is to produce a low dimensional (usually a 2- dimensional grid) representation of a high dimensional input space while preserving key similarity relations between input data samples. The resulting map is characterised by the formation of a topological map of the original data, in which similar patterns (i.e. samples) are close to each other, and the ones that are less similar tend to be further away. Figure 3 shows a 4 × 4 SOM map based on the analysis of 1467 SAGE tags published by . Ten SAGE libraries from developing mouse retina taken at 2-day intervals from embryonic day 12.5 (E12.5) to postnatal day 10.5 (P10.5) and adult retina were plotted on the x-axis, and relative tag abundance is shown on the y-axis of each SOM node. It can be seen that most of the tags, which show higher expression level in embryonic day are grouped together on the top-left hand-side in Figure 3, while those SAGE tags exhibiting higher expression values during postnatal periods are clustered into the right-bottom nodes. The tags with varying expression patterns throughout retinal development tend to be allocated in the central nodes shown in Figure 3.
The ability to reveal the intrinsic cluster structure of the data in a low dimensional space makes the SOM an appealing and powerful tool in various forms of clustering analysis. In a recent study published by Mclntosh et al. , the SOM has successfully supported the study of gene expression profiling of developing wheat caryopsis. A total of five SAGE libraries were constructed at five post-anthesis time-points, which correlate to key stages in the caryopsis developmental process. More than 90,000 LongSAGE tags were sequenced generating 29,261 unique tag sequences across all five SAGE libraries. Based on clustering analysis of expression patterns of the 250 most abundant tags with SOM, differential expression profiles that highlight development-specific genes were identified.
The application of the SOM-based clustering techniques requires the network structure and the number of nodes to be specified by the user in advance. Currently, for an unknown dataset, there is no theoretical way to determine the optimal size and structure of the output network. Usually, users need to rely on a trial-and-error method, which undoubtedly represents a time-consuming and tedious task.
Current advances in clustering analysis of SAGE data
Clustering analysis with a Poisson approach
Most of the applications discussed in the last section mainly applied tools currently available in microarray data clustering tools such as TIGR MeV  and GeneSpring . The data clustering algorithms offered by these tools do not take into account the specific statistical nature inherent in SAGE data. It has been shown that without the incorporation of the statistical model exhibited by SAGE data into the learning process, the advantages of clustering-based approaches may not be fully realized .
Based on the assumption that the number of tags observed in a SAGE library closely follows a Poisson distribution, Cai et al. proposed a new clustering algorithm (PoissonC) specifically designed for SAGE data. It was implemented within the k-means clustering framework but with a Poisson statistics-based function as a similarity measure. One of the innovations of PoissonC was that, instead of using traditional distance measures such as Pearson correlation and Euclidean distance, it adopts the chi-square statistic to determine how to assign each SAGE tag to its closest (cluster) centroid. Tested on simulated and experimental mouse retinal SAGE data, PoissonC has demonstrated significant advantages over traditional clustering methods.
More recently, Wang and colleagues  further incorporated Poisson statistics-based similarity measures into the learning process of SOM and agglomerative hierarchical clustering algorithms. Two new clustering methods called PoissonS and PoissonHC respectively were proposed. Like in PoissonC, PoissonS utilized Chi-square statistics to determine the winning nodes for each input sample. Let Y i be the input vector representing the i th k-dimensional SAGE tag (k is the total number of SAGE libraries), be the expected value of Y i (t) (t is the index of SAGE library), and m j be the associated weight vector of the j thnode, PoissonS used the following minimum Chi-square statistics-based distance matching criterion to determine the winning node denoted by the subscript c:
The calculation of the expected count represented in Equation (3) considers the following factors: (a) Like in a SOM, after each learning epoch, the weight vector, m j , in the PoissonS coincides with the centroid of the respective cluster, and (2) the main purpose of PoissonS is to group tags with similar relative expression rather than the absolute expression levels.
Under the assumption that Poisson distributions governing the generation of SAGE data are independent of each other across different SAGE tags and libraries, PoissonHC used the joint likelihood function, p(i,j), as a distance function to measure the similarity between tags i thand j thtags.
Where and are the expected values of Y i (t) and Y j (t) respectively, which can be calculated by using the 2 × k contingency table with Y i (t) being the first row and Y j (t) being the second row .
The performance of both PoissonS and PoissonHC was evaluated by using three datasets, i.e. one synthetic set published by Cai et al. , mouse retinal SAGE data including 10 murine SAGE libraries generated from developing retina taken at 2-day intervals  and human cancer SAGE data including eleven human cancer SAGE libraries . The results indicated that, in the context of SAGE-based data clustering, both PoissonS and PoissonHC offer several advantages over existing traditional data clustering techniques techniques. Figure 4 shows clustering analysis of a set of 35 tags with known biological functions and distinctive expression patterns with PoissonHC and hierarchical clustering with Pearson correlation as a distance function. Clearly, PoissonHC outperformed its hierarchical clustering counterpart.
To further enhance the capability for pattern discovery and visualization in SAGE data, a hybrid approach based on the combination of PoissonS and PoissonHC with PoissonS as the first analysis level, as illustrated in Figure 5, was also proposed by Wang et al. . Such a combination allows a better understanding of inter- and intra-cluster relationships hidden in the SAGE data.
Self-adaptive neural networks (SANNs)
SANNs represent a family of unsupervised neural networks, which have ability of dynamically organizing themselves (i.e. automatically adapt its topology) according to the natural clustering structure of the underlying data. Unlike the SOM, whose topology and number of nodes need to be predetermined by the user, SANNs allow the structure as well as the size of the network to be determined during the learning process. Thus, the resulting map has a structure that is directly linked to the underlying dataset. From a clustering prospective, such a feature may greatly facilitate the identification of cluster structures hidden in the data.
Zheng et al.  recently reported a new SANN model, Poisson-based Growing Self-Organizing Map (PGSOM), which implements novel weight adaptation and neurone growing strategies by taking into account the statistical properties of SAGE data. A fundamental advantage of PGSOM is that, based on the implementation of a Poisson statistic-based topology adaptation strategy, it is able to reflect similarity relationships and expression patterns encoded in the SAGE data by branching out. Figure 6 shows a representative map of PGSOM based on the analysis of a mouse retinal SAGE dataset published by Blackshaw et al. , which includes 63 non-PR-enriched and 261 PR-enriched tags. As can be seen from Figure 6(a), the PGSOM resulting map has branched out into four directions (Branches A1, A2, B1, and B2), each representing a distinct expression pattern encoded in the SAGE data. For example, genes associated with tags in Branches B1 are not associated with non-retina tissue (3t3 and hypo libraries) and before postnatal day P6.5. However, a significant increase in expression was observed throughout postnatal day. Genes that fall into Branch A12 show comparatively early onset of expression with expression signature starting at early stage of embryonic day and peaking around the time of birth.
Interestingly, PGSOM can also be used to perform hierarchical and multi-resolution clustering on selected areas of interest based on the selection on different learning parameters. The submap shown in Figure(b) is a higher-resolution map of Branch A1. This branch expanded into two directions: Branches A11 and A12, which were separated by the area covered by the dummy nodes. An analysis of expression pattern of SAGE tags clustered into these sub-branches reveal that each sub-branch is associated with a distinct, prototypical expression profile. While tags found in sub-branch A11 typically demonstrate a peak in expression during embryonic day, sub-branch A12 mainly contains tags with expression levels peaking around postnatal day, as shown in Figure 6(g).
Semi-supervised clustering approach
Traditional data-driven clustering analysis of SAGE data ignores existing prior biological knowledge. Recent advances in clustering techniques have demonstrated how functional biological knowledge can be integrated into a learning process to support SAGE data mining. Boratyn et al.  introduced a distance function, which makes use of the functional class information of annotated genes along with the experimental data, for clustering gene expression data. Based on the construction of a binary matrix that represents gene membership in a set of biological functions, they decreased the distance between a pair of genes annotated with similar functions and increased the pair-wise distance if two genes were annotated with different functions, or if these genes have no annotation. The new distance function was implemented within hierarchical clustering and evaluated using a human cancer SAGE dataset including 258 tags, whose expression values were significantly different across 4 normal and 7 ductal carcinoma in situ samples . An improvement in terms of biological validity of the obtained clusters was observed when using the combined distance measure in comparison to results from traditional data-driven clustering. This study made a strong case for the inclusion of existing biological information for supporting clustering-based SAGE data analysis.
Clustering evaluation techniques
As an unsupervised approach, clustering techniques generally do not require an external teacher to oversee a learning process and there are no predefined classes to indicate the type of valid relations or patterns that should be expected from the clustering process. Thus, the evaluation of clustering results is an essential task in cluster analysis.
Traditionally, the development of cluster validation techniques has mainly relied on indicators inferred from the data. One such example is the utilization of various cluster validity indices, which incorporate statistical aspects of the resulting partitioning to provide a quantitative assessment of the quality of clustering results. For example, based on the combination of different inter- and intra-cluster distances, Wang et al.  implemented generalized Dunn's cluster validity index to support clustering-based, large-scale analysis of SAGE expression data generated in the developing mouse retina.
It has been shown that such data-driven cluster evaluation methods are not sufficient for clustering analysis of biological data . Given the fact that one of the most important objectives of clustering analysis of SAGE data is to identify biologically-meaningful expression patterns encoded in the data, recent years have seen a growing trend towards the incorporation of prior biological knowledge to assess the quality of the clustering outcomes. Using functional information available in the Gene Ontology database, for instance, Datta and colleague  proposed the following two measures for assessing biological relevance of clustering analysis of gene expression data, including a Human breast cancer SAGE data: (a) Biological homogeneity index, which assesses how biologically homogeneous the clusters are, and (b) biological stability index, which measures the consistency of biological results produced. In an attempt to support the generation of biologically-meaningful partitioning, Zheng et al.  applied the hypergeometric distribution test to quantitatively assess the level of functional class enrichment (or over-representation) in a given partition. For each class (e.g. biologically category, cancer-specific SAGE tags), the probability (p-value) of observing k tags belonging to a class within a given cluster by chance is computed using the following formulae:
Where K is the number of tags assigned to the cluster under analysis, k is the number of tags belonging to the specific biological class in the cluster, N is the total number of SAGE tags in the whole data set and n is the total number of tags belonging to the specific class in the whole data set. If this probability is sufficiently low for a given class, one may conclude that the given biological category or functional class is significantly enriched in the cluster.
Given the amount and complexity of the data, computational approaches play an essential role in the analysis of SAGE data. This paper concentrated on relevant clustering techniques for the SAGE domain, based on an assessment of their merits, disadvantages and applications. Although this paper did not intend to represent an exhaustive review, key techniques and application principles of clustering-based approaches to SAGE data mining were discussed. Emphasis has been placed on current advances in the development of clustering algorithms for knowledge discovery in SAGE data.
Clustering analysis of SAGE data has traditionally focused on the application of software and tools typically applied to microarray data analysis. However, there are some fundamental mathematical differences between SAGE and micro array studies [17, 29]. For example, it has been shown that SAGE data are governed by different statistical models from those describing microarray data [17, 44]. Recent studies have demonstrated that without considering such a distinguishing statistical nature, clustering-based SAGE data mining may fail to produce biologically-meaningful and statistically-valid results. New clustering algorithms, which model the Poisson statistical nature of SAGE data, were reviewed in this paper. The advantages in terms of their ability to improve SAGE pattern discovery and visualization were highlighted.
It is worth noting that the Poisson-based clustering techniques discussed in this paper are not without their own limitations. As Kim et al.  pointed out, PoissonC fails to take the direction of departure of observed from expected into account. Thus, they proposed a new distant measure, which emphasizes the profile shape through suitable data transformations. In addition, PoissonC , Poisson S and PoissonHC  are also limited by some of the factors exhibited by traditional clustering. For example, like the standard SOM-algorithm, the network topology needs to be specified by the user. Like k-means algorithms, PoissonC may be trapped in a local optimal depending on the selection of initial cluster seeds. Incorporation of Poisson statistics into alternative, advanced clustering techniques deserves further investigation.
Recent development in SAGE research has proposed some new mathematical models to analyze SAGE data [50–52]. For example, Zuyderduyn  proposed a Poisson mixture model to represent SAGE data. Gilchrist et al.  introduced a Bayesian framework to model SAGE tag formation and its effects on data interpretation. Integration of these models into SAGE clustering analysis would be part of the future work.
There is no universal clustering solution for SAGE data analysis and no single clustering technique can always perform well on different type of datasets. Therefore, in practice, it is recommended to use more than one clustering technique in order to achieve more reliable clustering results. The application of a hybrid approach such as the neuro-hierachical approach proposed by Wang et al.  also represents a promising way for large-scale clustering analysis of SAGE data. Such a combination, on the one hand, can reduce the size of the dimensionality of the input SAGE data and provide a user-friendly visualization platform to understand the overall structure of the data by allowing the user to inspect the resulting PoissonS map. On the other hand, by visualizing the resulting map produced by PoissonS and the dendrogram generated by PoissonHC, inter- and intra- cluster relationships encoded in the SAGE data may be readily detected and easily understood.
As a final step of clustering analysis, the application of cluster validation techniques is vital to assist users in understanding some fundamental questions such as: Are these clusters biologically meaningful? Does this cluster represent outliers or some novel findings? Both data- and knowledge- driven cluster validation techniques were introduced in the paper. It should be emphasized that, a vast collection of cluster assessment methodologies developed for microarray studies such as Gene Ontology-based cluster validation  can, in principle, be applied to SAGE data analysis. Finally, it is important to recognize that, in order to obtain statistically-reliable and biologically-meaningful results, the application of both internal and external validation techniques is recommended for the assessment of clustering outcomes .
Velculescu VE, Zhang L, Vogelstein B, Kinzler KW: Serial analysis of gene expression. Science. 1995, 270: 484-7.
Patino WD, Mian OY, Hwang PM: Serial analysis of gene expression: technical considerations and applications to cardiovascular biology. Circ Res. 2002, 91 (7): 565-569.
Keime C, Damiola F, Mouchiroud D, Duret L, Gandrillon O: Identitag, a relational database for SAGE tag identification and interspecies comparison of SAGE libraries. BMC Bioinformatics. 2004, 5: 143-
Divina P, Foreijt J: The mouse SAGE site: database of public mouse SAGE libraries. Nucleic Acids Research. 2004, 32: D482-D483.
Lee T, Alba D, Baxendale V, Rennert O, Chan W: Application of transcriptional and biological network analyses in mouse germ-cell transcriptomes. Genomics. 2006, 88 (1): 18-33.
Porter D, Yao J, Polyak K: SAGE and related approaches for cancer target identification. Drug Discovery Today. 2006, 11 (3–4): 110-118.
Koon N, Zaika A, Moskaluk CA, Frierson HF, Knuutila S, Powell SM, El-Rifai W: Clustering of molecular alternations in gastroesophageal carcinomas. Neoplasia. 6 (2): 143-149.
Blackshaw S, Harpavat S, Trimarchi J, Cai L, Huang H, Kuo W, Lee K, Fraioli R, Cho S, Yung R, Asch E, Wong W, Ohno-Machado L, Weber G, Cepko CL: Genomic Analysis of Mouse Retinal Development. PLoS Biology. 2004, 2 (9):
El-Meanawy MA, Schelling JR, Pozuelo F, Churpek MM, Ficker EK, Iyengar S, Sedor JR: Use of serial analysis of gene expression to generate kidney expression libraries. Am J Physiol Renal Physiol. 2000, 279 (2): F383-392.
Akmaev VR, Wang CJ: Correction of sequence-based artifacts in serial analysis of gene exprexsion. Bioinformatics. 2004, 20 (8): 1254-1263.
Thygesen H, Zwinderman A: Modeling SAGE data with a truncated gamma-Poisson model. BMC Bioinformatics. 2006, 7: 157-
Beißbarth T, Hyde L, Smyth GK, Job C, Boon W-M, Tan S-S, Scott HS, Speed TP: Statistical modelling of sequencing errors in sage libraries. Bioinformatics. 2004, 20 (suppl 1): 31-39.
Saha S, Sparks AB, Rago C, Akmaev V, Wang CJ, Vogelstein B, Kinzler KW, Velculescu VE: Using the transcriptome to annotate the genome. Nat Biotechnol. 2002, 20: 508-512.
Stollberg J, Urschitz J, Urban Z, Boyd CD: A quantitative evaluation of SAGE. Genome Research. 2000, 10 (8): 1241-1248.
Akmaev VR: Correction of technology-related artefacts in serial analysis of gene expression. Methods Mol Biol. 2008, 387: 133-142.
Audic S, Claverie JM: The significance of digital gene expression profiles. Genome Res. 1997, 7 (10): 986-995.
Cai L, Huang H, Blackshaw S, Liu JS, Cepko C, Wong W: Clustering analysis of SAGE data: A Poisson approach. Genome Biology. 2004, 5: R51-
Man MZ, Wang X, Wang Y: POWER_SAGE: comparing statistical tests for SAGE experiments. Bioinformatics. 2000, 16: 953-959.
Chen H, Centola M, Altschul SF, Metzger H: Characterization of gene expression in resting and activated mast cells. J Exp Med. 1998, 188: 1657-1668.
Ruijter JM, Van Kampen AH, Baas F: Statistical evaluation of SAGE libraries: consequences for experimental design. Physiological Genomics. 2002, 11: 37-44.
Baggerly KA, Deng L, Morris JS, Aldaz CM: Differential expression in SAGE: accounting for normal between-library variation. Bioinformatics. 2003, 19: 1477-1483.
Baggerly KA, Deng L, Morris JS, Aldaz CM: Overdispersed logistic regression for SAGE: modelling multiple groups and covariates. BMC Bioinformatics. 2004, 5: 144-
Lu J, Tomfohr JK, Kepler TB: Identifying differential expression in multiple SAGE libraries: an overdispersed log-linear model approach. BMC Bioinformattics. 2005, 6: 165-
Becquet C, Blachon S, Jeudy B, Boulicaut J, Gandrillon O: Strong-association-rule mining for large-scale gene-expression data analysis: a case study on human SAGE data. Genome Biology. 2002, 3 (12):
Rioult F, Robardet C, Blachon S, Crémilleux B, Gandrillon O, Boulicaut JF: Mining concepts from large SAGE gene expression matrices. the Proc of the 2nd International Workshop on Knowledge Discovery in Inductive Databases KDID'03 co-located with ECML-PKDD. 2003, Catvat-Dubrovnik, September 22, 2003
Jin X, Xu A, Bie R, Guo P: Machine learning techniques and chi-square feature selection for cancer classification using SAGE gene expression profiles. the Proc. of PAKDD 2006 workshop. 2006, 106-115.
Wang H, Zheng H, Simpson D, Azuaje F: Machine learning approaches to supporting the identification of photoreceptor-enriched genes based on expression data. BMC Bioinformatics. 2006, 7: 116-
Ng RT, Sander J, Sleumer MC: Hierarchical cluster analysis of SAGE data for cancer profiling. the Proc. Of Workshop on Data Mining in Bioinformatics (BIOKDD01). 2001
Zheng H, Wang H, Azuaje F: Improving pattern discovery and visualisation of SAGE data through Poisson-based self-adaptive neural networks. IIEEE Trans Inf Technol Biomed. 2007, 12: 459-69.
Handl J, Knowles J, Kell DB: Computational cluster validation in post-genomic data analysis. Bioinformatics. 2005, 21: 3201-3212.
Norambuena T, Malig R, Melo F: SAGExplore: a web server for unambiguous tag mapping in serial analysis of gene expression oriented to gene discovery and annotation. Nucleic Acids Research. 2007, 35 (Web Server):
Eisen MB, Spellman PT, Brown PO, Botstein D: Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci USA. 1998, 95: 14863-14868.
Yasui W, Oue N, Ito R, Kuraoka K, Nakayama H: Search for new biomakers of gastric cancer through serial analysis of gene expression and its clinical implications. Cancer Science. 2004, 95 (5): 385-392.
Chan W, Lee T, Wu S, Ruszczyk L, Alba D, Baxendale V, Rennert OM: Transciptome analyses of male germ cells with serial analysis of gene expression (SAGE). Mol Cell Endocrinol. 2006, 250 (1–2): 8-19.
Mechaly I, Bourane S, Piquemal D, Al-Jumaily M, Venteo S, Puech S, Scamps F, Valmier J, Carroll P: Gene profiling during development and after a peripheral nerve traumatism reveals genes specifically induced by injury in dorsal root ganglia. Mol Cell Neurosci. 2004, 32 (3): 217-229.
Vos JB, van Sterkenburg MA, Rabe KF, Schalkwijk J, Hiemstra PS, Datson NA: Transcriptional response of bronchial epithelial cells to Pseudomonas aeruginosa: identification of early mediators of host defense. Physiol Genomics. 2005, 21: 324-336.
Sander J, Ng RT, Sleumer MC, Yuen MS, Jones SJ: A methodology for analysing SAGE libraries for cancer profiling. ACM Transactions on Information Systems. 2005, 23 (1): 35-60.
Porter DA, Krop IE, Nasser S, Sgroi D, Kaelin CM, Marks JR, Riggins G, Polyak K: A SAGE (serial analysis of gene expression) view of breast tumor progression. Cancer Res. 61 (15): 5697-702. 2001 Aug 1
Blackshaw S, Fraioli RE, Furukawa T, Cepko CL: Comprehensive analysis of photoreceptor gene expression and the identification of candidate retinal disease genes. Cell. 2001, 107: 579-589.
Tamayo P, Slonim D, Mesirov J, Zhu Q, Kitareewan S, Dmitrovsky E, Lander ES, Golub TR: Interpreting patterns of gene expression with self-organizing maps: methods and application to hematopoietic differentiation. Proc Natl Acad Sci USA. 1999, 96: 2907-2912.
Kohonen T: Self-Organizing Map. 2001, Berlin: Springer, 3
Mclntosh S, Watson , Bundock P, Crawford A, White J, Cordeiro G, Barbary D, Rooke L, Henry R: SAGE of the developing wheat caryopsis. Plant Biotechnology Journal. 2007, 5: 69-83.
Wang H, Zheng H, Azuaje F: Poisson-based self-organizing feature maps and hierarchical clustering for serial analysis of gene expression data. IEEE/ACM Trans Comput Biol Bioinform. 2007, 4 (2): 163-175.
Chu T: Learning from SAGE Data. 2003, PhD Dissertation, Department of Philosophy, Carnegie Mellon University
Buckhaults P, Zhang Z, Chen YC, Wang TL, Croix BS, Saha S, Bardelli A, Morin PJ, Polyak K, Hruban RH, Velculescu VE, Shih IM: Identifying tumor origin using a gene expression-based classification map. Cancer Research. 2003, 63: 4144-4149.
Boratyn GM, Datta Susmita, Datta Somnath: Incorporation of biological knowledge into distance for clustering genes. Bioinformation. 2007, 1 (10): 396-405.
Abba MC, Drake JA, Hawkins KA, Hu Y, Sun H, Notcovich C, Gaddis S, Sahin A, Baggerly K, Aldaz CM: Transcriptomic changes in human breast cancer progression as determined by serial analysis of gene expression. Breast Cancer Res. 2004, 6: R499-R513.
Wang H, Zheng H, Azuaje F: Computational Approaches to Supporting Large-Scale Analysis of Photoreceptor-Enriched Gene Expression. the Proceedings of the 19th IEEE Symposium on Computer-Based Medical Systems. 2006, 533-538. Datta S and Datta S: Methods for evaluating clustering algorithms for gene expression data using a reference set of functional classes. BMC informatics, 2006, 7:397.
Kim K, Zhang S, Jiang K, Cai L, Lee IB, Feldman LJ, Huang H: Measuring similarities between gene expression profiles through new data transformations. BMC Bioinformatics. 2007, 8: 29-
Zuyderduyn SD: Statistical analysis and significance testing of serial analysis of gene expression data using a Poisson mixture model. BMC Bioinformatics. 2007, 8: 282-
Gilchrist MA, Qin H, Zaretzki : Modeling SAGE tag formation and its effects on data interpretation within a Bayesian framework. BMC Bioinformatics. 2007, 8: 403-
Vêncio RZ, Varuzza L, de B Pereira CA, Brentani H, Shmulevich I: Simcluster: clustering enumeration gene expression data on the simplex space. BMC Bioinformatics. 2007, 8: 246-
Bolshakova N, Azuaje F, Cunningham P: A knowledge-driven approach to cluster validity assessment. Bioinformatics. 2005, 21 (10): 2546-2547.
The authors declare that they have no competing interests.
HW, HZ and FA co-wrote the manuscript. All authors read and approved the final manuscript.