LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Accelerating high‐dimensional clustering with lossless data reduction

Photo by bermixstudio from unsplash

Motivation: For cluster analysis, high‐dimensional data are associated with instability, decreased classification accuracy and high‐computational burden. The latter challenge can be eliminated as a serious concern. For applications where dimension… Click to show full abstract

Motivation: For cluster analysis, high‐dimensional data are associated with instability, decreased classification accuracy and high‐computational burden. The latter challenge can be eliminated as a serious concern. For applications where dimension reduction techniques are not implemented, we propose a temporary transformation which accelerates computations with no loss of information. The algorithm can be applied for any statistical procedure depending only on Euclidean distances and can be implemented sequentially to enable analyses of data that would otherwise exceed memory limitations. Results: The method is easily implemented in common statistical software as a standard pre‐processing step. The benefit of our algorithm grows with the dimensionality of the problem and the complexity of the analysis. Consequently, our simple algorithm not only decreases the computation time for routine analyses, it opens the door to performing calculations that may have otherwise been too burdensome to attempt. Availability and implementation: R, Matlab and SAS/IML code for implementing lossless data reduction is freely available in the Appendix. Contact: [email protected]

Keywords: reduction; high dimensional; dimensional clustering; data reduction; lossless data; accelerating high

Journal Title: Bioinformatics
Year Published: 2017

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.