Articles with "information bottleneck" as a keyword



Photo from wikipedia

Accelerating All-Atom Simulations and Gaining Mechanistic Understanding of Biophysical Systems through State Predictive Information Bottleneck.

Sign Up to like & get
recommendations!
Published in 2022 at "Journal of chemical theory and computation"

DOI: 10.1021/acs.jctc.2c00058

Abstract: An effective implementation of enhanced sampling algorithms for molecular dynamics simulations requires a priori knowledge of the approximate reaction coordinate describing the relevant mechanisms in the system. In this work, we focus on the recently… read more here.

Keywords: predictive information; state predictive; reaction coordinate; biophysical systems ... See more keywords
Photo from wikipedia

Attentive Variational Information Bottleneck for TCR–peptide interaction prediction

Sign Up to like & get
recommendations!
Published in 2022 at "Bioinformatics"

DOI: 10.1093/bioinformatics/btac820

Abstract: Abstract Motivation We present a multi-sequence generalization of Variational Information Bottleneck and call the resulting model Attentive Variational Information Bottleneck (AVIB). Our AVIB model leverages multi-head self-attention to implicitly approximate a posterior distribution over latent… read more here.

Keywords: information; tcr peptide; information bottleneck; variational information ... See more keywords
Photo from wikipedia

Shared-Private Information Bottleneck Method for Cross-Modal Clustering

Sign Up to like & get
recommendations!
Published in 2019 at "IEEE Access"

DOI: 10.1109/access.2019.2904554

Abstract: Recently, the cross-modal analysis has drawn much attention due to the rapid growth and widespread emergence of multimodal data. It integrates multiple modalities to improve learning and generalization performance. However, most previous methods just focus… read more here.

Keywords: cross modal; private information; method; information bottleneck ... See more keywords
Photo from wikipedia

Design of Nonorthogonal Multiple Access Systems: An Information Bottleneck Perspective

Sign Up to like & get
recommendations!
Published in 2022 at "IEEE Communications Letters"

DOI: 10.1109/lcomm.2022.3177412

Abstract: As a candidate technology of B5G cellular Internet of Things(IoT), grant-free non-orthogonal multiple access (NOMA) has arisen worldwide concerns. However, the non orthogonality leads to the mutual interference between users which reduces the reliability of… read more here.

Keywords: information; information bottleneck; bottleneck perspective; multiple access ... See more keywords
Photo from wikipedia

Childhood Leukemia Classification via Information Bottleneck Enhanced Hierarchical Multi-Instance Learning.

Sign Up to like & get
recommendations!
Published in 2023 at "IEEE transactions on medical imaging"

DOI: 10.1109/tmi.2023.3248559

Abstract: Leukemia classification relies on a detailed cytomorphological examination of Bone Marrow (BM) smear. However, applying existing deep-learning methods to it is facing two significant limitations. Firstly, these methods require large-scale datasets with expert annotations at… read more here.

Keywords: classification; leukemia classification; information bottleneck;
Photo by alterego_swiss from unsplash

Optimal prediction with resource constraints using the information bottleneck

Sign Up to like & get
recommendations!
Published in 2021 at "PLoS Computational Biology"

DOI: 10.1371/journal.pcbi.1008743

Abstract: Responding to stimuli requires that organisms encode information about the external world. Not all parts of the input are important for behavior, and resource limitations demand that signals be compressed. Prediction of the future input… read more here.

Keywords: information; information bottleneck; resource; using information ... See more keywords
Photo by austindistel from unsplash

IBVis: Interactive Visual Analytics for Information Bottleneck Based Trajectory Clustering

Sign Up to like & get
recommendations!
Published in 2018 at "Entropy"

DOI: 10.3390/e20030159

Abstract: Analyzing trajectory data plays an important role in practical applications, and clustering is one of the most widely used techniques for this task. The clustering approach based on information bottleneck (IB) principle has shown its… read more here.

Keywords: trajectory; visual analytics; information bottleneck; based trajectory ... See more keywords
Photo by alterego_swiss from unsplash

Learnability for the Information Bottleneck

Sign Up to like & get
recommendations!
Published in 2019 at "Entropy"

DOI: 10.3390/e21100924

Abstract: The Information Bottleneck (IB) method provides an insightful and principled approach for balancing compression and prediction for representation learning. The IB objective I(X;Z)−βI(Y;Z) employs a Lagrange multiplier β to tune this trade-off. However, in practice,… read more here.

Keywords: learnability information; learnability; information bottleneck;
Photo by alterego_swiss from unsplash

The Convex Information Bottleneck Lagrangian

Sign Up to like & get
recommendations!
Published in 2020 at "Entropy"

DOI: 10.3390/e22010098

Abstract: The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed representations T of some random variable X for the task of predicting Y. It is defined as a constrained optimization problem that maximizes… read more here.

Keywords: compression; information; information bottleneck; curve ... See more keywords
Photo from wikipedia

Variational Information Bottleneck for Semi-Supervised Classification

Sign Up to like & get
recommendations!
Published in 2020 at "Entropy"

DOI: 10.3390/e22090943

Abstract: In this paper, we consider an information bottleneck (IB) framework for semi-supervised classification with several families of priors on latent space representation. We apply a variational decomposition of mutual information terms of IB. Using this… read more here.

Keywords: information bottleneck; supervised classification; semi; semi supervised ... See more keywords
Photo from wikipedia

Information Bottleneck Classification in Extremely Distributed Systems

Sign Up to like & get
recommendations!
Published in 2020 at "Entropy"

DOI: 10.3390/e22111237

Abstract: We present a new decentralized classification system based on a distributed architecture. This system consists of distributed nodes, each possessing their own datasets and computing modules, along with a centralized server, which provides probes to… read more here.

Keywords: class; information bottleneck; classification; system ... See more keywords