Articles with "information decomposition" as a keyword



Photo by campaign_creators from unsplash

Fuzzy-Based Information Decomposition for Incomplete and Imbalanced Data Learning

Sign Up to like & get
recommendations!
Published in 2017 at "IEEE Transactions on Fuzzy Systems"

DOI: 10.1109/tfuzz.2017.2754998

Abstract: Class imbalance and missing values are two critical problems in pattern classification. Researchers have proposed a number of techniques to address each of the problems. However, no single technique can solve the two problems. Moreover,… read more here.

Keywords: based information; missing values; imbalanced data; fuzzy based ... See more keywords
Photo by datingscout from unsplash

Partial Information Decomposition and the Information Delta: A Geometric Unification Disentangling Non-Pairwise Information

Sign Up to like & get
recommendations!
Published in 2020 at "Entropy"

DOI: 10.20944/preprints202009.0661.v1

Abstract: Partial Information Decomposition and the Information Delta: A Geometric Unification Disentangling Non-Pairwise Information James Kunert-Graf 1*, Nikita Sakhanenko 1 and David Galas 1 1 Pacific Northwest Research Institute * Correspondence: [email protected] Version September 23, 2020… read more here.

Keywords: information; delta; information decomposition; partial information ... See more keywords
Photo from wikipedia

The Partial Information Decomposition of Generative Neural Network Models

Sign Up to like & get
recommendations!
Published in 2017 at "Entropy"

DOI: 10.3390/e19090474

Abstract: In this work we study the distributed representations learnt by generative neural network models. In particular, we investigate the properties of redundant and synergistic information that groups of hidden neurons contain about the target variable.… read more here.

Keywords: information; generative neural; network models; partial information ... See more keywords
Photo by strong18philip from unsplash

A Novel Approach to the Partial Information Decomposition

Sign Up to like & get
recommendations!
Published in 2022 at "Entropy"

DOI: 10.3390/e24030403

Abstract: We consider the “partial information decomposition” (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and unique components.… read more here.

Keywords: information theory; information; partial information; information decomposition ... See more keywords
Photo by alterego_swiss from unsplash

Revealing the Dynamics of Neural Information Processing with Multivariate Information Decomposition

Sign Up to like & get
recommendations!
Published in 2022 at "Entropy"

DOI: 10.3390/e24070930

Abstract: The varied cognitive abilities and rich adaptive behaviors enabled by the animal nervous system are often described in terms of information processing. This framing raises the issue of how biological neural circuits actually process information,… read more here.

Keywords: information; information processing; information decomposition; multivariate information ... See more keywords
Photo from wikipedia

Untangling Synergistic Effects of Intersecting Social Identities with Partial Information Decomposition

Sign Up to like & get
recommendations!
Published in 2022 at "Entropy"

DOI: 10.3390/e24101387

Abstract: The theory of intersectionality proposes that an individual’s experience of society has aspects that are irreducible to the sum of one’s various identities considered individually, but are “greater than the sum of their parts”. In… read more here.

Keywords: information; information decomposition; race sex; partial information ... See more keywords
Photo from wikipedia

Quick Estimate of Information Decomposition for Text Style Transfer

Sign Up to like & get
recommendations!
Published in 2023 at "Entropy"

DOI: 10.3390/e25020322

Abstract: A growing number of papers on style transfer for texts rely on information decomposition. The performance of the resulting systems is usually assessed empirically in terms of the output quality or requires laborious experiments. This… read more here.

Keywords: information; style transfer; information decomposition;
Photo by dawson2406 from unsplash

Modeling Categorical Variables by Mutual Information Decomposition

Sign Up to like & get
recommendations!
Published in 2023 at "Entropy"

DOI: 10.3390/e25050750

Abstract: This paper proposed the use of mutual information (MI) decomposition as a novel approach to identifying indispensable variables and their interactions for contingency table analysis. The MI analysis identified subsets of associative variables based on… read more here.

Keywords: mutual information; information decomposition; analysis; modeling categorical ... See more keywords
Photo by alterego_swiss from unsplash

A Review of Partial Information Decomposition in Algorithmic Fairness and Explainability

Sign Up to like & get
recommendations!
Published in 2023 at "Entropy"

DOI: 10.3390/e25050795

Abstract: Partial Information Decomposition (PID) is a body of work within information theory that allows one to quantify the information that several random variables provide about another random variable, either individually (unique information), redundantly (shared information),… read more here.

Keywords: information; fairness explainability; information decomposition; partial information ... See more keywords