Training an extreme learning machine by localized generalization error model
Sign Up to like & getrecommendations! Published in 2018 at "Soft Computing"
DOI: 10.1007/s00500-018-3012-5
Abstract: Extreme learning machine (ELM) is a non-iterative algorithm for training single-hidden layer feed-forward networks, whose training speed is much faster than those of conventional neural networks. However, its objective is only to minimize the empirical… read more here.
Keywords: generalization; generalization error; extreme learning; learning machine ... See more keywords
Understanding generalization error of SGD in nonconvex optimization
Sign Up to like & getrecommendations! Published in 2021 at "Machine Learning"
DOI: 10.1007/s10994-021-06056-w
Abstract: The success of deep learning has led to a rising interest in the generalization property of the stochastic gradient descent (SGD) method, and stability is one popular approach to study it. Existing generalization bounds based… read more here.
Keywords: generalization error; generalization; error sgd; loss ... See more keywords
Generalization error analysis for deep convolutional neural network with transfer learning in breast cancer diagnosis.
Sign Up to like & getrecommendations! Published in 2020 at "Physics in medicine and biology"
DOI: 10.1088/1361-6560/ab82e8
Abstract: Deep convolutional neural network (DCNN), now popularly called artificial intelligence (AI), has shown the potential to improve over previous computer-assisted tools in medical imaging developed in the past decades. A DCNN has millions of free… read more here.
Keywords: generalization error; transfer learning; deep convolutional; convolutional neural ... See more keywords
Theoretical Analysis of the Generalization Error of the Sampling-Based Fuzzy C-Means
Sign Up to like & getrecommendations! Published in 2021 at "IEEE Transactions on Fuzzy Systems"
DOI: 10.1109/tfuzz.2020.2990100
Abstract: Many studies take sampling to apply fuzzy C-means (FCM) to very large data sets. However, comparing with the plenty algorithms for sampling-based FCM, few research works theoretically study the generalization error. In this article, we… read more here.
Keywords: generalization; generalization error; sampling based; solution space ... See more keywords
Individually Conditional Individual Mutual Information Bound on Generalization Error
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Information Theory"
DOI: 10.1109/tit.2022.3144615
Abstract: We propose an information-theoretic bound on the generalization error based on a combination of the error decomposition technique of Bu et al. and the conditional mutual information (CMI) construction of Steinke and Zakynthinou. In a… read more here.
Keywords: generalization error; bound generalization; mutual information; information ... See more keywords
f-divergences and their applications in lossy compression and bounding generalization error
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Information Theory"
DOI: 10.1109/tit.2023.3268527
Abstract: In this paper, we provide three applications for $f$-divergences: (i) we introduce Sanov's upper bound on the tail probability of the sum of independent random variables based on super-modular $f$-divergence and show that our generalized… read more here.
Keywords: distortion; rate distortion; generalization error; lossy compression ... See more keywords