Large-Scale Distributed Training of Transformers for Chemical Fingerprinting
Sign Up to like & getrecommendations! Published in 2022 at "Journal of Chemical Information and Modeling"
DOI: 10.1021/acs.jcim.2c00715
Abstract: Transformer models have become a popular choice for various machine learning tasks due to their often outstanding performance. Recently, transformers have been used in chemistry for classifying reactions, reaction prediction, physiochemical property prediction, and more.… read more here.
Keywords: distributed training; molecular fingerprints; large scale; chemistry ... See more keywords
2D-HRA: Two-Dimensional Hierarchical Ring-Based All-Reduce Algorithm in Large-Scale Distributed Machine Learning
Sign Up to like & getrecommendations! Published in 2020 at "IEEE Access"
DOI: 10.1109/access.2020.3028367
Abstract: Gradient synchronization, a process of communication among machines in large-scale distributed machine learning (DML), plays a crucial role in improving DML performance. Since the scale of distributed clusters is continuously expanding, state-of-the-art DML synchronization algorithms… read more here.
Keywords: ring based; scale distributed; large scale; distributed machine ... See more keywords
The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Parallel and Distributed Systems"
DOI: 10.1109/tpds.2022.3170574
Abstract: File system metadata is the data in charge of maintaining namespace, permission semantics and location of file data blocks. Operations on the metadata can account for up to 80% of total file system operations. As… read more here.
Keywords: file; file systems; metadata; large scale ... See more keywords
A Weak-Consistency–Oriented Collaborative Strategy for Large-Scale Distributed Demand Response
Sign Up to like & getrecommendations! Published in 2021 at "Frontiers in Energy Research"
DOI: 10.3389/fenrg.2021.718859
Abstract: Large-scale distributed demand response is a hotspot in the development of power systems, which is of much significance in accelerating the consumption of new energy power generation and the process of clean energy substitution. However,… read more here.
Keywords: large scale; scale distributed; response; demand response ... See more keywords