References of "Entropy"
     in
Bookmark and Share    
Full Text
Peer Reviewed
See detailDesign of a 2-Bit Neural Network Quantizer for Laplacian Source
Peric, Zoran; Savic, Milan; Simic, Nikola et al

in Entropy (2021), 23(8), 933

Achieving real-time inference is one of the major issues in contemporary neural network applications, as complex algorithms are frequently being deployed to mobile devices that have constrained storage ... [more ▼]

Achieving real-time inference is one of the major issues in contemporary neural network applications, as complex algorithms are frequently being deployed to mobile devices that have constrained storage and computing power. Moving from a full-precision neural network model to a lower representation by applying quantization techniques is a popular approach to facilitate this issue. Here, we analyze in detail and design a 2-bit uniform quantization model for Laplacian source due to its significance in terms of implementation simplicity, which further leads to a shorter processing time and faster inference. The results show that it is possible to achieve high classification accuracy (more than 96% in the case of MLP and more than 98% in the case of CNN) by implementing the proposed model, which is competitive to the performance of the other quantization solutions with almost optimal precision. [less ▲]

Detailed reference viewed: 40 (1 UL)
Full Text
Peer Reviewed
See detailA Survey of Information Entropy Metrics for Complex Networks
Omar, Yamila UL; Plapper, Peter UL

in Entropy (2020)

Information entropy metrics have been applied to a wide range of problems that were abstracted as complex networks. This growing body of research is scattered in multiple disciplines, which makes it ... [more ▼]

Information entropy metrics have been applied to a wide range of problems that were abstracted as complex networks. This growing body of research is scattered in multiple disciplines, which makes it difficult to identify available metrics and understand the context in which they are applicable. In this work, a narrative literature review of information entropy metrics for complex networks is conducted following the PRISMA guidelines. Existing entropy metrics are classified according to three different criteria: whether the metric provides a property of the graph or a graph component (such as the nodes), the chosen probability distribution, and the types of complex networks to which the metrics are applicable. Consequently, this work identifies the areas in need for further development aiming to guide future research efforts. [less ▲]

Detailed reference viewed: 49 (5 UL)
Full Text
Peer Reviewed
See detailThermodynamics of Majority-Logic Decoding in Information Erasure
Sheng, Shiqi; Herpich, Tim UL; Diana, Giovanni et al

in Entropy (2019), 21(3), 284

Detailed reference viewed: 177 (6 UL)
Full Text
Peer Reviewed
See detailDetailed Fluctuation Theorems: A Unifying Perspective
Riccardo, Rao; Esposito, Massimiliano UL

in Entropy (2018)

We present a general method to identify an arbitrary number of fluctuating quantities which satisfy a detailed fluctuation theorem for all times within the framework of time-inhomogeneous Markovian jump ... [more ▼]

We present a general method to identify an arbitrary number of fluctuating quantities which satisfy a detailed fluctuation theorem for all times within the framework of time-inhomogeneous Markovian jump processes. In doing so, we provide a unified perspective on many fluctuation theorems derived in the literature. By complementing the stochastic dynamics with a thermodynamic structure (i.e., using stochastic thermodynamics), we also express these fluctuating quantities in terms of physical observables. [less ▲]

Detailed reference viewed: 235 (2 UL)
Full Text
Peer Reviewed
See detailDetailed Fluctuation Theorems: A Unifying Perspective
Rao, R.; Esposito, Massimiliano UL

in Entropy (2018), 20(9),

Detailed reference viewed: 44 (0 UL)
Full Text
Peer Reviewed
See detailQuantum Thermodynamics with Degenerate Eigenstate Coherences
Bulnes Cuetara, Gregory UL; Esposito, Massimiliano UL; Schaller, Gernot

in Entropy (2016), 18(447),

We establish quantum thermodynamics for open quantum systems weakly coupled to their reservoirs when the system exhibits degeneracies. The first and second law of thermodynamics are derived, as well as a ... [more ▼]

We establish quantum thermodynamics for open quantum systems weakly coupled to their reservoirs when the system exhibits degeneracies. The first and second law of thermodynamics are derived, as well as a finite-time fluctuation theorem for mechanical work and energy and matter currents. Using a double quantum dot junction model, local eigenbasis coherences are shown to play a crucial role on thermodynamics and on the electron counting statistics. [less ▲]

Detailed reference viewed: 162 (6 UL)
Full Text
Peer Reviewed
See detailQuantum Thermodynamics with Degenerate Eigenstate Coherences
Cuetara, G. B.; Esposito, Massimiliano UL; Schaller, G.

in Entropy (2016), 18(12),

Detailed reference viewed: 55 (1 UL)
Full Text
Peer Reviewed
See detailFact-Checking Ziegler’s Maximum Entropy Production Principle beyond the Linear Regime and towards Steady States
Polettini, Matteo UL

in Entropy (2013), 15(7), 2570-2584

We challenge claims that the principle of maximum entropy production produces physical phenomenological relations between conjugate currents and forces, even beyond the linear regime, and that currents in ... [more ▼]

We challenge claims that the principle of maximum entropy production produces physical phenomenological relations between conjugate currents and forces, even beyond the linear regime, and that currents in networks arrange themselves to maximize entropy production as the system approaches the steady state. In particular: (1) we show that Ziegler’s principle of thermodynamic orthogonality leads to stringent reciprocal relations for higher order response coefficients, and in the framework of stochastic thermodynamics, we exhibit a simple explicit model that does not satisfy them; (2) on a network, enforcing Kirchhoff’s current law, we show that maximization of the entropy production prescribes reciprocal relations between coarse-grained observables, but is not responsible for the onset of the steady state, which is, rather, due to the minimum entropy production principle. [less ▲]

Detailed reference viewed: 141 (2 UL)