Find in Library

In this paper, we first present the significance of information theory and several commonly referred concepts associated with it. Then, the communication channel models constructed by information theory are briefly introduced. Meanwhile, the channel capacity, as a key role in modeling a channel, is expatiated. In addition, source coding and channel coding are compared and explained with a number of simulations. By reading this paper, the readers are expected to understand the significance of information theory as well as the indispensable roles of source coding and channel coding in a communication system. Furthermore, most of the techniques and fundamentals introduced and analyzed in this paper are feasible for the big data analytics in cyber-physical systems, which pave the way for coding over these newborn systems.