Basic Concepts in Information Theory and Coding

1994 ◽  
Author(s):  
Solomon W. Golomb ◽  
Robert E. Peile ◽  
Robert A. Scholtz
Keyword(s):  
Information Theory ◽  
Basic Concepts

Information theory

2018 ◽  
Author(s):  
Kenneth M. Sayre
Keyword(s):  
Information Theory ◽  
Communication Systems ◽  
High Speed ◽  
Contemporary Philosophy ◽  
Average Amount Of Information ◽  
Computing Machinery ◽  
Academic Psychology ◽  
Processing Information ◽  
Channel Information ◽  
Basic Concepts

Information theory was established in 1948 by Claude Shannon as a statistical analysis of factors pertaining to the transmission of messages through communication channels. Among basic concepts defined within the theory are information (the amount of uncertainty removed by the occurrence of an event), entropy (the average amount of information represented by events at the source of a channel), and equivocation (the ‘noise’ that impedes faithful transmission of a message through a channel). Information theory has proved essential to the development of space probes, high-speed computing machinery and modern communication systems. The information studied by Shannon is sharply distinct from information in the sense of knowledge or of propositional content. It is also distinct from most uses of the term in the popular press (‘information retrieval’, ‘information processing’, ‘information highway’, and so on). While Shannon’s work has strongly influenced academic psychology and philosophy, its reception in these disciplines has been largely impressionistic. A major problem for contemporary philosophy is to relate the statistical conceptions of information theory to information in the semantic sense of knowledge and content.

scholarly journals Implications of information theory in optical fibre communications

2016 ◽  
Vol 374 (2062) ◽  
pp. 20140438 ◽  
Author(s):  
Erik Agrell ◽  
Alex Alvarado ◽  
Frank R. Kschischang
Keyword(s):  
Information Theory ◽  
Optical Fibre ◽  
Optical Fibres ◽  
Limited Capacity ◽  
Fibre Optic ◽  
Precious Resource ◽  
Basic Concepts

Recent decades have witnessed steady improvements in our ability to harness the information-carrying capability of optical fibres. Will this process continue, or will progress eventually stall? Information theory predicts that all channels have a limited capacity depending on the available transmission resources, and thus it is inevitable that the pace of improvements will slow. However, information theory also provides insights into how transmission resources should, in principle, best be exploited, and thus may serve as a guide for where to look for better ways to squeeze more out of a precious resource. This tutorial paper reviews the basic concepts of information theory and their application in fibre-optic communications.

scholarly journals Information as Work and as Value

2017 ◽  
Vol 15 (2) ◽  
pp. 816-847
Author(s):  
Marcos Dantas
Keyword(s):  
Information Theory ◽  
Intellectual Property ◽  
Production Process ◽  
20Th Century ◽  
Information Value ◽  
Present Stage ◽  
Capitalist Production ◽  
The Status ◽  
Basic Concepts ◽  
Artistic Work

This article suggests an approach to Marx's capital valorisation theory supported by a dialectical information theory as developed by physicians, biologists and also communication theorists during the second half of the 20th century. It suggests that it is possible to link the basic concepts of information, as science has established it, to Marx's basic concepts of capital. Based on this foundation, this article also tries to explain how capital, in its development, has evolved to discharge redundant or repetitive jobs but has become increasingly dependent on random or creative ones. Because of this circumstance, in its present stage, the capitalist production process creates value in many concrete forms of semiotic information. Because information cannot be reduced to the status of a commodity, as the theory explains, capitalist states and corporations are improving and hardening the intellectual property laws in order to appropriate the information value created by "creative" or "artistic" work.

Sign in / Sign up

Export Citation Format

Share Document