Hostname: page-component-7479d7b7d-jwnkl Total loading time: 0 Render date: 2024-07-10T03:17:00.505Z Has data issue: false hasContentIssue false
  • English
  • Français

Information Theory and Redundancy

Published online by Cambridge University Press:  01 April 2022

Derek Partridge
Derek Partridge*
Affiliation:
Computer Science Department New Mexico State University
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper argues that Information Theoretic Redundancy (ITR) is fundamentally a composite concept that has been continually misinterpreted since the very inception of Information Theory.

We view ITR as compounded of true redundancy and partial redundancy. This demarcation of true redundancy illustrates a limiting case phenomenon: the underlying metric (number of alternatives) differs only by degree but the properties of this concept differ in kind from those of partial redundancy.

Several other studies are instanced which also imply the composite nature of ITR. We thus provide broadly based but particular support for earlier generalized suggestions that it is the underlying calculus of Information Theory rather than the ill-named concepts themselves that provides something of a unitary language for the description of phenomena.

Type
Research Article
Information
Philosophy of Science , Volume 48 , Issue 2 , June 1981 , pp. 308 - 316
Copyright
Copyright © 1981 by the Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bar-Hillel, Y. (1955), “An Examination of Information Theory”, Philosophy of Science 22: 86–105.CrossRefGoogle Scholar
Bell, D. A. (1962), Information Theory and Its Engineering Applications. 3rd edn. London: Pitman.Google Scholar
Black, M. (1968), The Labyrinth of Language. Harmondsworth: Penguin.Google Scholar
Brown, J. (1966), “Information Theory”, in New Horizons in Psychology, Foss, B. M. (ed.), Harmondsworth: Penguin.Google Scholar
Chapanis, A. (1954), “The Reconstruction of Abbreviated Printed Messages”, Journal of Experimental Psychology 48: 496–510.CrossRefGoogle ScholarPubMed
Cherry, C. (1957), On Human Communication. Tech. Press MIT and Wiley, 2nd edn., 1966.CrossRefGoogle Scholar
Garner, W. (1962), Uncertainty and Structure as Psychological Concepts. New York: Wiley.Google Scholar
Gatlin, L. (1972), Information Theory and the Living System. New York: Columbia University Press.Google Scholar
Goldman, S. (1953), Information Theory. New York: Prentice-Hall.Google Scholar
Greene, J. (1975), Thinking and Language, in Essential Psychology, P. Herriot (series ed.), London: Methuen.Google Scholar
Herdan, G. (1964), Quantitative Linguistics. London: Butterworths.Google Scholar
Jackson, P. C. (1974), Introduction to Artificial Intelligence. New York: Petrocelli.Google Scholar
Malmberg, B. (1963), Structural Linguistics and Human Communication. New York: Academic Press.CrossRefGoogle Scholar
Miller, G. A. (1951), Language and Communication. New York: McGraw-Hill.CrossRefGoogle Scholar
Miller, G. A. and Friedman, E. A. (1957), “The Reconstruction of Mutilated English Texts”, Information and Control 1: 38–55.CrossRefGoogle Scholar
Partridge, D. and James, E. B. (1974), “Natural Information Processing”, International Journal of Man-Machine Studies 6: 205–235.CrossRefGoogle Scholar
Rosie, A. M. (1966), Information and Communication Theory. London: Blackie.Google Scholar
Shannon, C. E. (1948), “A Mathematical Theory of Communication”, Bell Sys. Tel. Journal 27: 379–423, 623–656.CrossRefGoogle Scholar
Shannon, C. E. (1951), “Prediction and Entropy of Printed English”, Bell Sys. Tel. Journal 30: 50–64.CrossRefGoogle Scholar
Shannon, C. E. and Weaver, W. (1949), The Mathematical Theory of Communication. Urbana: University of Illinois Press.Google Scholar
Weaver, W. (1949), “The Mathematics of Communications”, Scientific American 181, July 1949: 11–15.CrossRefGoogle Scholar
Weinberg, G. M. (1971), The Psychology of Computer Programming. New York: Van Nostrand Reinhold.Google Scholar
Wilkinson, J. (1961), “The Concept of Information and the Unity of Science”, Philosophy of Science 28: 406–413.CrossRefGoogle Scholar