Skip to main content Accessibility help
×
Hostname: page-component-7479d7b7d-qlrfm Total loading time: 0 Render date: 2024-07-12T00:25:53.184Z Has data issue: false hasContentIssue false

7 - Designed versus Intrinsic Computation

from Part Two - The Computation of Processes, and Not Computing the Brain

Published online by Cambridge University Press:  05 March 2016

Christof Teuscher
Affiliation:
Portland State University, Department of Electrical and Computer Engineering, P.O. Box 751, Portland OR 97207-0751, USA
S. Barry Cooper
Affiliation:
University of Leeds
Andrew Hodges
Affiliation:
University of Oxford
Get access

Summary

Top-down versus bottom-up design

The design of modern products commonly follows a well-defined path, such as for example the human-centered approach used by the famous IDEO design consultancy, Kelley (2001). Design has turned into a process that can be studied, formalized, learned, and improved. As Tom Kelley (2001) explains, IDEO uses a methodology that has the following five basic steps: understand, observe, visualize, evaluate and refine, implement. Two things are important to notice in this process. First, there is an implicit “loop” for the evaluation and refinement process. No product is perfect from the beginning and most of them will need to be refined and re-evaluated over and over again. Second, the process is organized in a very top-down manner, i.e., it is a step-wise process that starts with a high-level goal, target, or vision and then gradually follows down in the hierarchy by specifying, evaluating, and implementing the lower-level (sub)systems. That is the way engineers design cars, airplanes, computers, and whatnot. The most important reason why top-down design has been so successful in the engineering world is divide et impera, or in more contemporary words, divide and conquer. Top-down design allows us to handle complex problems and to treat subsystems as abstract black boxes. While this generally works well in the engineering world, an entirely different design process can be observed in nature. Nature proceeds in a bottom-up way by simple trial and error. The process is called evolution and has led to amazing, albeit by no means perfect, ‘designs. ’ As the name says, bottom-up design proceeds from the bottom up by piecing subsystems into something bigger. Often, the functionality of the resulting system is greater than the sum of its parts. In that context, the term emergence (Holland, 1999) comes up frequently. Loosely speaking, emergence means that the interactions of the subsystem components do not necessarily allow us to predict the behavior at the next level. There is an element of surprise (Ronald et al., 1999) involved, which describes that non-predictibility nicely.

Today, the computing disciplines face difficult challenges from extending CMOS technology to and beyond dimensional scaling. One solution path is to use an innovative combination of novel manufacturing techniques, devices, compute paradigms, and architectures to create new information processing technology that may be radically different from what we currently know.

Type
Chapter
Information
The Once and Future Turing
Computing the World
, pp. 106 - 116
Publisher: Cambridge University Press
Print publication year: 2016

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

L., Bϋsing, B., Schrauwen, and R., Legstein. Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons.Neural Computation, 22:1272–1311, 2010.Google Scholar
J.P., Crutchfield, W.L., Ditto, and S., Sinha. Introduction to focus issue: intrinsic and designed computation: information processing in dynamical systems – beyond the digital hegemony. Chaos, 20:037101, 2010.
R.A., Freitas Jr. and R.C., Merkle. Kinematic Self-Replicating Machines.Landes Bioscience, 2004.
A., Goudarzi, C., Teuscher, N., Gulbahce, and T., Rohlf. Emergent criticality through adaptive information processing in Boolean networks. arXiv:1104.4141, 2011. In revision.
J.H., Holland. Emergence: From Chaos to Order. Perseus Books, 1999.
ITRS (International Technology Roadmap for Semiconductors), update. Semiconductor Industry Association, http://www.itrs.net/Links/2009ITRS/Home2009.htm, 2009.
S.A., Kauffman. Metabolic stability and epigenesis in randomly connected genetic nets. Journal of Theoretical Biology, 22:437–467, 1968.Google Scholar
S.A., Kauffman. The Origins of Order: Self–Organization and Selection in Evolution. Oxford University Press, 1993.
T., Kelley. The Art of Innovation. Currency Books, 2001.
L.B., Kish. End of Moore's law: Thermal (noise) death of integration in micro and nano electronics. Physics Letters A, 305:144–149, 2002.Google Scholar
E., Lazowska, M., Pollack, D., Reed, and J., Wing. Boldly exploring the endless frontier. Computing Research News, 21(1):1, 6, 2009.
W., Maass, T., Natschläger, and H., Markram. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Computation, 14(11):2531–2560, 2002.Google Scholar
T., Rohlf, N., Gulbahce, and C., Teuscher. Damage spreading and criticality in finite random dynamical networks. Physical Review Letters, 99(24):248701, 2007.Google Scholar
E.M.A., Ronald, M., Sipper, and M.S., Capcarrere. Design, observation, surprise! A test of emergence. Artificial Life, 5(3):225–239, 1999.Google Scholar
P.T., Saunders, editor. Collected Works of A.M. Turing: Morphogenesis. North-Holland, 1992.
A., Sinha, M.S., Kulkarni, and C., Teuscher. Evolving nanoscale associative memories with memristors. In Proceedings of the 11th International Conference on Nanotechnology (IEEE Nano 2011), pp. 860–864, IEEE, 2011.
D.B., Strukov, G.S., Snider, D.R., Stewart, and R.S., Williams. The missing memristor found. Nature, 453(7191):80–83, 2008.Google Scholar
C., Teuscher. Turing's Connectionism. An Investigation of Neural Network Architectures. Springer-Verlag, 2002.
C., Teuscher. Turing's connectionism. In Alan Turing: Life and Legacy of a Great Thinker,C., Teuscher (ed.), pp. 499–530. Springer-Verlag, 2004.
C., Teuscher, I., Nemenman, and F.J., Alexander (eds.). Novel computing paradigms: Quo vadis?Physica D, 237(9):1157–1316, 2008.
A.M., Turing. Intelligent machinery. In Machine Intelligence,B., Meltzer and D., Michie (eds.). Vol. 5, pp. 3–23. Edinburgh University Press, 1969.
W., Wolf. Modern VLSI Design: Systems on Silicon. Prentice Hall, 2nd edition, 1998.
V.V., Zhirnov and D.J.C., Herr. New frontiers: Self-assembly in nanoelectronics. IEEE Computer, 34:34–43, 2001.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×