NNs vs Computers

(24th-January-2021)

• Digital Computers

• Deductive Reasoning. We apply known rules to input data to produce output.

• Computation is centralized, synchronous, and serial.

• Memory is packetted, literally stored, and location addressable.

• Not fault tolerant. One transistor goes and it no longer works.

• Exact.

• Static connectivity.

• Applicable if well defined rules with precise input data.

•

• Compare NN is following,

• Neural Networks

• Inductive Reasoning. Given input and output data (training examples), we construct the rules.

• Computation is collective, asynchronous, and parallel.

• Memory is distributed, internalized, short term and content addressable.

• Fault tolerant, redundancy, and sharing of responsibilities.

• Inexact.

• Dynamic connectivity.

• Applicable if rules are unknown or complicated, or if data are noisy or partial.