VLSI hardware for example-based learning
- 1 September 1997
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 5 (3), 320-328
- https://doi.org/10.1109/92.609875
Abstract
Example-based learning, as performed by neural networks and other approximation and classification techniques, is both computationally intensive and I/O intensive, typically Involving the optimization of hundreds or thousands of parameters during repeated network evaluations over a database of example vectors. Although there Is currently no dominant approach or technique among the various neural networks and learning algorithms, the basic functionality of most neural networks can be conceptually realized as a multidimensional look-up table. While multidimensional look-up tables are clearly impractical due to the exponential memory requirements, we are pursuing an approach using interpolation based only on the sparse data provided by an initial example database. In particular, we have designed prototype VLSI components for searching multidimensional example databases for the X closest examples to an input query as determined by a programmable metric using a massively parallel search. This nearest-neighbor approach can be used directly for classification, or in conjunction with any number of neural network algorithms that exploit local fitting. The hardware removes the I/O bottleneck from the learning task by supplying a reduced set of examples for localized training or classification. Though nearest-neighbor retrieval algorithms have efficient software implementations for low-dimensional databases, exhaustive searching is the only effective approach for handling high-dimensional data. The parallel VLSI hardware we have designed can accelerate the exhaustive search by three orders of magnitude. We believe this special purpose VLSI will have direct application in systems requiring learning functionality and in accelerating learning applications on large, high-dimensional databases.Keywords
This publication has 9 references indexed in Scilit:
- Computational Ram: A Memory-simd Hybrid And Its Application To DspPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- A radial basis function neural network with on-chip learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- 55GCPS CAM using 5b analog flashPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Regularization Theory and Neural Networks ArchitecturesNeural Computation, 1995
- An efficient branch-and-bound nearest neighbour classifierPattern Recognition Letters, 1988
- A Fast k Nearest Neighbor Finding Algorithm Based on the Ordered PartitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1986
- A worst-case analysis of nearest neighbor searching by projectionLecture Notes in Computer Science, 1980
- An Algorithm for Finding Best Matches in Logarithmic Expected TimeACM Transactions on Mathematical Software, 1977
- Nearest neighbor pattern classificationIEEE Transactions on Information Theory, 1967