This paper considers the usage of neural networks for the construction of clusters and classifications from given data and discusses, conversely, the use of clustering methods in neural network algorithms. We survey related work in the fields of k-means clustering, stochastic approximation, Kohonen maps, Hopfield networks and multi-layer perceptrons. We propose various new approaches, reveal the asymptotic behaviour of Kohonen maps, and point to possible extensions.