3

I want to mimic computer memory with jeff heaton's encog neural network library. I just don't know what approach to use.

My requirement is to, have a memory location and a collection of bytes for the values.

location [0000]:byte-data[0101010]
location [0001]:byte-data[0101010]

Those are the values I pass to the neural network system.

I was trying to avoid retraining the neural network every time the memory data changes. But maybe that is what I need to do.

What neural network techniques would you use to accomplish what I am trying to do?

1
  • 2
    That's a strange thing to use a neural network. NN are best used as a classifier, not memory. NN don't learn the way it's meant to be with memory: they omit, generalize and forget. What exactly are you trying to accomplish? Is that some kind of research or non-discussable client requirement?
    – Rekin
    Commented Jan 8, 2011 at 11:48

3 Answers 3

2

What you're trying to do isn't a problem neural networks are really that great at since they're better at generalizing patterns, not learning them. However you may be able to accomplish this with either probabilistic neural networks or a regular perception. You were a little vague about your problem, so I'll have to be vague about my answer. I'm going to assume you mean that you pass in memory data and then "classify it" to a memory address. This way when you train the network using a supervised training method you will be able to pass in memory data that is similar or the same as an existing item and the network will give you the address. You could also do the same thing in reverse I suppose.

If you use a probabilistic neural network you'll essentially be learning every single pattern you pass to the network. Of course then every time you want to store a new memory address, you're adding a new node to the network, which makes things a little inefficient. Work has been done to reduce this problem, for example, this paper (you would have to implement the algo yourself). Perhaps this type of network would be most reliable in "remembering" the memory accurately, while still being able to generalize the results (using probabilities). The downside is that it will be memory intensive.

Traditional feedforward, backpropogation networks (perceptrons) should also allow you to do something like this. However you're going to have to be careful to create enough hidden nodes to allow the network to properly recall all your input values. Doing this will of course cause over fitting, but it sounds like you don't want to generalize your input data, you want better recall for patterns.

To solve the problem of learning new data, you'll just need to make your network able to learn over time, instead of learning once. You'll have to research this more, but you'll want to use some sort of online learning algorithm.

In conclusion, don't use neural networks, use some other kind of algorithm :p

1

The Hopfield neural network is a simple way of implementing associative memory. Conveniently, it is even supported by the Encog framework.

0

Not to be too nontechnical, but I'm pretty sure a series of loops coming off of a bunch of connected loops could produce memory.

Each loop would allow data to circle, and each loop underneath could identify, retrieve, or modify the memory.

Of course, I'm not sure how you would entice the network to incorporate that design.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.