maybe your test cases are your rules. as long as you're recording things over time you have data to feed back to
and learn from. also, each level of abstraction you could store less data to potential learn from. instead of storing every pixel just store edges and other low level features from the first layer.