Seems like the sort of thing machine learning actually ought to work quite well on, if you had enough hand written letters as training samples.