Succinct Language Model Links

Succinct Language Model Links

Double Array Language Model

N-gram language models are essential components in ASR and MT system. A practical problem is using large models with limited memory. This paper proposes a double array structure and compares the memory usage and speed to kenlm. The slides and code are also available online

Both Watanabe and Sorenson have proposed succinct LM structures which are not mentioned in this paper and have freely available implementations.

This entry was posted by Edobashira. Bookmark the permalink.

9 thoughts on “Succinct Language Model Links”

Leave a Reply

Note: only a member of this blog may post a comment.