Statistical mechanics of lossy compression using multilayer perceptrons

URI http://harp.lib.hiroshima-u.ac.jp/hiroshima-cu/metadata/4038
ファイル
タイトル
Statistical mechanics of lossy compression using multilayer perceptrons
著者
氏名 MIMURA Kazushi
ヨミ ミムラ カズシ
別名 三村 和史
氏名 OKADA Masato
ヨミ オカダ マサト
別名 岡田 真人
抄録

Statistical mechanics is applied to lossy compression using multilayer perceptrons for unbiased Boolean
messages. We utilize a treelike committee machine committee tree and treelike parity machine parity tree
whose transfer functions are monotonic. For compression using a committee tree, a lower bound of achievable
distortion becomes small as the number of hidden units K increases. However, it cannot reach the Shannon
bound even where K→ . For a compression using a parity tree with K 2 hidden units, the rate distortion
function, which is known as the theoretical limit for compression, is derived where the code length becomes
infinity.

査読の有無
掲載雑誌名
Physical Review E - Statistical, Nonlinear, and Soft Matter Physics
74
2
開始ページ
026108-1
終了ページ
026108-11
出版年月日
2006-08
出版者
American Physical Society
ISSN
1539-3755
NCID
AA11558033
本文言語
英語
資料タイプ
学術雑誌論文
著者版フラグ
出版社版
権利情報
© 2008 The American Physical Society
旧URI
区分
hiroshima-cu