## Tags : maximum entropy

Entries in this Tags : 1logs Showing : 1 - 1 / 1

## Jun 30, 2010

### Cross-disciplinary approach of E. T. Jaynes

Post @ 20:33:48 | maximum entropy

Edwin Thompson Jaynes is nowadays mostly known for the maximum entropy principle exposed in the 1957 papers:

@article{jaynes-1957,
author = {Edwin Thompson Jaynes},
journal = {The Physical Review},
number = 4,
pages = {620--630},
publisher = {American Physical Society},
title = {Information Theory and Statistical Mechanics},
volume = 106,
year = 1957,
numpages = {10},
doi = {10.1103/PhysRev.106.620},
month = may
}


There it is shown that distributions with expectation constraints maximizing Shannon entropy are precisely exponential families. There a nice biography here.

Jaynes work was profound as he brought a new viewpoint of statistical mechanics as inference based on incomplete information.

Note that now-famous papers (his 1957 Phys. rev. papers) was objected by a reviewer then.

Frank.