We are very excited to join forces with MLCommons and OctoML.ai! Contact Grigori Fursin for more details!

Calculating entropy at different scales among diverse communication systems

lib:bb81a8434aefcd59 (v1.0.0)

Authors: Gerardo Febres,Klaus Jaffe
ArXiv: 1510.01026
Document:  PDF  DOI 
Abstract URL: http://arxiv.org/abs/1510.01026v1

We evaluated the impact of changing the observation scale over the entropy measures for text descriptions. MIDI coded Music, computer code and two human natural languages were studied at the scale of characters, words, and at the Fundamental Scale resulting from adjusting the symbols length used to interpret each text-description until it produced minimum entropy. The results show that the Fundamental Scale method is comparable with the use of words when measuring entropy levels in written texts. However, this method can also be used in communication systems lacking words such as music. Measuring symbolic entropy at the fundamental scale allows to calculate quantitatively, relative levels of complexity for different communication systems. The results open novel vision on differences among the structure of the communication systems studied.

Relevant initiatives  

Related knowledge about this paper Reproduced results (crowd-benchmarking and competitions) Artifact and reproducibility checklists Common formats for research projects and shared artifacts Reproducibility initiatives


Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!