Using Probabilistic Models for Data Compression

被引:4
|
作者
Iatan, Iuliana [1 ]
Dragan, Mihaita [2 ]
Dedu, Silvia [3 ]
Preda, Vasile [2 ,4 ,5 ]
机构
[1] Tech Univ Civil Engn, Dept Math & Comp Sci, Bucharest 020396, Romania
[2] Univ Bucharest, Fac Math & Comp Sci, Bucharest 010014, Romania
[3] Bucharest Univ Econ Studies, Dept Appl Math, Bucharest 010734, Romania
[4] Gheorghe Mihoc Caius Iacob Inst Math Stat & Appl, Bucharest 050711, Romania
[5] Costin C Kiritescu Natl Inst Econ Res, Bucharest 050711, Romania
关键词
data compression; descriptors; probabilistic models; entropy; Huffman coding; coding redundancy; coding efficiency; artificial intelligence; ENTROPY; PATTERN;
D O I
10.3390/math10203847
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Our research objective is to improve the Huffman coding efficiency by adjusting the data using a Poisson distribution, which avoids the undefined entropies too. The scientific value added by our paper consists in the fact of minimizing the average length of the code words, which is greater in the absence of applying the Poisson distribution. Huffman Coding is an error-free compression method, designed to remove the coding redundancy, by yielding the smallest number of code symbols per source symbol, which in practice can be represented by the intensity of an image or the output of a mapping operation. We shall use the images from the PASCAL Visual Object Classes (VOC) to evaluate our methods. In our work we use 10,102 randomly chosen images, such that half of them are for training, while the other half is for testing. The VOC data sets display significant variability regarding object size, orientation, pose, illumination, position and occlusion. The data sets are composed by 20 object classes, respectively: aeroplane, bicycle, bird, boat, bottle, bus, car, motorbike, train, sofa, table, chair, tv/monitor, potted plant, person, cat, cow, dog, horse and sheep. The descriptors of different objects can be compared to give a measurement of their similarity. Image similarity is an important concept in many applications. This paper is focused on the measure of similarity in the computer science domain, more specifically information retrieval and data mining. Our approach uses 64 descriptors for each image belonging to the training and test set, therefore the number of symbols is 64. The data of our information source are different from a finite memory source (Markov), where its output depends on a finite number of previous outputs. When dealing with large volumes of data, an effective approach to increase the Information Retrieval speed is based on using Neural Networks as an artificial intelligent technique.
引用
收藏
页数:29
相关论文
共 50 条
  • [11] Data-driven discovery using probabilistic hidden variable models
    Smyth, Padhraic
    ALGORITHMIC LEARNING THEORY, PROCEEDINGS, 2006, 4264 : 28 - 28
  • [12] A probabilistic approach to training machine learning models using noisy data
    Alzraiee, Ayman H.
    Niswonger, Richard G.
    ENVIRONMENTAL MODELLING & SOFTWARE, 2024, 179
  • [13] Probabilistic unfolding models for sensory data
    MacKay, DB
    FOOD QUALITY AND PREFERENCE, 2001, 12 (5-7) : 427 - 436
  • [14] Probabilistic topic models for sequence data
    Nicola Barbieri
    Giuseppe Manco
    Ettore Ritacco
    Marco Carnuccio
    Antonio Bevacqua
    Machine Learning, 2013, 93 : 5 - 29
  • [15] Probabilistic topic models for sequence data
    Barbieri, Nicola
    Manco, Giuseppe
    Ritacco, Ettore
    Carnuccio, Marco
    Bevacqua, Antonio
    MACHINE LEARNING, 2013, 93 (01) : 5 - 29
  • [16] Speechreading using probabilistic models
    Luettin, J
    Thacker, NA
    COMPUTER VISION AND IMAGE UNDERSTANDING, 1997, 65 (02) : 163 - 178
  • [17] Probabilistic models of freeway safety performance using traffic flow data as predictors
    Golob, Thomas F.
    Recker, Will
    Pavlis, Yannis
    SAFETY SCIENCE, 2008, 46 (09) : 1306 - 1333
  • [18] Validation of probabilistic fracture models in mullite based ceramics using experimental data
    Cosp, JP
    Arenzana, JZ
    del Valle, AR
    Serrano, JCG
    EURO CERAMICS VIII, PTS 1-3, 2004, 264-268 : 1091 - 1094
  • [19] Transportation Modes Identification from Mobile Phone Data Using Probabilistic Models
    Xu, Dafeng
    Song, Guojie
    Gao, Peng
    Cao, Rongzeng
    Nie, Xinwei
    Xie, Kunqing
    ADVANCED DATA MINING AND APPLICATIONS, PT II, 2011, 7121 : 359 - +
  • [20] A data mining approach to predictive vegetation mapping using probabilistic graphical models
    Dlamini, Wisdom M.
    ECOLOGICAL INFORMATICS, 2011, 6 (02) : 111 - 124