Applying Occam's razor to FSMs

被引:2
作者
Núñez, M [1 ]
Rodríguez, I [1 ]
Rubio, F [1 ]
机构
[1] Univ Complutense Madrid, Fac Informat, Dept Sistemas Informat & Programac, E-28040 Madrid, Spain
来源
PROCEEDINGS OF THE THIRD IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS | 2004年
关键词
Occam's razor; Chomsky's classification; cognitive; informatics;
D O I
10.1109/COGINF.2004.1327469
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present a formal learning algorithm based both on the Occam's razor and on Chomsky's classification of languages. Since Chomsky proposes that the generation of language (and, indirectly, any mental process) can be expressed through a kind of formal language, we assume that cognitive processes can be formulated by means of the formalisms that can express those languages. We apply this idea to the simplest languages according to Chomsky's classification, the regular languages, which can be expressed by finite state machines. Besides, we apply the Occam's razor principle, which says that when data do not allow to distinguish between two theories, the simplest one should be chosen. This principle, basic in science, is implicitly applied in the human brain. We apply these concepts to construct an algorithm that provides the simplest finite state machine (that is, the simplest cognitive theory) that fits into some given world observation. Thus, the resulting machine is the most preferable theory for the observer, according to the Occam's razor criterion.
引用
收藏
页码:138 / 147
页数:10
相关论文
共 14 条
  • [1] [Anonymous], 1965, ASPECT THEORY SYNTAX
  • [2] [Anonymous], 1938, OCKHAM STUDIES SELEC
  • [3] OCCAM RAZOR
    BLUMER, A
    EHRENFEUCHT, A
    HAUSSLER, D
    WARMUTH, MK
    [J]. INFORMATION PROCESSING LETTERS, 1987, 24 (06) : 377 - 380
  • [4] Chomsky Noam, 1957, SYNTACTIC STRUCTURES
  • [5] The role of occam's razor in knowledge discovery
    Domingos, P
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 1999, 3 (04) : 409 - 425
  • [6] Fisher D., 1988, P 5 INT C MACH LEARN, P22
  • [7] Lau C, 1991, NEURAL NETWORKS THEO
  • [8] Mingers J., 1989, Machine Learning, V4, P227, DOI 10.1023/A:1022604100933
  • [9] RAO RB, 1995, P 12 INT C MACH LEAR, P471
  • [10] MODELING BY SHORTEST DATA DESCRIPTION
    RISSANEN, J
    [J]. AUTOMATICA, 1978, 14 (05) : 465 - 471