Organizing the LSST database for real-time astronomical processing

被引:0
|
作者
Becla, Jacek [1 ]
Lim, Kian-Tat [1 ]
Monkewitz, Serge [2 ]
Nieto-Santisteban, Maria [3 ]
Thakar, Ani [3 ]
机构
[1] Stanford Linear Accelerator Ctr, 2575 Sand Hill Rd, Menlo Pk, CA 94025 USA
[2] CALTECH, Pasadena, CA 91125 USA
[3] Johns Hopkins Univ, Dept Phys & Astron, Baltimore, MD 21218 USA
关键词
D O I
暂无
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
The Large Synoptic Survey Telescope (LSST) will catalog billions of astronomical objects and trillions of sources, all of which will be stored and managed by a database management system. One of the main challenges is real-time alert generation. To generate alerts, up to 100K new difference detections have to be cross-correlated with the huge historical catalogs, and then further processed to prune false alerts. This paper explains the challenges, the implementation of the LSST Association Pipeline and the database organization strategies we are planning to use to meet the real-time requirements, including data partitioning. parallelization, and pre-loading.
引用
收藏
页码:114 / +
页数:2
相关论文
共 50 条
  • [1] RADIO ASTRONOMICAL SYNTHESIS ARRAYS - REAL-TIME PROCESSING NEEDS
    BURNS, WR
    EWING, MS
    PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1983, 431 : 41 - 47
  • [2] Commit processing in distributed real-time database systems
    Gupta, R
    Haritsa, J
    Ramamritham, K
    Seshadri, S
    17TH IEEE REAL-TIME SYSTEMS SYMPOSIUM, PROCEEDINGS, 1996, : 220 - 229
  • [3] Transaction processing in mobile real-time database systems
    Lei, XD
    Zhao, YL
    Yuan, XL
    CHINESE JOURNAL OF ELECTRONICS, 2005, 14 (03): : 491 - 494
  • [4] PROCESSING REAL-TIME TRANSACTIONS IN A REPLICATED DATABASE SYSTEM
    ULUSOY, O
    DISTRIBUTED AND PARALLEL DATABASES, 1994, 2 (04) : 405 - 436
  • [5] Secure real-time transaction processing with timeliness guarantees in mobile distributed real-time database systems
    Xiao, YY
    Liu, YS
    Liao, GQ
    Liu, XF
    PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, 2005, 3758 : 358 - 370
  • [6] Transaction processing in distributed active real-time database systems
    Ulusoy, O
    JOURNAL OF SYSTEMS AND SOFTWARE, 1998, 42 (03) : 247 - 262
  • [7] Transaction processing in mobile distributed real-time database systems
    Lei, Xiang-Dong
    Zhao, Yue-Long
    Chen, Song-Qiao
    Yuan, Xiao-Li
    Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology), 2007, 38 (06): : 1186 - 1191
  • [8] Transaction processing in distributed active real-time database systems
    Bilkent Univ, Ankara, Turkey
    J Syst Software, 3 (247-262):
  • [9] Design of data management for real-time database in processing industry
    Wang, Cheng-Guang
    Su, Hong-Ye
    Chu, Jian
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2003, 37 (02): : 134 - 138
  • [10] Transaction pre-processing in real-time main memory database
    Huazhong Univ of Science and, Technology, Wuhan, China
    Ruan Jian Xue Bao, 3 (204-209):