Research on massive AIS ship data storage method based on HBase and Elasticsearch

The Automatic Identification System (AIS) for ships consists of base station facilities and onboard equipment, and is a new type of digital navigation aid that integrates network technology, modern communication technology, computer technology, and electronic information display technology. Real time collection and storage of ship AIS information can be achieved through AIS base stations and receivers. At present, the storage method of AIS data mainly relies on relational databases such as Oracle and MySQL for short-term data access, which has disadvantages such as long storage time and slow retrieval queries. In response to these problems, this paper proposes a distributed storage scheme for ship AIS data based on HBase and Elasticsearch. This scheme uses HBase as the data storage database to store complete ship data and designs the storage structure of the ship database. Based on this, Elasticsearch is used to establish a secondary index for the fields that need to be retrieved. After experiments, it was found that this scheme has better storage and retrieval efficiency than traditional methods, and can be used for daily ship data storage and query.