PAR Government Systems Corporation (PGSC) has recently developed a complete activity detection and tracking system using standard NTSC Video or Infrared (IR) camera inputs. The inputs are processed using state-of-the-art signal processing hardware and software developed specifically for real-time applications. The system automatically detects and tracks moving objects in video or infrared imagery. Algorithms to automatically detect and track moving objects were implemented and ported to a C80 based DSP board for real-time operation. The real-time embedded software performs: 1) Video/IR frame registration to compensate for sensor motion, jitter, and panning 2) Moving target detection and track formation 3) Symbology overlays The hardware components are PC based COGS which include a high speed DSP board for real-time video/IR data collection and processing. The system can be used for a variety of detection and tracking purposes including border surveillance, perimeter surveillance including building, airport, correctional facilities, and other areas requiring detection and tracking of intruders. The system was designed, built and tested in 1998 by PAR Government Systems Corporation, La Jolla, CA. This paper adresses the algorithms (Registration, Tracking, Outputs) as well as hardware used to port the algorithms (C80 DSP board) for real-time processing.