Large scale companies and institutions often have huge amount of electronic computing systems, these systems usually vary in hardware architecture, operating system and even network communication mode. They were built in different years, using different technology and platform, namely they are heterogeneous. How to maintain and upgrade these systems consistently is a big problem. This paper proposes a solution to solve this problem. Shows how to design and implement a software upgrade system based on Ice middleware, gives you a reference model, and we puts forward some creative ways to solve difficult problems encountered.