Abstract: Traditional video monitoring system control is not flexible, processing speed is slow, and video algorithms for each video signal can not be supported in the system. A multi-channel real-time video processing and display system baesd on FPGA is proposed in this paper. A single chip FPGA hardware is used in the system to realize multi-channel video acquisition, video format conversion, video caching, algorithm processing, video splicing and information display. Video switching display and processing can be realized among multi-channel video, and the system supports different algorithms for each channel video at the same time. The parallel processing capabilities of the FPGA is used to realize real-time processing and display of 4-channel video, the frame rate is up to 15 frames per second, processing time of each video signal is less than 4ms. The proposed system has advantages of low cost, low power consumption, real-time, expansibility. And it is suitable for daily video monitoring application.