The smart perimeter security system can significantly increase situational awareness by combining mmWave MIMO radar for sensitive target detection, video surveillance camera with intelligent vision recognition algorithm, and smart fusion algorithm that intelligently processes data from both sensors to accurately determine intrusion events with smart target classification. Deep learning algorithm is adapted to further reduce false alerts to increase the adaptability of the device to various environments.