Scalable and Deep Anomaly Detection from Big Data with Similarity Hashing

Anomaly detection, aiming to identify anomalous but insightful patterns in data mining, is an important big data analytics technique. The nature of big data requires a detection method that can handle fast-evolving data of diverse types. However, existing methods suffer from either high computational cost or low detection performance. This project aims to develop a detection framework to advance detection performance and efficiency, based on a novel deep learning model called deep isolation forest which is different from the traditional artificial neural network based models. The outcome will bring huge benefits to various applications such as real-time predictive maintenance in smart manufacturing, and intrusion detection in cybersecurity.