Microsoft has revamped its MMLSpark open source project, the better to integrate “many deep learning and data science tools to the Spark ecosystem,” according to the notes on the project repository.
MMLSpark, originally released last year, is a collection of projects intended to make Spark more useful in many contexts—mainly machine learning, but also in some general-purpose ways.
Some of MMLSpark’s features integrate Spark with Microsoft machine learning offerings such as the Microsoft Cognitive Toolkit (CNTK) and LightGBM, as well as with third-party projects such as OpenCV.
