CNTK Library Evaluation Overview

Overview

The CNTK Library API allows to evaluate both the CNTK model-v1 and model-V2 format. The CNTK Library is currently available in C++ and Python (on Windows and Linux). The C# library for evaluation is currently being developed and will be available soon.

New features of the CNTK Library for Evaluation include

• Support both CPU and GPU device.
• Support evaluation of multiple evaluation requests in parallel by multi-threading.
• Share model parameters among multiple threads if the same model is loaded. This could significantly reduce memory usage when running evaluation in a service environment.

The following pages provide detailed information about model evaluation using CNTK Library.

• CNTK-library evaluation on Windows
• CNTK-library evaluation on Linux
• CNTK-library evaluation with Python