A project that shows how to combine Microsoft's Custom Vision Service with Windows 10 Ink capabilities to create "smart ink". Analyze ink strokes and classify the shapes to identify what the user is drawing. Examples would be recoginizing product icons, technical diagrams components, etc.
Trained models can be packaged and shared as Nuget packages and shared with others.
The project is currently comprised of two parts:
This library contains the components for creating, managing, utlizing and packaging smart ink models created using the Custom Vision Service.
Test harness for interacting with Custom Vision Service to train AI models to recognize ink patterns and to map ink patterns to icons/images.
Simple demo applicaiton showing how to use two different models to understanding ink.
There are two ways to use Windows Smart Ink. The first is to use the Smart Ink Laboratory to create your own Smart Ink packages. The other is to use Smart Ink packages that have been published to Nuget for inclusion in your own application.
To create your won Smart Ink Package using the Smart Ink Laboratory, you need to use the Microsoft Custom Vision Service. After creating a Custom Vision account, follow these steps to get the environment ready for use by the Smart Ink Laboratory application.
- On the main Custom Vision page, click on New Project
- Fill out the form as shown:
Be sure to click the Create New if you want to create a new Azure Resource Group (non-trial).
- Once a new project is created, click on the Settings icon in the upper-right of the Custom Vision Service Home Page.
- Copy the Training Key and Prediction Key for use in the Smart Ink Laboratory.
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.