Microsoft is enhancing its OneNote application by enabling Copilot AI to read and analyze handwritten notes. Currently, in beta testing, this feature allows users to write notes using a stylus and then use AI to summarize, generate to-do lists, and ask questions based on those notes.
Copilot AI's ability to convert handwritten notes into text is a game-changer, making editing and sharing a breeze. Initially launched within OneNote last November, this upgraded functionality will soon be available to Copilot for Microsoft 365 subscribers and Copilot Pro users, further enhancing their user experience.
In my brief testing, Copilot's ability to interpret handwriting proved to be not just good, but impressive. It successfully summarized both small and large handwritten notes, accurately rewriting a paragraph into more readable text while maintaining the original meaning. This is particularly noteworthy given the propensity of generative AI models to produce incorrect information, providing users with a reliable tool.
Copilot's new feature simplifies converting these lists into text for users who maintain handwritten to-do lists in OneNote. The AI accurately transformed a handwritten list into a text format within seconds.
However, there are concerns about how Copilot will manage abysmal handwriting. Similar features, like Samsung's Galaxy AI, often need help with deciphering the worst handwriting.
To test Copilot's handwritten note recognition, you must be a Microsoft 365 Insider running the latest OneNote on Windows build (17628.20006 or later) and have a Copilot Pro or Copilot for Microsoft 365 subscription.