Microsoft Azure AI Document Intelligence | Merging Multiple Models | Data Extraction
People & Blogs
Introduction
In this article, we will explore how to utilize Microsoft Form Recognizer to create a more efficient and unified model by merging multiple models together. This composed model can then be integrated with Microsoft Power Apps Flow and Fabsoft's Desktop Automation Driver to develop a robust system for processing documents.
Training a New Custom Model
To begin, you will need to either have an existing project or create a new one within your Microsoft Form Recognizer environment, specifically designed for your patient registration forms project. Once the project is set up, select your desired training forms for labeling.
If you have already trained a model for a previous patient registration form template, you can leverage the existing fields and add any new fields required for the new document template. The labeling process is user-friendly and straightforward, allowing for easy data annotation.
After labeling the first page, proceed to label all other documents in your training set. Once all documents have been labeled accurately, you can initiate the training of your new model by providing it with a name and description. Select the template build mode and click "Train."
Composing Models for Enhanced Flexibility
With two different template models for the same document type processed, you can now compose them into a single model capable of efficiently handling multiple patient registration form templates. The significant advantage of composing these models is the flexibility it offers—new form templates can be easily added without having to start the training process from scratch.
Testing the composed model reveals its effectiveness in accurately extracting key information from both document formats, even when they originate from different hospitals with distinct layouts for patient registration forms.
Before proceeding, ensure that the correct resource is selected in the project settings; this can either be done by selection or by copying the key and endpoint from the resource itself. This alignment enables the model to effectively interface with the Fabsoft Desktop Automation Driver.
Automating Document Processing
Having successfully developed the composed patient registration model, it can be utilized to create a workflow within the Fabsoft Desktop Automation Driver. When a patient registration form is submitted to the driver, the associated workflow activates the Microsoft Form Recognizer model to extract key information from the document, subsequently forwarding this data to a Microsoft Power Apps Flow.
The Power Apps Flow then generates a new row of data for the submitted document in an Excel spreadsheet hosted on SharePoint. The integration of the Fabsoft Desktop Automation Driver with a Form Recognizer model simplifies the workflow process, as the information is readily acquired from the document.
Moreover, because the composed Form Recognizer model accommodates various formats of patient registration forms, the automation workflow becomes a general solution applicable to all patient registration documents.
Monitoring and Batch Processing
A notable feature of the Fabsoft Desktop Automation Driver is its capability to monitor specific directories. In this example, a folder named "Patient Registration Submissions" has been set up as a monitoring directory. Consequently, any document placed within this folder will be automatically processed by the Desktop Automation Driver. This feature allows for the rapid processing of numerous documents simultaneously.
Microsoft Form Recognizer significantly enhances the efficiency of this automated document processing system. Coupled with the Fabsoft Desktop Automation Driver and Microsoft Power Apps Flow, these tools collaborate to save businesses valuable time and labor in managing documentation.
Conclusion
In summary, the combination of Microsoft Form Recognizer, Fabsoft Desktop Automation Driver, and Microsoft Power Apps creates a powerful document processing system. This integrated approach not only facilitates the automatic extraction of key information from various document templates but also allows for seamless integration with various output locations and formats.
Keywords
- Microsoft Form Recognizer
- Fabsoft Desktop Automation Driver
- Microsoft Power Apps
- Document Processing
- Model Composition
- Data Extraction
- Workflow Integration
- Patient Registration Forms
FAQ
Q1: What is Microsoft Form Recognizer?
A1: Microsoft Form Recognizer is an AI-powered document processing service that uses machine learning technology to extract information from documents.
Q2: How do I train a custom model in Form Recognizer?
A2: You can train a custom model by creating a project, labeling your training documents, and then initiating the training process within the Microsoft Form Recognizer environment.
Q3: What is the benefit of composing multiple models?
A3: Composing multiple models allows for enhanced flexibility, enabling users to process various document formats without needing to retrain the models from scratch.
Q4: How does the Fabsoft Desktop Automation Driver work with Form Recognizer?
A4: The Fabsoft Desktop Automation Driver integrates with Form Recognizer to automatically process documents and extract key information, which can then be used in workflows like Microsoft Power Apps Flow.
Q5: Can I monitor a directory for document processing?
A5: Yes, the Fabsoft Desktop Automation Driver has the capability to monitor specific directories, allowing for automatic processing of any documents placed in those locations.
