Lets look at the challenges being faces by AI developers in training and deploying AI model and how OpenVINO and Azure IoT helps solve the problem
Challenges in training and deploying AI model
- Choosing a Neural network model
- Train/re-train till model converge (Costly and time consuming task)
- Deploying it on Edge device (IoT device's / Laptop / Desktop )
Prerequisites/System requirements - Free Subscription, Software, Hardware and setup:
- Prerequisites
- Subscription:
- Hardware (Any two of the below):
- Intel Powered IoT Device (Ex: UP2 AEEON IOT Edge device)
- Intel Powered Laptop/Desktop with Core i7/i9
- Neural Compute Stick (USB powered) acts as AI accelerator at Edge
- USB Web cam (Ex: Logitech )
- Operating System and Software (pre-installed on Host Machine):
- Setup:
- Host machine should be connected to Azure IoT Hub
- Enable xhost (ubuntu terminal command: $sudo xhost +)
Solution:
This Azure Marketplace (deploy) will make total end2end train and deploy onnx model in less than a minute. Application uses docker image built on OpenVINO with ONNX Run-time execution provider (EP)
Details: How it works:
Step 1: Training using customvision.ai in three simple steps
Details: How it works:
Step 1: Training using customvision.ai in three simple steps
- Login to customvision.ai - Upload few train samples (min 25)
- Annotate them
- Do a quick train
Step 2: Deploying OpenVINO AI Vision Module on to IoT Edge device
- Click "Get It Now" on Azure Marketplace
- Select device from IoT Hub to deploy
- Once deploy is successful - will see "OpenVINOReadyToDeployAIVisionModule" Edge module running
- Expected output: Camera stream rendering on to display
Step 3: Passing ONNX model to the app with "Twin Updates"
- 1.Copy "ONNX model URL from" -> customvision.ai -> select project -> Performance -> Export -> Click on ONNX -> Copy ONNX model URL
- Goto "portal.azure.com" -> IoT Hub -> IoT Edge -> Select device
- Click on "setmodules" -> click on -> "OpenVINOReadyToDeployAIVisionModule"
- Selecting "Twin Module Settings" -> pass "ONNX model URL path selected in step 3.1" to -> inference_files_zip_url (looks like inference_files_zip_url="onnx url path")
- Finally click "Update" and "Review+Create"
- Expected output: OpenVINO app will restart the stream and starts running inference based on the ONNX model passed (Object detection/Image classification) (Camera: Should be pointing to object/image of interest to do recognition/classifciation) Note: If no NCS2 connected, inference will start on Intel CPU
Powered by
Note:
- Setup is one time process - need some patients to go through cloud setup (if doing it first time) - Happy to answer any question - leave a comment
- Deploying (Docker pull) application will take decent time (only once per device) based on network speed
- Note: Working on making light weight docker
Lead management is a systematic process in which incoming leads are qualified, analyzed, and nurtured so that they can be converted into new business opportunities.
ReplyDeleteIn a typical sales process, leads from multiple channels enter your lead management system, and the sales-ready leads are converted into deals.
Digital Adoption Platform Software
Lead management is a systematic process in which incoming leads are qualified, analyzed, and nurtured so that they can be converted into new business opportunities.
ReplyDeleteIn a typical sales process, leads from multiple channels enter your lead management system, and the sales-ready leads are converted into deals.
Lead Management Software
HR Management Software
ReplyDeleteIT Project Management Software
ReplyDeleteIT project management software boosts efficiency by giving users the features they need to monitor and track progress and performance. This keeps their IT projects on track to meet tight schedules and budgets.
Legal case management solutions cover accounting, scheduling, time tracking, and more. All these are features that will help you manage your practice more efficiently, contribute to better cash flow management, and ease collaboration on cases. Legal Case Management Software
ReplyDeleteA channel manager is a tool that will allow you to sell all your rooms on all your connected booking sites at the same time. It will automatically update your availability in real-time on all sites when a booking is made, when you close a room to sale, or when you want to make bulk changes to your inventory.Hotel Channel Management Software
ReplyDeletePCI compliance software can help IT teams address a slew of PCI DSS requirements, including: Protecting systems against botnets, spear phishing attacks, and ransomware. Developing and maintaining secure systems and applications. Tracking and monitoring access to network resources and cardholder data.PCI Compliance Software
ReplyDeleteGST Rates 2021 for Goods and Services list of products under 0%, 5%, 12%, 18% & 28%. Check recently revised GST Rates slabs in 2020 & bracket. ... all your sales and purchase data to ClearTax GST software and file your returns. ... use our Tax Calculator software, claim HRA, check refund status and ...GST Rate Finder Software
ReplyDeleteIntegrated Risk Management Software
ReplyDeleteIntegrated risk management (IRM) is a set of practices and processes supported by a risk-aware culture and enabling technologies, that improves decision making and performance through an integrated view of how well an organization manages its unique set of risks.
Beauty Salon Management Software
ReplyDeleteSalon and Spa Management Software is designed to automate the day-to-day activities of spas, salon, and beauty parlor. It enables the salon and spa managers to run their business, manage their daily schedule, appointment booking, staff and inventory with just a click of the button.
Human Resource Information System (HRIS) is defined as a software or online solution that is used for data entry, data tracking, and data management of all human resources operations of an organization. ... An HRIS includes under its umbrella a wide range of systems.
ReplyDelete