Today's case for AI at the edge

Display portlet menu

Today's case for AI at the edge for engineers

person touching globe with finger

Artificial intelligence (AI) might feel far away, but many of us experience AI every single day in applications like speech to text virtual assistance or fingerprint recognition on smartphones. AI capabilities in IoT applications help to identify patterns and detect variations in IoT edge devices carrying sensors for environmental parameters like temperature or pressure.

Traditionally, simple embedded edge devices collect this data from sensors in the application environment and stream the data to AI systems built on cloud infrastructures to perform analytics and draw inferences. Yet, as the need for real-time decision making in IoT implementations grows, so do connectivity or processing needs—and it is not always possible to stream all data to the cloud for AI processing. This paper will discuss how deploying AI at the edge can improve the efficiency and cost-effectiveness of IoT implementations.

 

How to deploy AI at the edge

The basic components of a typical edge AI model include both the hardware and software for capturing sensor data, software for training the model for application scenarios as well as the application software that runs the AI model on the IoT device.

A micro-service software that is running on the edge device is responsible for initiating the AI package residing on the edge device upon request by the user. Within the edge device, the feature selections and transformations defined during the training phase are used. The models are customized to the appropriate feature set, which can be extended to include aggregations and engineered features.

Intelligent edge devices are deployed in battery operated applications in areas with low bandwidth and intermittent network connectivity. Edge device manufacturers are building sensors with integrated processing and memory capabilities and widely used low-speed communication protocols like BLE, Lora, and NB-IoT in tiny footprints and low power consumption.

 

The benefits of AI at the edge

While the complexity of such designs may make the edge expensive, the benefits far outweigh the related costs.

Apart from being highly responsive in real time, edge-based AI has significant advantages such as greater security built into the edge devices and lesser data flowing up and down the network. It is highly flexible, as customized solutions are built for each application. Since the inferences are pre-built into the edge devices, it needs fewer skills to operate and maintain.

Edge computing also allows developers to distribute computing across the network by transferring some sophisticated activities to edge processors in the local network like routers, gateways, and servers. They provide very good operational reliability as data is stored and intelligence is derived locally helping deployment in areas of intermittent connectivity or without a network connection.

Ordinarily, building a machine learning model to solve a challenge is complex. Developers have to manage vast amounts of data for model training, choose the best algorithm to implement, and manage the cloud services to train the model. Application developers then deploy the model into a production environment using programming languages like Python. The smart edge device manufacturer will find it extremely difficult to invest in resources to execute an AI implementation on edge from scratch.

Learn more with our AI at the Edge whitepaper for engineers

Related Articles
man wearing virtual reality headset with graphic overlays
How LoRaWAN and AI at the Edge Revolutionize the IoT
January 3, 2020
Learn how LoRaWAN and artificial intelligence (AI) at the edge can revolutionize the internet of things by reducing data transmission and improving latency.
A group of colleagues working in a computer security room having a discussion
Avnet and Microsoft Azure Sphere: IoT security in hardware, software and at the edge
March 5, 2019
IoT has transformed various industries by automating them at large, but the security concerns associated are just as large as the market opportunity this technology presents. That’s where Azure Sphere comes in.
A doctor writing on a clipboard
How AI-powered virtual assistants can transform healthcare
February 26, 2019
We have witnessed a paradigm shift in the way patients are being treated by the doctors with the help of AI and machine learning.
field of zeros and ones with shadow of letters AI in center
AGI, artificial general intelligence, the AI bubble and more: Q&A with Toby Walsh
February 25, 2019
We sat down with "rock start of AI" Toby Walsh to talk about the buzz around AI, how far true intelligence really is and how to operationalize AI today for benefits in your business tomorrow.
shopping cart in grocery store
4 ways AI connects retailers and customers
February 25, 2019
Technologies like machine learning and AI help retailers to process massive amounts of customer data. And with this data in hand, retailers can thoroughly understand their customers’ buying behavior.
computer monitor in factory
How leading manufacturing companies are reaping various benefits of AI
February 25, 2019
Manufacturing companies are applying AI-powered analytics for multiple use cases, such as, cutting unplanned downtime, better product designing, increasing product quality, ensuring employee safety, and many more.
depiction of brain surrounded by icons
The rise of machine intelligence in the AI era
February 24, 2019
Whether you know it or not, this technology has a lot of potential to deal with business-specific challenges and the benefits of deep learning outnumber its drawbacks.
man using tablet computer in industrial setting
5 of the best artificial intelligence use cases
January 3, 2019
AI’s upgraded algorithms make predictive analytics, parse data, and help businesses make smarter decisions from the boardroom to the factory floor.
group of young people wearing virtual reality headsets
Top 6 Trends: Get ready to meet the demand for IoT solutions
December 11, 2018
Gartner predicts that in less than two years, more than 20 billion Internet of Things (IoT) devices will be deployed. Here are the top six technology trends to ensure your IoT strategies are successful.
Person going through security using IoT-enabled thumbprint scanning technology
2018 Was IoT’s Breakout Year
December 11, 2018
From connected devices at home to security cameras and sensors in factories, the acceleration of IoT in 2018 has ignited the imagination and pushed product development in new directions.
Doctor checking on a patient from a remote patient monitoring device -- artificial intelligence
AI From A-Z: The biggest buzzwords around artificial intelligence
November 28, 2018
Companies across markets from consumer electronics to factory floors are finding power in the introduction of two letters: AI (artificial intelligence).
electronic circuit board
Increasingly powerful chips driving artificial intelligence
November 13, 2018
AI-supported applications must keep pace with rapidly growing data volumes and often have to respond simultaneously in real time. The classic CPUs that you will find in every computer quickly reach their limits in this area because they process tasks
Edge AI robotic hand using laptop
IoT at the Edge: How AI Will Transform IoT Architecture
By Lou Lutostanski   -   October 26, 2018
Futurists say artificial intelligence (AI) and the Internet of Things (IoT) will transform business and society more profoundly than the industrial and digital revolutions combined, and we’re now starting to see how that world might shape up.
Bill Amelio
Learning to utilize the benefits of Artificial Intelligence
May 30, 2018
Learn about the impact of Artificial Intelligence (AI) and the market opportunities it presents.
Bill Amelio
As technology reshapes our world, ecosystems reshape our business models
By Bill Amelio   -   April 25, 2018
See why businesses are now increasingly reliant on formal structures that tap into the power of partnership - “the company you keep.”
Related Events
Ultra96 Technical Training Courses
Date: April 29, 2019
Location: Multiple Locations