With the Google Assistant SDK, you can embed the Google Assistant into your
own project, making it function similarly to a Google Home. However, your project
may have unique hardware capabilities that Google Home does not have: for
example, it may have a unique LED display with customizable brightness and
color settings.
Device Actions are a set of tools and APIs that allow you to extend what
the Assistant can do, in the projects you develop, to take full potential of
their hardware capabilities.
Built-in Device Actions
Google has created a wide range of common built-in device actions for everyday
things, including lights, appliances, and cameras. With these actions, you can
harness the power of the Google Assistant's natural language processing to
control your project. For example, a project with a light can be turned on in
different ways:
- Ok Google, turn on the light.
- Hey Google, turn my light on.
- Ok Google, turn on my living room light.
You can create your own project that responds to commands for
many
smart home traits
like:
- Ok Google, set the brightness to 50%.
- Hey Google, set the temperature to 98 degrees.
Custom Device Actions
You can also create custom device actions for your own unique hardware. For these
actions, you define the grammar and commands:
- Ok Google, blink my light 5 times.
- Hey Google, move left.
Learn more about incorporating these actions using the
Google Assistant service
.
How it works
The device has the Google Assistant SDK installed on it along with credentials for
accessing the Google Assistant Service. The device sends out the spoken request
(
Turn on.
) and asks the service to turn on the device's onboard LED.
The device also sends its model and device instance identifiers so the service
can determine how to best respond in context to the request.
The service uses Automatic Speech Recognition (ASR) to determine what words were
spoken by the user, Natural Language Processing (NLP) to analyze and understand
the meaning of the request from these words, and device matching to provide context
for the request. This context is important because it defines the actions the
device supports and how these actions should be fulfilled.
The service then responds with text that is spoken back to the user (
Sure.
)
along with the device-specific command. The device knows how to handle this
command: it turns on its LED!
Get started
Bring your ideas to life by embedding the Google Assistant
into your project and then adding unique functionality with Device
Actions. You can develop your project
using the Google Assistant service
.