Google Assistant on DragonBoard™ 410c

This Instructables will teach you to run Google Assistant in the DragonBoard and and setup an smarthome environment with some devices.

Required:

-DragonBoard™ 410c (w/ a fresh install of linaro-alip);

-12V/1A 5.5mm jack power supply;

-CC2531 zigbee module;

-HDMI monitor;

-USB mouse and keyboard;

-OSRAM LIGHTFY™ Tunable White 60 bulb;

-FLC BLE bulb;

-Yale Real Living deadbolt smart lock (w/ zigbee module);

-Host PC (w/ Windows)

In the host PC, go to the Google Cloud page and log in.

In the left menu hover the mouse over "PubSub" and click on "Topics".

Insert a project name and click on "CREATE".

Click on "Enable API".

Click on "Create a topic".

Insert a name for the topic and click on "CREATE".

Click on "CREATE SUBSCRIPTION".

Insert a name to the subscription and fill the rest as the image above shows.

Following the example, create these topics with these subscriptions:

1. BluDevCtl
   1. DashBluDevSub
   2. BluDevSub
2. ZigCtl
   1. DashZigSub
   2. ZigCtlSub

Go to Actions console page and log in with the same account used before.

Click on "Add/import project".

Select the previously created project to import and click on "IMPORT PROJECT".

On project's console click on "Device registration".

Click on "REGISTER MODEL".

Insert a name for the device, manufacturer and the device type as Speaker and click on "REGISTER MODEL".

Click on "Download OAuth 2.0 credentials" to download the client secret JSON that will be used later and click on "Next".

Only click on "SKIP".

Go to the Google Activity control page, log in with the same account as before and ensure the following toggle switches are enabled (blue):

• Web & App Activity. In addition, be sure to select the Include Chrome history and activity from sites, apps, and devices that use Google services checkbox;
• Device Information;
• Voice & Audio Activity.

Go to Google Cloud Credentials console, log in with the same account as before and click on "Create credentials".

Choose "New service account" in "Service account", insert a name for it, select "Owner" as the "Role", select JSON as the "Key type" and click on "Create".

As will click on "Create", a JSON file will be download. Save as you will need this file ahead.

Go to the Google Cloud Storage page, log in and click on "CREATE BUCKET".

The Storage is a paid service, but Google offers a free trial that has more than needed. To setup the free trial click on "Sign up for a free trial".

Select the country, accept the terms of service and click on “AGREE AND CONTINUE”.

From here you need to enter some institutional information (that vary country to country) and a credit card to be able to access the storage.

Click again on "CREATE BUCKET".

Inset a name for the bucket and fill the rest as the image above shows.

Create 3 files with these names:

• status.txt;
• statusble.txt;
• statuszgb.txt.

Upload the files dragging then to the bucket.

Wait until all files be uploaded.

Go to the Google Cloud Functions page and log in. You MUST have followed the instructions for a free trial in Step 22 to be able to create a function.

Fill the setup as the image above shows. The .zip file available to download below.

In the Function Console click on the expand icon of the inline editor.

Set the bucket variable to the name of the Bucket setted in Step 26 and click on "OK".

Click on "Deploy" to save the variable change. Wait the funciton to be deployed, and if any error appears, repeat the process again.

Go to the Dialogflow page and click on "Go to console".

Log in using the same Google account as before.

Choose a country, accept the terms of service and click on "ACCEPT".

Select the language, timezone and the Cloud project (Step 3) and click o "CREATE".

In the agent console click on the configuration icon.

Click on "Export and import".

Click on "RESTORE FROM ZIP".

Click on "SELECT FILE".

Select the .zip file available to download below, type RESTORE where it says to and click in "RESTORE".

On the agent console click on "SAVE".

Click in "Fulfillment" in the left menu.

In another tab go to the console of the previously created function and click on "Trigger".

Copy the URL and paste as the Webhook URL in the Dialogflow fulfillment setup.

To perform these steps you need a form to access the terminal of the DragonBoard. In the example, PuTTY was used on Windows to access via serial UART. Do not run any command that the tutorial shows as ROOT! If accessing the terminal via serial UART switch to user linaro as the image shows.

Command:

$ su linaro

Download the .zip in this step and extract.

Now it's time to transfer the credentials generated in the Google Cloud to the Dragonboard. It can be done in various ways. This example will use FileZila on the host machine to send the files to the Dragonboard internal memory.

In "Host" insert the DB local network IP*, the default user and password is "linaro" and the "Port" is 22.

*Run ifconfig in the terminal to discover the local IP.

$ ifconfig

Transfer the DB_GA folder to the Dragonboard in the /home/linaro/ folder.

Now transfer the credentials to the root of the DB_GA folder and rename the "client_secret_XXX.json" to "client_secret.json" and the other to "service_account_key.json".

• Run apt update;

$ sudo apt update

• Install these packages via apt: python-pip, libglib2.0-dev, swig, portaudio19-dev, libpulse-dev;

$ sudo apt install python-pip libglib2.0-dev swig portaudio19-dev libpulse-dev<br>

• Go to the “DB” folder in "DB_GA" and run this command to install pip packages;

$ sudo pip install –r requirements.txt

• Install NodeJS 8.x;

$ sudo curl -sL https://deb.nodesource.com/setup_8.x | sudo bash - 

$ sudo apt install -y nodejs=8.15.1-1nodesource1<br>

• Go to the “DB_GA/DB/zbserver” folder and run npm install.

sudo npm install

Now it's time to connect the HDMI monitor, keyboard and mouse to the DB.

In the DB Desktop enter Ctrl+Alt+T to open an terminal.

Go to the DB_GA folder:

$ cd /home/linaro/DB_GA/

Run this command:

$ sudo google-oauthlib-tool --client-secrets client_secret.json --credentials /root/.config/google-oauthlib-tool/credentials.json --scope https://www.googleapis.com/auth/assistant-sdk-prototype --save

Copy the URL that the last command outputs and paste into the DB browser and log in with the same Google account used in the entire tutorial.

Go to the DB_GA/DB/syswatch_dev/ folder:

$ cd /home/linaro/DB_GA/DB/syswatch_dev/

Connect the Zigbee Module to the DB;

Run the watch.py file:

$ sudo python watch.py