Skip to main content

Google Cloud IoTCore with UDOO Quad

UDOO Quad is a maker SBC board from UDOO. It has a built-in Arduino microcontroller and can run Linux on the SBC. On the web, most of the Google IoT Core samples have been focused using Mongoose OS and I have written a post on "Journey into Google Cloud IoT Core with ESP8266 and Mongoose OS". Recently, Google releases code samples which make the initial handshaking with Cloud IoTCore simpler.  For UDOO, the tedious part is to get all supporting tools to work with a particular version of Linux Distribution.

UDOO supports a few Linux distributions (Ubuntu, Debian and others). I have installed Ubuntu and the current version supported by UDOO is 14.04 LTS. For this demo, I wanted to work on Python 3.5 and I have compiled the Python from source. This is step may not be necessary if you use the version that is installed (Python 3.4).

The idea for this project is to read the temperature and humidity reading from UDOO Arduino side, transfer the data to Linux side and forward the data to Google IoTCore. The data is streaming into BigQuery and finally displayed on Google Data Studio. The following are the stages:
    1. UDOO Arduino to read from DHT11
    2. Transfer the data to UDOO Linux core via serial.
    3. A python script reads the data and put it into Cloud MQTT.
    4. Cloud IoTCore reads the data and pushes it to Pub/Sub.
    5. Pub/Sub triggers a Cloud Function that appends the data to BigQuery.
    6. Data Studio displayed the data on the chart.
Data Flow from UDOO to Google Cloud

Components Setup

Setting up UDOO to access Google Cloud Platform (GCP)

  1. Install Google cloud SDK and setting a GCP Project.   
  2. Install the Python requirements. Please refer to Github for the Python libraries to be installed.

Setting up IoTCore, Cloud Functions and BigQuery

There are a couple of steps involved in this setup. Firstly for the IoTCore, setting up Google IotCore by following the instructions. IoTCore will create 2 Pub/Sub topics, one for Telemetry Data and the other for State.

Create and configure the Cloud Function to be triggered by the telemetry data topics. The Cloud Function will insert the data into Big Query.
Next, create a Big Query dataset IoTDemo01 and within the dataset, create a table weather. The schema for the table is as shown. For the Big Query schema, normally I will create the column attributes as String. The reason is to prevent failure when inserting and this can be cleanup later or transform using the Big Query SQL.
The source code for the above is available at GitHub. It also contains a simple Arduino sketch t read data from DHT11.

To execute the code at the shell, the following command is used. Replace the data in the [] with your project id and registry id.

python3 cloudiot_mqtt.py --project_id [project id] --registry_id [registry id] 
--device_id udoo_quad_01 --private_key_file ./key/ec_private.pem  --algorithm ES256 
--cloud_region asia-east1 --ca_certs ./key/roots.pem

Presenting the Data in Google Data Studio

Finally, after making sure that the data are correctly inserting into Big Query, the final stage is to display the data on a Dashboard. Google Data Studio is a very powerful tool which has a connector that can directly connect to Big Query.



Here is the live link which shows hourly average temperature and humidity.

Concluding Thoughts

UDOO Quad is quite a powerful SBC. Technically, installed with Ubuntu, it is capable to connect to GCP directly and insert the data into Big Query using Cloud SDK. The advantage of using Cloud IoTCore is the ability to manage all the devices using a single dashboard. The sending of data back to the devices using Cloud IoTCore will be another feature which will be described in future post

Comments

Popular posts from this blog

Using ESP-Link transparent bridge (ESP-01 and Arduino Pro Mini)

Recently stumbled across an interesting open source project ESP-Link . Its main purpose is to network-enable a non-network microcontroller (MCU) such as Arduino Uno, Pro mini or Nano using ESP8266. The author termed it as "Transparent Bridge". The ESP and MCU  communicate via the serial link and there is a companion Arduino library EL-Client  for the MCU to connect up the network using MQTT, REST, TCP and UDP. Setup I have put together an ESP-01 and an Arduino Pro Mini for this experiment. I have chosen a 3.3 version Pro mini so that I do not need to do any voltage level shifting between the I/O pins. In order to have a stable voltage source, the ESP8266 is powered by Pro Mini and the Pro Mini "RAW" pin is connected to a 5v USB power source. The RAW pin can take voltage up to 12V. The reset pin of Pro Mini is connected to GPIO 0 of ESP-01. This enables the ESP-01 to reset the Pro Mini.   I have linked up an APDS 9960 sensor to it and periodically se

DIY Sonoff RF Bridge

Tasmota recently supported the RF bridge by iTead which allowed for RF 433 remote devices to be controlled/controlling using Sonoff products. e.g A handphone can be used to control a remote RF device or an RF remote control can use to control a WIFI enabled device. By using Tasmota, I can control the device using MQTT. This idea fits exactly to my smart home plan. Here is the schematic: I cheated a bit by having ESP01 mounted on a breakout board. This breakout board converts all the external pins to 5v which simplified the wiring and I do not need to use a voltage level shifter. Moreover, the Arduino 3.3v power does not have enough current to power the ESP reliably and I have to power it via the 5V from Arduino Uno. Next, I used an Arduino Uno prototype shield with a tiny breadboard to hold all the components together. For the RF 433 transmitter/receiver, I am using the development kits when I purchased the all-in-one Arduino development kits. An antenna is added for more sensi

Using ESP-Link transparent bridge (ATmega2560+ESP8266 board)

I have found this interesting board selling on Aliexpress website. It is an Arduino Mega 2650 with a built-in ESP8266 which allows the Mega to connect to wifi. This board has cut down a lot of wiring and bring out interesting possibilities. One of this is to connect up both the microcontrollers using ESP-link firmware. I have an earlier blog post  that described how to wire up an ESP-01 and Arduino Pro Mini. One of the tricky parts in this setup is the sequence of flashing the ESP firmware. Flashing the onboard ESP8266 requires some setting changes to the dip switches. The following are the sequences which I get both the microcontrollers to talk to each other. Set the jumper 5,6,7 to ON and the rest OFF. This will set the ESP to update mode. I am using version 3.0.14  and flashed the ESP using the following parameters: esptool --port com26 --baud 230400 write_flash -fm dio -fs 4MB -ff 80m 0x0 boot_v1.6.bin 0x1000 user1.bin 0x3fc000 esp_init_data_default.bin 0x3fe0