Skip to main content

Posts

Showing posts from July, 2019

Post-training Quantization for Edge TPU

In Tensorflow website, there is quite a bit of explanation for post-training quantization  but there is not much on transfer learning. The sample shown on Coral website is using Tensorflow 1.x and requires to execute the transfer learning inside a docker. In this blog post, I am going to demonstrate on how to perform post-training quantization using Tensorflow 2.0 for Mobilenet V1 and V2. All the steps can be performed on Colab notebook (thus making use of free GPU from Google, Thank you Google!!!). The steps are almost the same for both versions except at the base model I have changed the model. The tflite model is then converted to Edge TPU tflite model which can be used for realtime inferencing. For both the models, I am using the flower dataset to perform the transfer learning. Readers can use this as a base for another class of classification. In the future blog post, I may try more advanced models such as Inception, Resnet etc. A lot depends on the Edge TPU compiler because t

SiPeed AI at the Edge

Edge AI looks like going to be the next big things. In this blog post, I am going to introduce a very cheap and yet power AI chip based on Kendryte K210. K210 is based on open source RISC-V instructions set. According to Wikipedia ,  RISC-V  started in 2010 and in the recent 2 years, actual chips are produced with prototyping boards. A few China companies have started to build prototyping kits around this chip. One of these company is SiPeed . They have produced a few form factors of prototyping board and I have gotten hold of the Maixpy GO board. The Maixpy Go has the following features: 2.8 inch touch LCD Camera TF card slot Mic RGB LED Speaker WIFI Rechargeable battery Powered via USB C. The USB-C also act as Uart for transferring of codes and flashing of firmware. There are a few ways to program the kit, micropython, Arduino IDE or Platform IO. For micropython, there is Maixpy IDE which is a port of OpenMV IDE. Sipeed also has 2 interesting peripherals, m

Transfer Learning (Image Classification) in Colab for Edge TPU

Most visual deep learning applications used an existing model and performed transfer learning to classify the images or detect the objects within the image. To use the Coral USB accelerator for these operations, the model has to be converted to Tensorflow lite model and then to model understood by Edge TPU. There is a good article on model optimisation  but for this blog post, I am using the Quantization Aware approach for the transfer learning. In Google example, it is required to install a docker and perform the transfer learning within docker. In this blog post, I have moved the retraining process to Colab and only the final step of converting to Edge TPU format is done on the local machine.