Using ViewModels in Android to preserve your running app’s state

Articles

In my previous blog on using Room with Android, I outlined how one can use Room to effectively store app data after a user has exited your app for a better user experience. If you haven’t read this blog, you can read it here:

But what about cases where your app is running and its state is changed—for example, when the phone’s orientation is changed from portrait to landscape and vice versa?

Continue reading “Using ViewModels in Android to preserve your running app’s state”

Real-Time 3D Object Detection on Mobile Devices with MediaPipe

Articles

Object detection has always been one of the most extensively studied problems in computer vision. Being one of the most basic and rudimentary forms of detection, and unparalleled in its usefulness, object detection has been used in many commercial computer vision based applications.

However, recently some light has been shed on an earlier oversight, which is now leading to an entirely new set of problems in the relatively mature field.

Continue reading “Real-Time 3D Object Detection on Mobile Devices with MediaPipe”

Looking at Post Effects in Lens Studio

Articles

Lens Studio enables you to add visible effects such as Analog Tv, Pixelization, and Color Correction Post Effect which improves the nature of your lenses. The Post Effects are built-in Lens Studio and therefore free to use. In this article, we will look at how you can add Post Effects and Color Correction Effects and how they can be modified to achieve the outcome that you want.

Let’s get started!

Continue reading “Looking at Post Effects in Lens Studio”

Building a Custom Glasses Snapchat Lens with Fritz AI and Lens Studio — Zero Code Involved

Articles
Computer Vision — SnapML Introduction

A few weeks ago, Snapchat released a new feature where AI developers can easily integrate their own custom models — one of these features is the ability to segment regions of the view and project fun and immersive AR effects. We’ll cover this ML task in this article.

Lens Studio, an augmented reality creativity suite released by Snapchat in 2017, gives users the opportunity to create their own augmented reality (AR) Lenses.

Continue reading “Building a Custom Glasses Snapchat Lens with Fritz AI and Lens Studio — Zero Code Involved”

Getting Started with Face Landmark Detection in the Browser with TensorFlow.JS

Articles

In this tutorial, our work on implementing various demo apps using the TensorFlow.js library continues. In the most recent tutorial on using TensorFlow.js, we detected a specific hand gesture—a “thumbs-up” pose using the handpose library.

This tutorial is going to demonstrate similar logic for detecting the keypoints of a full face mesh using the facemesh model library.

Specifically, we’ll learn how to detect face poses using the webcam and then draw the facial landmarks that make up a face mesh, using path and triangular face data matrices. The idea is to create a React app with a webcam stream that feeds the video data to the model, allowing it to make keypoint predictions.

Continue reading “Getting Started with Face Landmark Detection in the Browser with TensorFlow.JS”

PyTorch Mobile: Image Classification on iOS

Articles

PyTorch is one of the most sought-after deep learning frameworks. It has its own advantages over the other widely used frameworks like TensorFlow (here’s a great comparison of these two frameworks). Facebook recently released PyTorch 1.3 and plugged the missing piece of the pie in their framework—which is, mobile support for Android and iOS.

Up until now, the two most used mobile machine learning frameworks were Apple’s Core ML and Google’s TensorFlow Lite. So PyTorch’s entry into the mobile domain should be an interesting one. It’ll get a tough challenge from Core ML, but considering the cross-platform support, PyTorch will likely carve out its own space.

Continue reading “PyTorch Mobile: Image Classification on iOS”

Research Guide for Transformers

Articles

Transformers are a type of neural network used in neural machine translation, which mainly involves tasks that transform an input sequence to an output sequence. Such tasks include speech recognition and text-to-speech transformation, just to mention a few.

These kinds of tasks require memory—the upcoming sentence has to work with some context from the previous sentence. This is quite critical so as not to lose any important context between sentences.

Until recently, recurrent neural networks (RNNs) and convolutional neural networks (CNNs) have been used to tackle this challenge. The problem with these is that they aren’t able to keep up with context and content when sentences are too long.

Continue reading “Research Guide for Transformers”