FS Studio brings the future of play to life

Editor’s Note: We are excited to introduce FS Studio as a new certified ARTIK partner! FS Studio is a advanced technology studio that helps companies realize their ideas into products. With an expertise in embedded systems, FS Studio builds systems that integrate next-generation technologies like natural language interface, machine learning, computer vision and more. Recently they developed a proof-of-concept to show how Samsung ARTIK™ can enhance traditional objects into smart applications. Read their story below.

THE FUTURE OF PLAY?

Our Space Battle opens up a new frontier in the exploration for the most exciting interactive toys

ju5d4602

What’s the future of play? How are advances in engineering changing the world of game design and toys? In an age of touch screens, 3D graphics and augmented reality, it goes without saying that our children are already assimilated to the connected world. I recently spoke to a curator for a children’s museum who reiterated the importance of promoting interactivity in design for educational curriculum to keep up with the pace of entertainment and other media that increasingly make fractal claims on our children’s attention.

“If they can’t touch it and have the object respond,” she told me, “as far as they’re concerned, it’s a poster.”

Introducing SPACE BATTLE, a smart toy we’re excited to debut on the Samsung ARTIK platform. By all appearances, SPACE BATTLE looks like a regular spaceship, but it comes equipped with the latest capabilities in AI. An optical sensor uses computer vision and a DeepNet neural network to respond to objects in its environment. We also introduce an engaging story line that facilitates participation and wonder. In other words, the toy plays with you. Demonstrated at the Korea Electronic Show and the IoT Israel Summit last month, SPACE BATTLE is able to identify and respond to “enemy” and “foe” objects in its environment as it flies through “space.”

How did we do it?

For the toy to be feasible, it had to run a real-time image recognition process that works on low-powered devices. That’s where ARTIK comes in. Powered by the ARTIK 1020 module, the octa-core processor and flash storage gave SPACE BATTLE all the performance room it needed to come alive in your hands.

At our workstation, we began by building a dataset of tens of thousands of images, both real and synthetically produced. Then we undertook the task of “training” our neural network by rotating and randomly moving each image against different backgrounds. To provide context and improve accuracy, we added a number of layers for object classification. The goal, of course, is to train the system with all the subtleties, such as natural lighting, backlighting, and shadows.

Then we introduced other deep learning techniques to optimize performance, tweaking as we went along the various training hyperparameters (mini-batch size, number of training iterations, step size, alpha, etc.) We verified our results by simulating trials, but also through brute force of manual testing in the real world. This is decidedly qualitative, but it’s the best overall measure of our success.

ju5d4202

The Result

The result? We have a highly accurate real-time image recognition system that works offline on highly constrained devices. Do you want to add hand signals to a camera to control camera functionality? Do you want to add event triggers to low-cost toys?

Every day here at FS Studio, we try to tackle the challenges of the next generation toy. Every day we play Geppetto to our clients’ Pinnochio, trying to conjure something unique and alive out of a magical block of talking wood (in this case, plastic and silicon chips). For us, the future of play is here.