L2-constrained Softmax Loss for Discriminative Face Verification

Introduction With the recent successes in CNNs, the performance of face recognition has also benefited. A baseline for face recognition includes a sequential network and a softmax criterion. In this paper, the authors analyze some disadvantages of the softmax loss, then propose a constraint condition based softmax loss, called L2 softmax loss. Problem with softmax […]

Continue reading


Deep Learning Paper Sparks Online Feud!

Feature image is created by Jannoon028 – Freepik.com Researchers Yoav Goldberg and Yann Lecun face off on Natural Language Processing Social media is humanity’s new intellectual battlefield. Sports fans, social justice warriors, and even the President of the United States tweet, take to discussion boards or make memes to mock, preach, thrust and parry against […]

Continue reading


Failures of Deep Learning

Abstract Today, Deep Learning is being applied in many fields such as computer vision, audio and natural language processing and generation etc. Although we are pushing the limits of its performance, people should be aware that Deep Learning has its limitations. In 2015, Anh Nguyen published a paper in CVPR [1] that identified a limit […]

Continue reading


Epic’s Tim Sweeney: Deep Learning A.I. Will Open New Frontiers in Game Design

“[Video game] AI is still in the dark ages,” Epic CEO Tim Sweeney told a crowd gathered for Games Beat’s 2017 industry summit. The video game industry has witness a tremendous amount of growth, thanks to the incredible increase in computation power in terms of visual representations. Using the parallel computation ability of GPUs, powerful […]

Continue reading


How to Teach Machines to Think Like Humans

Given the task of sorting rectangular blocks by colour, an 18-month-old child can perform well due to relational reasoning — an intellectual process that helps humans find inner relationships between separate items. While humans take such an ability for granted, researchers are patiently working to instill machines with the same capability. On June 5, Google’s […]

Continue reading


Does Fitness Data Make the Average Person Healthier?

Background Today, an increasing number of people are caring more and more about their health. As a result, fitness trackers are popping up everywhere. With these handy wearable gadgets, we can now track every aspect of our health and fitness. But are they actually making a difference to the average person’s well being? Panelist: Dr. […]

Continue reading


Adversarial Generator-Encoder Networks

1. Introduction This paper proposes a new autoencoder-like generative network, called Adversarial Generator-Encoder Networks (AGE Network). This model is special because this AGE does not have any discriminators, which makes the entire architecture much simpler than some recently-proposed GANs, but with nearly the same-level performance of sample generation. 2. Methods As the figure above shows, […]

Continue reading


Customer Success with Machine Learning (Google Cloud NEXT’17)

TensorFlow is an open-source software library for machine intelligence, and have played an important role in this field since its release in 2015. To-date, more than 8,000 open source projects are using this library. The reason why TensorFlow is so widely used is due to its automatic derivation of functions and distributed computing capability, which […]

Continue reading


Exploring Sparsity in Recurrent Neural Networks

Recurrent Neural Networks (RNN) are widely used to solve a variety of problems, and as the quantity of data and the amount of available computing power have increased, so have model sizes. The number of parameters in recent state-of-the-art networks makes them hard to deploy, especially on mobile phones and embedded devices. The challenge is […]

Continue reading


C2 Montreal – Master Class with Yoshua Bengio: Know The Basics

Held May 23-25, C2 Montréal 2017 attracted over 6,000 industry participants from 50 countries. Now in its 6th year, organizers of the “immersive event” partnered with local startup Element AI to host Canada’s first Artificial Intelligence Forum and promote Montréal as a global AI hub. The keynote speakers were Professor Yoshua Bengio of the Montreal […]

Continue reading