Generating Natural Questions About an Image
Distributed DNN platform
DNN is a really important and practical machine learning capability, this project focuses on finding solution for distributing the DNN training on a cluster of machines based on our parameter server framework. The research in…
Model Scheduling For Super Large Scale Model Training
Machine learning in this big data era is facing two challenges, one is big data, the other is big model (one machine cannot hold the entire model in runtime). In distributed machine learning, people has…
DMTK
DMTK is an open source project running in our group to share our recent research output on distributed machine learning with open source community. It contains our Multiverso parameter server platform and many of our…
Click prediction in sponsored search
Click prediction is one of the major technical parts in sponsored search which dramatically affect the overall revenue of search engine. In this project we have proposed quite a few new method and aspects to…
GPU based Linear Programming
This project is to develop a highly parallel simplex method for solving linear programming problems on top of GPU architecture
LightLDA
LightLDA is a distributed system for large scale topic modeling. It implements a distributed sampler that enables very large data sizes and models. LightLDA improves sampling throughput and convergence speed via a fast O(1) metropolis-Hastings…
Reinforcement Learning for Machine Learning
Reinforcement learning (RL) has achieved great success in video and board games. In this project, we aim at boosting machine learning algorithms and systems by leveraging reinforcement learning techniques. We focus the following aspects. First,…
Reinforcement Learning for Internet Applications
Reinforcement learning (RL) has achieved great success in video and board games, in which RL can make improvement through (almost) infinite self-play. However, different from games, in real-world applications, self-play is either impossible or costly.…
Mechanism Design For Complex Systems
We are living in and interacting with many complex systems nowadays, including the advertising system, cloud system, large scale machine learning system, and multitenancy big data system. There are multiple kinds of players with different…