Skip to main content

Showing 1–17 of 17 results for author: Ngiam, J

Searching in archive cs. Search in all archives.
.
  1. arXiv:2203.08195  [pdf, other

    cs.CV

    DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection

    Authors: Yingwei Li, Adams Wei Yu, Tianjian Meng, Ben Caine, Jiquan Ngiam, Daiyi Peng, Junyang Shen, Bo Wu, Yifeng Lu, Denny Zhou, Quoc V. Le, Alan Yuille, Mingxing Tan

    Abstract: Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to existing 3D detection models, our study shows that fusing camera features with deep lidar features instead of raw points, can lead to better performance. Howev… ▽ More

    Submitted 15 March, 2022; originally announced March 2022.

    Comments: CVPR 2022. 1st rank 3D detection method on Waymo Challenge Leaderboard: https://waymo.com/open/challenges/entry/?timestamp=1647356360224524&challenge=DETECTION_3D&emailId=5451f123-a0ea

  2. arXiv:2106.13381  [pdf, other

    cs.CV

    To the Point: Efficient 3D Object Detection in the Range Image with Graph Convolution Kernels

    Authors: Yuning Chai, Pei Sun, Jiquan Ngiam, Weiyue Wang, Benjamin Caine, Vijay Vasudevan, Xiao Zhang, Dragomir Anguelov

    Abstract: 3D object detection is vital for many robotics applications. For tasks where a 2D perspective range image exists, we propose to learn a 3D representation directly from this range image view. To this end, we designed a 2D convolutional network architecture that carries the 3D spherical coordinates of each pixel throughout the network. Its layers can consume any arbitrary convolution kernel in place… ▽ More

    Submitted 24 June, 2021; originally announced June 2021.

    Journal ref: CVPR 2021

  3. arXiv:2106.08417  [pdf, other

    cs.CV cs.LG cs.RO

    Scene Transformer: A unified architecture for predicting multiple agent trajectories

    Authors: Jiquan Ngiam, Benjamin Caine, Vijay Vasudevan, Zhengdong Zhang, Hao-Tien Lewis Chiang, Jeffrey Ling, Rebecca Roelofs, Alex Bewley, Chenxi Liu, Ashish Venugopal, David Weiss, Ben Sapp, Zhifeng Chen, Jonathon Shlens

    Abstract: Predicting the motion of multiple agents is necessary for planning in dynamic environments. This task is challenging for autonomous driving since agents (e.g. vehicles and pedestrians) and their associated behaviors may be diverse and influence one another. Most prior work have focused on predicting independent futures for each agent based on all past motion, and planning against these independent… ▽ More

    Submitted 4 March, 2022; v1 submitted 15 June, 2021; originally announced June 2021.

    Comments: ICLR 2022

  4. arXiv:2104.10133  [pdf, other

    cs.CV cs.LG cs.RO

    Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset

    Authors: Scott Ettinger, Shuyang Cheng, Benjamin Caine, Chenxi Liu, Hang Zhao, Sabeek Pradhan, Yuning Chai, Ben Sapp, Charles Qi, Yin Zhou, Zoey Yang, Aurelien Chouard, Pei Sun, Jiquan Ngiam, Vijay Vasudevan, Alexander McCauley, Jonathon Shlens, Dragomir Anguelov

    Abstract: As autonomous driving systems mature, motion forecasting has received increasing attention as a critical requirement for planning. Of particular importance are interactive situations such as merges, unprotected turns, etc., where predicting individual object motion is not sufficient. Joint predictions of multiple objects are required for effective route planning. There has been a critical need for… ▽ More

    Submitted 20 April, 2021; originally announced April 2021.

    Comments: 15 pages, 10 figures

  5. arXiv:2103.16054  [pdf, other

    cs.CV

    3D-MAN: 3D Multi-frame Attention Network for Object Detection

    Authors: Zetong Yang, Yin Zhou, Zhifeng Chen, Jiquan Ngiam

    Abstract: 3D object detection is an important module in autonomous driving and robotics. However, many existing methods focus on using single frames to perform 3D detection, and do not fully utilize information from multiple frames. In this paper, we present 3D-MAN: a 3D multi-frame attention network that effectively aggregates features from multiple perspectives and achieves state-of-the-art performance on… ▽ More

    Submitted 29 March, 2021; originally announced March 2021.

  6. arXiv:2103.02093  [pdf, other

    cs.CV cs.LG

    Pseudo-labeling for Scalable 3D Object Detection

    Authors: Benjamin Caine, Rebecca Roelofs, Vijay Vasudevan, Jiquan Ngiam, Yuning Chai, Zhifeng Chen, Jonathon Shlens

    Abstract: To safely deploy autonomous vehicles, onboard perception systems must work reliably at high accuracy across a diverse set of environments and geographies. One of the most common techniques to improve the efficacy of such systems in new domains involves collecting large labeled datasets, but such datasets can be extremely costly to obtain, especially if each new deployment geography requires additi… ▽ More

    Submitted 2 March, 2021; originally announced March 2021.

  7. arXiv:2010.06808  [pdf, other

    cs.LG cs.CV

    Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout

    Authors: Zhao Chen, Jiquan Ngiam, Yanping Huang, Thang Luong, Henrik Kretzschmar, Yuning Chai, Dragomir Anguelov

    Abstract: The vast majority of deep models use multiple gradient signals, typically corresponding to a sum of multiple loss terms, to update a shared set of trainable weights. However, these multiple updates can impede optimal training by pulling the model in conflicting directions. We present Gradient Sign Dropout (GradDrop), a probabilistic masking procedure which samples gradients at an activation layer… ▽ More

    Submitted 14 October, 2020; originally announced October 2020.

    Comments: Conference on Neural Information Processing Systems (NeurIPS) 2020

  8. arXiv:2005.01864  [pdf, other

    cs.CV

    Streaming Object Detection for 3-D Point Clouds

    Authors: Wei Han, Zhengdong Zhang, Benjamin Caine, Brandon Yang, Christoph Sprunk, Ouais Alsharif, Jiquan Ngiam, Vijay Vasudevan, Jonathon Shlens, Zhifeng Chen

    Abstract: Autonomous vehicles operate in a dynamic environment, where the speed with which a vehicle can perceive and react impacts the safety and efficacy of the system. LiDAR provides a prominent sensory modality that informs many existing perceptual systems including object detection, segmentation, motion estimation, and action recognition. The latency for perceptual systems based on point cloud data can… ▽ More

    Submitted 4 May, 2020; originally announced May 2020.

  9. arXiv:2004.00831  [pdf, other

    cs.CV

    Improving 3D Object Detection through Progressive Population Based Augmentation

    Authors: Shuyang Cheng, Zhaoqi Leng, Ekin Dogus Cubuk, Barret Zoph, Chunyan Bai, Jiquan Ngiam, Yang Song, Benjamin Caine, Vijay Vasudevan, Congcong Li, Quoc V. Le, Jonathon Shlens, Dragomir Anguelov

    Abstract: Data augmentation has been widely adopted for object detection in 3D point clouds. However, all previous related efforts have focused on manually designing specific data augmentation methods for individual architectures. In this work, we present the first attempt to automate the design of data augmentation policies for 3D object detection. We introduce the Progressive Population Based Augmentation… ▽ More

    Submitted 16 July, 2020; v1 submitted 2 April, 2020; originally announced April 2020.

    Comments: Accepted at ECCV 2020

  10. arXiv:1912.04838  [pdf, other

    cs.CV cs.LG stat.ML

    Scalability in Perception for Autonomous Driving: Waymo Open Dataset

    Authors: Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla, Aurelien Chouard, Vijaysai Patnaik, Paul Tsui, James Guo, Yin Zhou, Yuning Chai, Benjamin Caine, Vijay Vasudevan, Wei Han, Jiquan Ngiam, Hang Zhao, Aleksei Timofeev, Scott Ettinger, Maxim Krivokon, Amy Gao, Aditya Joshi, Sheng Zhao, Shuyang Cheng, Yu Zhang, Jonathon Shlens, Zhifeng Chen, Dragomir Anguelov

    Abstract: The research community has increasing interest in autonomous driving research, despite the resource intensity of obtaining representative real world data. Existing self-driving datasets are limited in the scale and variation of the environments they capture, even though generalization within and between operating regions is crucial to the overall viability of the technology. In an effort to help a… ▽ More

    Submitted 12 May, 2020; v1 submitted 10 December, 2019; originally announced December 2019.

    Comments: CVPR 2020

  11. arXiv:1910.06528  [pdf, other

    cs.CV

    End-to-End Multi-View Fusion for 3D Object Detection in LiDAR Point Clouds

    Authors: Yin Zhou, Pei Sun, Yu Zhang, Dragomir Anguelov, Jiyang Gao, Tom Ouyang, James Guo, Jiquan Ngiam, Vijay Vasudevan

    Abstract: Recent work on 3D object detection advocates point cloud voxelization in birds-eye view, where objects preserve their physical dimensions and are naturally separable. When represented in this view, however, point clouds are sparse and have highly variable point density, which may cause detectors difficulties in detecting distant or small objects (pedestrians, traffic signs, etc.). On the other han… ▽ More

    Submitted 23 October, 2019; v1 submitted 15 October, 2019; originally announced October 2019.

    Comments: CoRL2019

  12. arXiv:1908.11069  [pdf, other

    cs.CV

    StarNet: Targeted Computation for Object Detection in Point Clouds

    Authors: Jiquan Ngiam, Benjamin Caine, Wei Han, Brandon Yang, Yuning Chai, Pei Sun, Yin Zhou, Xi Yi, Ouais Alsharif, Patrick Nguyen, Zhifeng Chen, Jonathon Shlens, Vijay Vasudevan

    Abstract: Detecting objects from LiDAR point clouds is an important component of self-driving car technology as LiDAR provides high resolution spatial information. Previous work on point-cloud 3D object detection has re-purposed convolutional approaches from traditional camera imagery. In this work, we present an object detection system called StarNet designed specifically to take advantage of the sparse an… ▽ More

    Submitted 2 December, 2019; v1 submitted 29 August, 2019; originally announced August 2019.

  13. arXiv:1908.10940  [pdf, other

    cs.CL cs.LG

    Learning a Multi-Domain Curriculum for Neural Machine Translation

    Authors: Wei Wang, Ye Tian, Jiquan Ngiam, Yinfei Yang, Isaac Caswell, Zarana Parekh

    Abstract: Most data selection research in machine translation focuses on improving a single domain. We perform data selection for multiple domains at once. This is achieved by carefully introducing instance-level domain-relevance features and automatically constructing a training curriculum to gradually concentrate on multi-domain relevant and noise-reduced data batches. Both the choice of features and the… ▽ More

    Submitted 1 May, 2020; v1 submitted 28 August, 2019; originally announced August 2019.

    Comments: Accepted at ACL2020

  14. arXiv:1904.10076  [pdf, other

    cs.CV cs.LG

    Using Videos to Evaluate Image Model Robustness

    Authors: Keren Gu, Brandon Yang, Jiquan Ngiam, Quoc Le, Jonathon Shlens

    Abstract: Human visual systems are robust to a wide range of image transformations that are challenging for artificial networks. We present the first study of image model robustness to the minute transformations found across video frames, which we term "natural robustness". Compared to previous studies on adversarial examples and synthetic distortions, natural robustness captures a more diverse set of commo… ▽ More

    Submitted 29 August, 2019; v1 submitted 22 April, 2019; originally announced April 2019.

    Comments: Video Robustness Dataset included in directory

  15. arXiv:1904.04971  [pdf, other

    cs.CV cs.AI cs.LG

    CondConv: Conditionally Parameterized Convolutions for Efficient Inference

    Authors: Brandon Yang, Gabriel Bender, Quoc V. Le, Jiquan Ngiam

    Abstract: Convolutional layers are one of the basic building blocks of modern deep neural networks. One fundamental assumption is that convolutional kernels should be shared for all examples in a dataset. We propose conditionally parameterized convolutions (CondConv), which learn specialized convolutional kernels for each example. Replacing normal convolutions with CondConv enables us to increase the size a… ▽ More

    Submitted 3 September, 2020; v1 submitted 9 April, 2019; originally announced April 2019.

    Journal ref: NeurIPS 2019

  16. arXiv:1811.07056  [pdf, other

    cs.CV cs.LG

    Domain Adaptive Transfer Learning with Specialist Models

    Authors: Jiquan Ngiam, Daiyi Peng, Vijay Vasudevan, Simon Kornblith, Quoc V. Le, Ruoming Pang

    Abstract: Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training data does not always help, and transfer performance depends on a judicious choice of pre-training data. These findings are important given the continued increase i… ▽ More

    Submitted 11 December, 2018; v1 submitted 16 November, 2018; originally announced November 2018.

  17. arXiv:1811.06965  [pdf, other

    cs.CV

    GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism

    Authors: Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Mia Xu Chen, Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V. Le, Yonghui Wu, Zhifeng Chen

    Abstract: Scaling up deep neural network capacity has been known as an effective approach to improving model quality for several different machine learning tasks. In many cases, increasing model capacity beyond the memory limit of a single accelerator has required developing special algorithms or infrastructure. These solutions are often architecture-specific and do not transfer to other tasks. To address t… ▽ More

    Submitted 25 July, 2019; v1 submitted 16 November, 2018; originally announced November 2018.

    Comments: 11 pages. Work in progress. Copyright 2018 by the authors