Research
For a full list of publications click here.
For the below publications, click on each for the project page and paper.
Sim-to-Real Transfer for Optical Tactile Sensing
Zihan Ding, Nathan Lepora, and Edward Johns
ICRA 2020
Mini Abstract We train a TacTip optical tactile sensor to detect edge positions and orientations. Training is done with simulated data using a soft-body model, and transfer to the real world is achieved by randomising simulator parameters. Real-world tests show that edge positions can be predicted with an error of less than 1mm.
Constrained-Space Optimization and Reinforcement Learning for Complex Tasks
Ya-Yen Tsai, Bo Xiao, Edward Johns, and Guang-Zhong Yang
RA-Letters and ICRA 2020
Mini Abstract We train a robot to perform a complex sewing task. Human demonstrations are used to create a constrained space, and reinforcement learning in simulation optimises a trajectory by exploring this space. Real-world experiments show that this optimised trajectory is superior to any one of the individual demonstrations.
Self-supervised Generalisation with Meta Auxiliary Learning
Shikun Liu, Andrew Davison, and Edward Johns
NeurIPS 2019
Mini Abstract We train a CNN for image recognition, using automatically-generated auxiliary labels. A second CNN generates these auxiliary labels using meta learning, by encouraging labels which assist the primary task. Experiments show that the performance on the primary task is as good as using human-defined auxiliary labels.
End-to-End Multi-Task Learning with Attention
Shikun Liu, Edward Johns, and Andrew Davison
CVPR 2019
Mini Abstract We train a multi-task CNN which can share features across different tasks. A common trunk of features is learned, and each task applies a soft attention mask to the common pool, where the attention masks are learned end-to-end. Our method achieves state-of-the-art performance on dense image prediction.
Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Task
Stephen James, Andrew J. Davison, and Edward Johns
CoRL 2017
Mini Abstract We train an end-to-end robot controller to grasp a cube from multiple positions, and drop it into a basket. Training is done in simulation with behavioural cloning, and is transferred to the real world with domain randomisation. In real-world experiments, we show robustness to distractor objects and illumination changes.
Deep Learning a Grasp Function for Grasping under Gripper Pose Uncertainty
Edward Johns, Stefan Leutenegger, and Andrew Davison
IROS 2016
Mini Abstract We train a robot to grasp novel objects using depth images. Data is collected in simulation by attempting grasps across a wide range of objects. A CNN is trained to predict the grasp quality across a regular grid of gripper poses, which is combined with the gripper's pose uncertainty to create a robust grasp.
Pairwise Decomposition of Image Sequences for Active Multi-View Recognition
Edward Johns, Stefan Leutenegger, and Andrew Davison