|
1 | 1 | # 3D Object Tracking |
2 | 2 |
|
3 | | -Tracking a rigid object in 3D space and determining its 6DoF pose is an essential task in computer vision. Its application ranges from augmented reality to robotic perception. Given consecutive image frames and a 3D model of the object, the goal is to robustly estimate both the rotation and translation of a known object relative to the camera. While the problem has been thoroughly studied, many challenges such as partial occlusions, appearance changes, motion blur, background clutter, and real-time requirements still exist. |
| 3 | +Tracking objects and kinematic structures in 3D space and determining their poses and configurations is an essential task in computer vision. Its application ranges from augmented reality to robotic perception. Given consecutive image frames, as well as 3D meshes and kinematic information, the goal is to robustly estimate the rotation and translation of all bodies relative to a camera. While the problem has been thoroughly studied, many challenges such as partial occlusions, appearance changes, motion blur, background clutter, object ambiguity, and real-time requirements still exist. |
4 | 4 |
|
5 | | -In this repository, we will continuously publish algorithms and code of our ongoing research on 3D object tracking. The folders for the different algorithms include everything necessary to reproduce results presented in our papers. Note that the code for each new paper also includes an updated version of previous work. If you want to use our tracker in your own project or application, please use the code from the latest publication. Currently, the latest version of our code can be found in the folder [__ICG__](https://github.com/DLR-RM/3DObjectTracking/tree/master/ICG). |
| 5 | +In this repository, we will continuously publish algorithms and code of our ongoing research on 3D object tracking. The folders for the different algorithms include everything necessary to reproduce results presented in our papers. Note that the code for each new paper also includes an updated version of previous work. If you want to use our tracker in your own project or application, please use the code from the latest publication. Currently, the latest version of our code can be found in the folder [__M3T__](https://github.com/DLR-RM/3DObjectTracking/tree/master/M3T). |
6 | 6 |
|
7 | | -The algorithms corresponding to the following papers are included: |
| 7 | + |
| 8 | +## Algorithms |
8 | 9 | * [__RBGT__](https://github.com/DLR-RM/3DObjectTracking/tree/master/RBGT) |
9 | 10 | Stoiber M, Pfanne M, Strobl KH, Triebel R, Albu-Schäffer A (2020) A Sparse Gaussian Approach to Region-Based 6DoF Object Tracking. In: Asian Conference on Computer Vision |
10 | 11 | * [__SRT3D__](https://github.com/DLR-RM/3DObjectTracking/tree/master/SRT3D) |
11 | 12 | Stoiber M, Pfanne M, Strobl KH, Triebel R, Albu-Schäffer A (2022) SRT3D: A Sparse Region-Based 3D Object Tracking Approach for the Real World. In: International Journal of Computer Vision |
12 | 13 | * [__ICG__](https://github.com/DLR-RM/3DObjectTracking/tree/master/ICG) |
13 | 14 | Stoiber M, Sundermeyer M, Triebel R (2022) Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objects. In: Conference on Computer Vision and Pattern Recognition |
| 15 | +* [__ICG+__](https://github.com/DLR-RM/3DObjectTracking/tree/master/ICG+) |
| 16 | +Manuel Stoiber, Mariam Elsayed, Anne E. Reichert, Florian Steidle, Dongheui Lee, and Rudolph Triebel (2023) Fusing Visual Appearance and Geometry for Multi-modality 6DoF Object Tracking. Submitted to: IEEE/RSJ International Conference on Intelligent Robots 2023 |
14 | 17 | * [__Mb-ICG__](https://github.com/DLR-RM/3DObjectTracking/tree/master/Mb-ICG) |
15 | | -Stoiber M, Sundermeyer M, Boerdijk W, Triebel R (2022) A Multi-body Tracking Framework - From Rigid Objects to Kinematic Structures |
| 18 | +Stoiber M, Sundermeyer M, Boerdijk W, Triebel R (2023) A Multi-body Tracking Framework - From Rigid Objects to Kinematic Structures. Submitted to: IEEE Transactions on Pattern Analysis and Machine Intelligence |
| 19 | +* [__M3T__](https://github.com/DLR-RM/3DObjectTracking/tree/master/M3T) |
| 20 | +Stoiber M (2023) Closing the Loop: 3D Object Tracking for Advanced Robotic Manipulation. Dissertation submitted to the Technical University of Munich |
| 21 | + |
| 22 | + |
| 23 | +## Videos |
| 24 | + |
| 25 | +<a href="https://youtu.be/0ORZvDDbDjA"> |
| 26 | +<p align="center"> |
| 27 | + <img src="Mb-ICG/dlr_mb_icg_real_world.png" width=500> |
| 28 | + <br> |
| 29 | + <em>A Multi-body Tracking Framework - From Rigid Objects to Kinematic Structures</em> |
| 30 | +</p> |
| 31 | +</a> |
| 32 | + |
| 33 | +<a href="https://www.youtube.com/watch?v=NfNzxXupX54"> |
| 34 | +<p align="center"> |
| 35 | + <img src="ICG+/dlr_icg+_video.png" width=500> |
| 36 | + <br> |
| 37 | + <em>Fusing Visual Appearance and Geometry for Multi-Modality 6DoF Object Tracking</em> |
| 38 | +</p> |
| 39 | +</a> |
| 40 | + |
| 41 | +<a href="https://www.youtube.com/watch?v=eYd_3TnJIaE"> |
| 42 | +<p align="center"> |
| 43 | + <img src="ICG/dlr_icg_video_presentation.png" width=500> |
| 44 | + <br> |
| 45 | + <em>Presentation CVPR 2022</em> |
| 46 | +</p> |
| 47 | +</a> |
| 48 | + |
| 49 | +<a href="https://youtu.be/qMr1RHCsnDk"> |
| 50 | +<p align="center"> |
| 51 | + <img src="ICG/dlr_icg_video_real-world.png" width=500> |
| 52 | + <br> |
| 53 | + <em>Iterative Corresponding Geometry</em> |
| 54 | +</p> |
| 55 | +</a> |
| 56 | + |
| 57 | +<a href="https://www.youtube.com/watch?v=Y-nFAuElE1I&ab_channel=DLRRMC"> |
| 58 | +<p align="center"> |
| 59 | + <img src="RBGT/dlr_thumbnail_video_oral.png" width=500> |
| 60 | + <br> |
| 61 | + <em>Oral Presentation ACCV 2020</em> |
| 62 | +</p> |
| 63 | +</a> |
| 64 | + |
| 65 | +<a href="https://www.youtube.com/watch?v=lwhxSRpwn3Y&ab_channel=DLRRMC"> |
| 66 | +<p align="center"> |
| 67 | + <img src="RBGT/dlr_thumbnail_video_real-world.png" width=500> |
| 68 | + <br> |
| 69 | + <em>A Sparse Gaussian Approach to Region-Based 6DoF Object Tracking</em> |
| 70 | +</p> |
| 71 | +</a> |
16 | 72 |
|
| 73 | +<a href="https://www.youtube.com/watch?v=TkS0Wkd_0lA&ab_channel=DLRRMC"> |
| 74 | +<p align="center"> |
| 75 | + <img src="RBGT/dlr_thumbnail_video_rbot.png" width=500> |
| 76 | + <br> |
| 77 | + <em>A Sparse Gaussian Approach to Region-Based 6DoF Object Tracking</em> |
| 78 | +</p> |
| 79 | +</a> |
0 commit comments