Controlling and Assisting Manual Assembly Processes by Automated Progress and Gesture Recognition

Sebastian Hogreve; Simon Kaczmarek; Jannes Adam; Linus Franz; Tim Döllen; Henning Paulus; Vincent Reinkemeyer; Kirsten Tracht

doi:10.4028/www.scientific.net/AMM.840.50

Paper Titles

Analysis and Reduction of Errors in an Automated Robot-Based Repair Process Chain
p.16

Identification of Assembly System Configuration for Cyber-Physical Assembly System Planning
p.24

Simplified Path Programming for Industrial Robots on the Basis of Path Point Projection by a Laser Source
p.33

Towards a Domain Specific Language for Sensor-Based Actions
p.42

Controlling and Assisting Manual Assembly Processes by Automated Progress and Gesture Recognition
p.50

Investigation of the Applicability of an iGPS Metrology System to Automate the Assembly in Motion of a Truck Cabin
p.58

Joining Parameters and Handling System for Automated Subpreform Assembly
p.66

Simulation-Based Control and Simulation-Based Support in eRobotics Applications
p.74

Application of Customizable Robot Assistance Systems to Compensate Age-Related Restrictions of the Musculoskeletal System for Assembly Workplaces
p.82

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vol. 840Controlling and Assisting Manual Assembly...

Controlling and Assisting Manual Assembly Processes by Automated Progress and Gesture Recognition

Abstract:

The digital progress monitoring of manual assembly processes at goods with huge dimensions is a challenging task. The paper presents an approach using 3D-image sensors for gesture control and progress recognition. The developed system is able to avoid time and effort consuming walks of workers between assembly objects and computer terminals. Progress recognition of assembly processes is realized by interpreting the movements of the workers’ hands and by detecting the passing of defined coordinates within the assembly and warehouse areas.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volume 840)

Pages:

50-57

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.840.50

Citation:

Cite this paper

Online since:

June 2016

Authors:

Sebastian Hogreve*, Simon Kaczmarek, Jannes Adam, Linus Franz, Tim Döllen, Henning Paulus, Vincent Reinkemeyer, Kirsten Tracht

Keywords:

Assembly, Gesture Control, Monitoring

Export:

RIS, BibTeX

Price:

Permissions:

Request Permissions

* - Corresponding Author

References

[1] K. Tracht, L. Funke, M. Schottmayer, Online-control of assembly processes in paced production lines, CIRP Annals – Manufacturing Technology. 64 (2015) 395-398.

DOI: 10.1016/j.cirp.2015.04.112

Google Scholar

[2] P. Menezes, F. Lerasle, J. Dias, Towards human motion capture from a camera mounted on a mobile robot, Image and Vision Computing. 29 (2001) 382-393.

DOI: 10.1016/j.imavis.2011.01.003

Google Scholar

[3] T. Dutta, Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace, Applied Ergonomics. 43 (2012) 645-649.

DOI: 10.1016/j.apergo.2011.09.011

Google Scholar

[4] L. Zhang, G. Brunnett, S. Rusdorf, Real-time human motion capture with simple marker sets and monocular video, J. Virtual Reality and Broadcasting. 8 (2011) 1.

Google Scholar

[5] R. Urtasun, D.J. Fleet, P. Fua, Temporal motion models for monocular and multiview 3D human body tracking, Computer Vision and Image Understanding. 104 (2006) 157-177.

DOI: 10.1016/j.cviu.2006.08.006

Google Scholar

[6] D. Regazzoni, G. de Vecchi, C. Rizzi, RGB cams vs RGB-D sensors: Low cost motion capture technologies performances and limitations, J. of Manuf. Sys. 33 (2014) 719-728.

DOI: 10.1016/j.jmsy.2014.07.011

Google Scholar

[7] S. Kaczmarek, S. Hogreve, K. Tracht, Progress monitoring and gesture control in manual assembly systems using 3D-image sensors, Procedia CIRP. 37 (2015) 1-6.

DOI: 10.1016/j.procir.2015.08.006

Google Scholar

[8] J. Krüger, T.D. Nguyen, Automated vision-based live ergonomics analysis in assembly operations, CIRP Annals – Manufacturing Technology. 64 (2015) 9-12.

DOI: 10.1016/j.cirp.2015.04.046

Google Scholar