Project 1: Convert 2D films into 3D videos automatically or
semi-automatically
3D movies have become more and popular recently. However,
many films produced in the past 100 years are mostly made in
2D. This project is to investigate techniques to turn these 2D
films into 3D videos automatically or semi-automatically.
Students need to study the methods of 3D computer vision and
investigate different approaches to achieve the goal.
The Google glasses will become popular and should inspire a
new generation of computer vision applications. Here are some
ideas: (i) Text translation of what the user is looking at.
The idea is to develop automatic translation of what the user
is seeing. When the user is wearing Google Glasses, what he is
seeing is being captured by a camera. Using Optical character
recognition (OCR) technology, the machine can translate the
foreign texts he/she is looking at into the language he/she
understands, then displays using the Google glasses or speak
to the user through the earphones. (ii) Tourist Navigation:
Using computer vision and GPS technology, the system can
display information of the area, advertising materials etc. to
the user.
Projects for research students (PhD, Mphil, Msc), write to
me (Prof.
K.H. Wong)
if you are interested.
Computer vision based
intelligence desk development (project
webpage) : Many people are still
preferred to read printed papers and write on papers. If a
camera is hanging over a desk and monitoring the
activities on the desk, the system can store, then
translate the text into a database for later use. This
project involves the recognition of books and texts
printed on them, and locates where you finger is pointing
to for user input. We have already finished part of the
project and new students can continue what we have already
built. Requirement: Interested in computer vision
and Programming (demo)
. Demos of our similar projects can be found at
http://www.youtube.com/watch?gl=TW&hl=zh-TW&v=DDfNqXUK6Uk
3D
reconstruction
using
the KINECT sensor.: Kinect is a
new device for finding the 3D range image of an
environment in real time at a very low cost. At
CUHK, this is now being used in a number of interesting
applications, such as human counting and human tracking
for security applications. It is also be used in medical
applications, for example, it is being used to monitor the
development of new muscles of a patient after he/she has
undergone a surgery after the bad muscles have been
removed. The objective measurement can quantify the muscle
development and give advice for doctors for further
treatment. This is a collaborated project with the Prince
of Wales hospital Hong Kong. Rrequirement:
Interested in computer vision and Programming.
Music playing robot
development: A music playing robot is being developed. It
is a pioneer work of making a robot that can play the
Chinese Flute. The system integrates various mechanical
control systems to produce an air jet to blow at the
embouchure hole of a flute to emulate the way a human
flutist plays the instrument. A sound based feedback
system is implemented to make sure the sound is rich and
appealing to the ears. It is an attempt to find a new
paradigm of computer music production – that is computer
music is produced by an authentic musical instrument, but
not produced by combining pre-recorded sounds as in
previous approaches (see our demos: http://www.youtube.com/watch?v=lDSA3s55iQc,
http://www.youtube.com/watch?v=NJ7wv2z8Wgk&list=UUfy2EumiHMeoUorMFR0woZA&index=1&feature=plcp).
Requirement:
interested
in
music, programming and signal processing.
