====== FYP IK0903 iPhone Application with Augmented Reality ======
( [[fyp:ik0903_2009fall|2009 Fall Semester]] | **2010 Spring Semester** )
====== Title ======
iPhone Application with Augmented Reality - Picment
( Former named: Photo Earth Live )
====== People ======
Supervisor
[[king@cse.cuhk.edu.hk|Prof. KING Kuo Chin, Irwin]]
Students
[[ckkung7@cse.cuhk.edu.hk|KUNG Chun Kit]] [[syyeung7@cse.cuhk.edu.hk|YEUNG Shing Yuen]]
====== About This Application ======
====== Schedule ======
^ Weeks ^ Detail ^ Remarks ^
| Week 01 (11/01 - 18/01)| - Meeting with supervisor
- Discussion on the schedule of spring semester| / |
| Week 02 (19/01 - 25/01)| - Meeting with supervisor
- Marketing research about current available applications| / |
| Week 03 (26/01 - 01/02)| - Meeting with supervisor
- Redefine the extension part of the project| / |
| Week 04 (02/02 - 08/02)| - Meeting with supervisor
- Research on image recognization
- Reorganization of details on this wiki| / |
| Week 05 (09/02 - 15/02)| - Meeting with supervisor
- Development schedule planning
- Image comparison softwares' performance testing | / |
| Week 06 (16/02 - 22/02)| (Chinese New Year Holiday) | / |
| Week 07 (23/02 - 02/03)| - Meeting with supervisor
- Redesigning UI with experience from other apps. | / |
| Week 08 (03/03 - 09/03)|
====== Features / Work Status ======
===== Application Overview =====
^ Items ^ Expected Finish Week ^ Status ^
| Application interface design evaluate| Week 10 | In progress |
| Documentation | Week 13 - 15 | |
===== Server =====
^ Items ^ Expected Finish Week ^ Status ^
| Receiving & storing photos sent via iPhone | Week 08 | In progress |
| Retrieving GPS & compass information of photos uploaded | Week 09 | In progress |
| Sending photo requested to iPhone by geo-location | Week 10 | |
| Resizing uploaded photos | Week 11 | |
| Advertisement recognition | Week 12 | |
| Sending recognized advertisement info. to iPhone| Week 12 | |
===== Feature Coding Test =====
^ Items ^ Expected Finish Week ^ Status ^
| Upload photos to the server with geo info. | Week 08 | In progress |
| Resize photos to be uploaded | Week 08 | In progress |
| Changing the range of photos shown | Week 09 | In progress |
| In-app photo taking | Week 10 | |
| Grid view of photos in AR mode | Week 10 | |
| Edit the photos taken by iPhone inside the app | Week 10 | |
| Mapping thumbnail photos onto Google map | Week 11 | In progress |
| Switching auto/manually change the compass direction | Week 12 | |
| Switching auto/manually change the user location | Week 12 | |
| Magnify photos and display more information in AR mode when photos are selected | Week 12 | |
| Photos around are indicated by a dot | Week 13 | |
| Display information of an advertisement uploaded to the server | Week 13 | |
| Scroll left and right to see the photos around the user location
within the same direction and a standard range | Week 14 | |
| Scroll up and down to see the photos around the user location
within the same direction but different range | Week 14 | |
===== Feature Testing Screenshots =====
==== Image Comparison Programs Performance Testing ====
=== Before Testing ===
On week 4, we have found [[fyp:ik0903#image_comparison_reference|2 programs]] that should be suitable to be installed on the server for image comparison. Therefore on week 5, we tried to install the 2 programs and test their performance. By that time, we found that "[[http://linux.softpedia.com/get/Programming/Widgets/Perl-Modules/Image-Compare-43727.shtml|Compare]]" is a Perl script. Therefore we have only tested the program "[[http://www.marengo-ltd.com/open_source/index.php|jpegdiff]]".
=== Test Result ===
^ Original & Test Case^ Sample #0 ^ Sample #1 ^ Sample #2 ^ Sample #3 ^
| {{:fyp:ik0903:jpegdiff_test:original.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:0.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:1.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:2.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:3.jpg?w=120&h=160|}} |
| Fuzziness : 140 | MATCH | Do NOT Match | Do NOT Match | Do NOT Match |
| Fuzziness : 140
Night Mode ON | MATCH | Do NOT Match | Do NOT Match | Do NOT Match |
^ Original & Test Case^ Sample #4 ^ Sample #5 ^ Sample #6 ^ Sample #7 ^
| {{:fyp:ik0903:jpegdiff_test:original.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:4.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:5.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:6.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:7.jpg?w=120&h=160|}} |
| Fuzziness : 140 | Do NOT Match | Do NOT Match | Do NOT Match | Do NOT Match |
| Fuzziness : 140
Night Mode ON | Do NOT Match | Do NOT Match | Do NOT Match | Do NOT Match |
^ Original & Test Case^ Sample #8 ^ Sample #9 ^ Sample #10 ^ Sample #11 ^
| {{:fyp:ik0903:jpegdiff_test:original.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:8.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:9.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:10.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:11.jpg?w=120&h=160|}} |
| Fuzziness : 140 | Do NOT Match | Do NOT Match | Do NOT Match | MATCH |
| Fuzziness : 140
Night Mode ON | Do NOT Match | Do NOT Match | Do NOT Match | MATCH |
^ Original & Test Case^ Sample #12 ^ Sample #13 ^ Sample #14 ^ Sample #15 ^
| {{:fyp:ik0903:jpegdiff_test:original.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:12.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:13.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:14.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:15.jpg?w=120&h=160|}} |
| Fuzziness : 140 | MATCH | Do NOT Match | Do NOT Match | MATCH |
| Fuzziness : 140
Night Mode ON | MATCH | Do NOT Match | MATCH | MATCH |
^ Original & Test Case^ Sample #16 ^ Sample #17 ^ Sample #18 ^ Sample #19 ^
| {{:fyp:ik0903:jpegdiff_test:original.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:16.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:17.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:18.jpg?w=120&h=160|}} | {{:fyp:ik0903:jpegdiff_test:19.jpg?w=120&h=160|}} |
| Fuzziness : 140 | Do NOT Match | Do NOT Match | Do NOT Match | Do NOT Match |
| Fuzziness : 140
Night Mode ON | MATCH | MATCH | Do NOT Match | Do NOT Match |
===== Application Prototyping =====
===== Applications / Services Comparison ====
^ Applications | Picment | Layar | AroundMe | Leisure Guide| Acrossair |
^ Map View | ✔ | ✔ | ✔ | ✔ | ✔ |
^ Thumbnail | ✔ | | | | |
^ Augmented Reality | ✔ | ✔ | ✔ | ✔ | ✔ |
^ → pause the digital compass | ✔ | | | | |
^ → manually change the facing direction | ✔ | | | | ✔ |
^ → manually change the distance/range | ✔ | | | | |
^ → scroll up and down within the same direction | ✔ | | | | ✔ |
^ Direction (Compass)| ✔ | ✔ | ✔ | ✔ | ✔ |
^ In-app photo taking| ✔ | | | | |
^ Upload photo| ✔ | | | | |
^ Changing origin of
the viewing range | ✔ | | | | |
====== Purposed Future Features / Elements ======
Enhanced: Login system
Enhanced: Can include multimedia like sound, video and text.
Game: Treasure hunt
====== Reference ======
===== iPhone Documents Reference =====
- [[http://developer.apple.com/iphone/library/documentation/Cocoa/Conceptual/ObjectiveC/index.html#//apple_ref/doc/uid/TP30001163|The Objective-C 2.0 Programming Language]]
- [[http://developer.apple.com/iphone/library/documentation/Cocoa/Conceptual/CocoaFundamentals/index.html#//apple_ref/doc/uid/TP40002974|Cocoa Fundamentals Guide]]
- [[http://developer.apple.com/iphone/library/documentation/iPhone/Conceptual/iPhoneOSProgrammingGuide/Introduction/Introduction.html|iPhone Application Programming Guide]]
===== Image Comparison Reference =====
- [[http://www.marengo-ltd.com/open_source/index.php|Software: jpegdiff]]
- [[http://linux.softpedia.com/get/Programming/Widgets/Perl-Modules/Image-Compare-43727.shtml|Software: Compare]]