 |
Final Posting
Posted on July 12, 2018. Please check main page on detailed evaluation metrics.
Final Ranking on GPU Platform
| Rank | Team Name | Measured IoU | Power | FPS | Real IoU | ES | TS (Final score) |
| 1 | ICT-CAS | 0.6975 | 12577 | 24.55 | 0.6975 | 0.969504536 | 1.373729414 |
| 2 | DeepZ | 0.6911 | 13271 | 25.3 | 0.6911 | 0.967453023 | 1.359706784 |
| 3 | SDU-legend | 0.6847 | 10308 | 23.64 | 0.6847 | 0.983504261 | 1.358105368 |
| 4 | XJTU-IAIR-Falcon | 0.6763 | 8619 | 24.15 | 0.6763 | 1.0009017 | 1.353209819 |
| 5 | anonymous | 0.6479 | 11245 | 21.08 | 0.6479 | 0.965991878 | 1.273766138 |
| 6 | anonymous | 0.6317 | 12713 | 24.67 | 0.6317 | 0.968993869 | 1.243813427 |
| 7 | anonymous | 0.6286 | 14109 | 23.55 | 0.6286 | 0.955908584 | 1.229484136 |
| 8 | anonymous | 0.6292 | 9531 | 19.67 | 0.6188182 | 0.975787954 | 1.222653545 |
| 9 | anonymous | 0.5515 | 9174 | 21.55 | 0.5515 | 0.985587356 | 1.095051427 |
| 10 | anonymous | 0.4613 | 4834 | 20.97 | 0.4613 | 1.038868006 | 0.940529811 |
| 11 | anonymous | 0.5429 | 5008 | 15.87 | 0.43079115 | 1.031682784 | 0.875230963 |
| 12 | anonymous | 0.4229 | 6175 | 23.78 | 0.4229 | 1.028524626 | 0.857863065 |
| 13 | anonymous | 0.6059 | 8203 | 12 | 0.36354 | 0.988821106 | 0.723016025 |
| 14 | anonymous | 0.2687 | 8853 | 31.9 | 0.2687 | 1.022749692 | 0.543512842 |
| 15 | anonymous | 0.2049 | 5226 | 46.52 | 0.2049 | 1.101303709 | 0.43055713 |
| 16 | anonymous | 0.1921 | 6379 | 24 | 0.1921 | 1.026501377 | 0.389290914 |
| 17 | anonymous | 0.2608 | 7942 | 12.86 | 0.1676944 | 0.991629671 | 0.333985143 |
| 18 | anonymous | 0.5369 | 5439 | 5.21 | 0.13986245 | 1.024511836 | 0.283153185 |
| 19 | anonymous | 0.1552 | 7889 | 14.95 | 0.116012 | 0.992211257 | 0.231120412 |
| 20 | anonymous | 0.2465 | 5390 | 6.5 | 0.0801125 | 1.025297895 | 0.162251678 |
| 21 | anonymous | 0.0728 | 6972 | 31.6 | 0.0728 | 1.04267559 | 0.148706783 |
Final Ranking on FPGA Platform
| Rank | Team Name | Measured IoU | Power | FPS | Real IoU | ES | TS (Final score) |
| 1 | TGIIF | 0.623798 | 4.2 | 11.9553 | 0.623798 | 1.031858706 | 1.267469397 |
| 2 | SystemsETHZ | 0.491926 | 2.45 | 25.9678 | 0.491926 | 1.397615426 | 1.179449366 |
| 3 | iSmart2 | 0.5733 | 2.59 | 7.3488 | 0.5733 | 1.02976763 | 1.163665782 |
| 4 | traix | 0.610656 | 3.11 | 5.4448 | 0.610656 | 0.886937833 | 1.15226991 |
| 5 | hwac_object_tracker | 0.520074 | 3.66 | 4.9354 | 0.513354644 | 0.81551284 | 0.932001948 |
| 6 | anonymous | 0.208425 | 2.75 | 15.6059 | 0.208425 | 1.231575241 | 0.46511607 |
| 7 | anonymous | 0.2148419 | 2.38 | 5.4547 | 0.2148419 | 0.965427063 | 0.422256085 |
May Posting
Posted on May 09, 2018. Please check main page on detailed evaluation metrics.
Top Three Designs on GPU Platform
| Team Name | Measured IoU | Power (mW) | FPS | ES | True IoU | TS (Final score) |
| ICT-CAS | 0.6764 | 9364 | 24.97 | 0.993284 | 0.6764 | 1.348258 |
| DeepZ | 0.6759 | 10148 | 20.13 | 0.967586 | 0.6759 | 1.329891 |
| CARES | 0.6315 | 10543 | 25.84 | 0.985959 | 0.6315 | 1.254133 |
Top Three Designs on FPGA Platform
| Team Name | Measured IoU | Power (mW) | FPS | ES | True IoU | TS (Final score) |
| SystemsETHZ | 0.42 | 2350 | 12.99 | 1.127 | 0.42 | 0.893 |
| LiLou | 0.11 | 2350 | 5.27 | 0.875 | 0.11 | 0.206 |
| Qiu's Team | 0.09 | 2360 | 9.7 | 1.059 | 0.09 | 0.185 |
April Posting
Posted on Apr. 16, 2018. Please check main page on detailed evaluation metrics.
Top Three Designs on GPU Platform
| Team Name | Measured IoU | Power (mW) | FPS | ES | True IoU | TS (Final score) |
| DeepZ | 0.668800 | 9860 | 20.802100 | 0.963561 | 0.668800 | 1.313230 |
| CARES | 0.566400 | 4943 | 23.382600 | 1.033696 | 0.566400 | 1.151885 |
| DeepHUST | 0.553556 | 6927 | 20.644330 | 0.993566 | 0.553556 | 1.103551 |
Top Three Designs on FPGA Platform
| Team Name | Measured IoU | Power (mW) | FPS | ES | True IoU | TS (Final score) |
| iSmart2 | 0.266 | 2340 | 13.4 | 1.13 | 0.266 | 0.56 |
| Traix | 0.137 | 2170 | 25.6 | 1.23 | 0.137 | 0.30 |
| Lilou | 0.086 | 2350 | 5.89 | 0.81 | 0.086 | 0.16 |
March Posting
Posted on Mar. 12, 2018. Please check main page on detailed evaluation metrics.
Top Three Designs on GPU Platform
| Team Name | Measured IoU | Power (mW) | FPS | True IoU | TS (Final score) |
| DeepZ | 0.65033601 | 5435 | 19.9386 | 0.64834 | 1.2601 |
| SkyNet | 0.472236914 | 3058 | 13.3003 | 0.31404 | 0.62606 |
| USL-TAMU | 0.476465427 | 3068 | 12.2867 | 0.29271 | 0.58344 |
Top Three Designs on FPGA Platform
N/A
February Posting
Posted on Feb. 19, 2018. Please check main page on detailed evaluation metrics.
Top Three Designs on GPU Platform
| Team Name | IoU | Power (mW) | TS (Final score) |
| DeepZ | 0.62 | 2754 | 0.74 |
| USL-TAMU | 0.48 | 1622 | 0.32 |
| CIG-UIUC | 0.41 | 966 | 0.16 |
Top Three Designs on FPGA Platform
N/A
Back to main page.