{"id":2434,"date":"2021-02-25T14:28:32","date_gmt":"2021-02-25T14:28:32","guid":{"rendered":"https:\/\/uni.hi.is\/helmut\/?p=2434"},"modified":"2021-02-27T14:50:30","modified_gmt":"2021-02-27T14:50:30","slug":"object-detection-using-neural-networks-in-your-smartphone-trained-by-a-supercomputer","status":"publish","type":"post","link":"https:\/\/uni.hi.is\/helmut\/2021\/02\/25\/object-detection-using-neural-networks-in-your-smartphone-trained-by-a-supercomputer\/","title":{"rendered":"Stafr\u00e6ni H\u00e1sk\u00f3ladagurinn 2021: Object detection using neural networks in your smartphone trained by a supercomputer"},"content":{"rendered":"

The University of Iceland's Computer Science department is researching machine learning using the next generation's supercomputer DEEP-EST<\/a> -- by the way: we are also offering a Data Science specialisation<\/a> in our Computer Science programme<\/a>, where, e.g., machine learning including deep neural networks is covered. To showcase what is possible if you have a supercomputer to train neural networks, we offer a web page that allows you to use the camera of your smartphone (or laptop) to detect objects in real-time.<\/p>\n

$\"https:\/\/nvndr.csb.app\/\"$ <\/a><\/p>\n

Just open the following web page and allow your browser to use the camera: https:\/\/nvndr.csb.app\/<\/a>
\n(Allow up to approx. 1 minute for loading the trained neural network and for initialisation. Web page works best in landscape orientation.)<\/p>\n

While neural networks are still best trained on a supercomputer, such as DEEP-EST<\/a> with its Data Analysis Module, the trained neural network even runs in the browser of a smartphone (purely running locally as Javascript in your browser without any connection to a supercomputer, i.e. completely offline after having downloaded the Javascript code and the trained neural network).\n<\/p>\n

The used approach is Single Shot Detector (SSD)<\/a> (the percentage shows how sure the neural network is about the classification) using the MobileNet neural network<\/a> architecture. The dataset used for training is COCO (Common Objects in Context), i.e. only objects of the labeled object classes contained in COCO<\/a> will get detected. The Javascript code that is running in your browser<\/a> uses Tensorflow Lite<\/a> and its Object Detection API<\/a>.<\/p>\n

$\"\"$

Example object detection via a neural network<\/p><\/div>\n

If you want learn more about the DEEP-EST project where the next generation supercomputer is developed, have a look at the poster below (click on the picture below for PDF version):<\/p>\n

$\"PDF$ <\/p>\n","protected":false},"excerpt":{"rendered":"

The University of Iceland's Computer Science department is researching machine learning using the next generation's supercomputer DEEP-EST -- by the way: we are also offering a Data Science specialisation in our Computer Science programme, where, e.g., machine learning including deep neural networks is covered. To showcase what is possible if you have a supercomputer to […]<\/p>\n","protected":false},"author":512,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[79],"tags":[],"class_list":["post-2434","post","type-post","status-publish","format-standard","hentry","category-research"],"_links":{"self":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/posts\/2434","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/users\/512"}],"replies":[{"embeddable":true,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/comments?post=2434"}],"version-history":[{"count":21,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/posts\/2434\/revisions"}],"predecessor-version":[{"id":2464,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/posts\/2434\/revisions\/2464"}],"wp:attachment":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/media?parent=2434"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/categories?post=2434"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/tags?post=2434"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}