{"id":2784,"date":"2024-01-08T15:52:24","date_gmt":"2024-01-08T14:52:24","guid":{"rendered":"https:\/\/sites.unica.it\/net4u\/?p=2784"},"modified":"2025-08-27T14:44:00","modified_gmt":"2025-08-27T12:44:00","slug":"confront-challenge-on-wifi-frame-fingerprinting-for-people-counting-and-trackingconfront","status":"publish","type":"post","link":"https:\/\/sites.unica.it\/net4u\/confront-challenge-on-wifi-frame-fingerprinting-for-people-counting-and-trackingconfront\/","title":{"rendered":"CONFRONT &#8211; Challenge ON wifi FRame fingerprinting for people cOunting aNd Tracking"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\">Results<\/h3>\n\n\n\n<p>We have finally released the results of the challenge CONFRONT \u2013 \u201cChallenge ON wifi FRame fingerprinting for people cOunting aNd Tracking\u201d.<\/p>\n\n\n\n<p>Seven international research groups participated by applying their own algorithm to our dataset.<\/p>\n\n\n\n<p>We are very happy now to share the news that the winner is Tom\u00e1s Santos (Iscte &#8211; Instituto Universit\u00e1rio de Lisboa, Portugal). The second place was achieved by Ale\u0161 Simon\u010di\u010d (Jo\u017eef Stefan Institute, Slovenia).<\/p>\n\n\n\n<p>We thank all the participants for competing in our challenge:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Abhishek Mishra (Privatics \/ Inria Lyon, France)<\/li>\n\n\n\n<li>Ale\u0161 Simon\u010di\u010d (Jo\u017eef Stefan Institute, Slovenia)<\/li>\n\n\n\n<li>Diego Gasco (Polytechnic of Turin, Italy)<\/li>\n\n\n\n<li>Giuseppe Perrone (Polytechnic of Turin, Italy)<\/li>\n\n\n\n<li>Tom\u00e1s Santos (Iscte &#8211; Instituto Universit\u00e1rio de Lisboa, Portugal)<\/li>\n\n\n\n<li>2 members of an IT company in Germany<\/li>\n<\/ul>\n\n\n\n<p>The results will be presented during the <a href=\"https:\/\/www.eucnc.eu\/\" target=\"_blank\" rel=\"noreferrer noopener\">2024 EuCNC &amp; 6G Summit<\/a> in Antwerp (Belgium) at the beginning of June. This activity has been funded by <a href=\"https:\/\/www.centronazionalemost.it\/\" target=\"_blank\" rel=\"noreferrer noopener\">MOST<\/a>.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Background<\/h3>\n\n\n\n<p>The widespread use of personal mobile devices, including tablets and smartphones, created new opportunities for collecting comprehensive data on individual movements within cities while preserving their anonymity. Extensive research focused on turning personal mobile devices into tools for measuring human presence. To protect privacy, the data collected must be anonymous or pseudo-anonymous, leading to the preference for management data.<\/p>\n\n\n\n<p>A common approach involves analysing probe requests, which are Wi-Fi protocol messages transmitted by mobile devices while searching for access points. These messages contain media access control (MAC) addresses, which used to be unique identifiers. To safeguard the privacy of smartphone users, Google, Apple, and Microsoft have implemented algorithms that generate random MAC addresses, which change often and unpredictably.<\/p>\n\n\n\n<p>This challenge focuses on the problem of fingerprinting Wi-Fi devices by analysing management messages to overcome previous methods that relied on the MAC address and became obsolete. Detecting messages from the same source allows counting the devices in an area, calculating their permanence, and approximating these metrics with the ones of the humans carrying them.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Challenge<\/h3>\n\n\n\n<p>The Challenge consists of three tasks:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Task A<\/strong>: you must use a file obtained by merging individual device captures (capture_A.pcap). We will tell you the number of devices but not which are the sources of the individual probes. The output required from you is a CSV file with two columns: the IDs of the samples and the labels. If you wish to discard some samples you have to use -1 as label.<\/li>\n\n\n\n<li><strong>Task B<\/strong>: you must use a file obtained by merging individual captures (capture_B.pcap).&nbsp; You won\u2019t know the number of devices neither the sources of the individual probes. The output you will give us is a CSV file with two columns: the IDs of the samples and labels. &nbsp;If you wish to discard some samples you have to use -1 as label.<\/li>\n\n\n\n<li><strong>Task C<\/strong>: you must use a file obtained by sniffing a group of devices inside the anechoic chamber (capture_C.pcap). The output you will give us is the number of devices and discarded samples.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Registration<\/h3>\n\n\n\n<p>To participate in the challenge, you must register by 20th January 2024 via the following <a href=\"https:\/\/forms.gle\/o94RUMjK32LhKUec9\" target=\"_blank\" rel=\"noreferrer noopener\">link<\/a>. <\/p>\n\n\n\n<p>Groups or individuals may participate.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Timeline<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>2024 January 20<sup>th<\/sup> &#8211; registration<\/li>\n\n\n\n<li>2024 January 31<sup>st<\/sup> &#8211; transmission of the dataset<\/li>\n\n\n\n<li>2024 March 15<sup>th<\/sup> &#8211; deadline for the transmission of obtained results<\/li>\n\n\n\n<li>2024 March 20<sup>th<\/sup> &#8211; ranking publication<\/li>\n\n\n\n<li>2024 March 29<sup>th<\/sup> &#8211; paper submission<\/li>\n\n\n\n<li>2024 April 8<sup>th<\/sup> &#8211; paper-acceptance notification<\/li>\n\n\n\n<li>2024 April 12<sup>th<\/sup> &#8211; deadline for final version of the papers<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Dataset<\/h3>\n\n\n\n<p>The dataset provided for the challenge will consist of 3 files containing Wi-Fi probe requests. It will only be sent to those who register by the deadline. However, you can download two complete examples of captures in pcap format and the requested output in the following <a href=\"https:\/\/drive.google.com\/drive\/folders\/12HuR_Mw2L0UufEekAmKHASPI-Xnhb4O8?usp=sharing\" target=\"_blank\" rel=\"noreferrer noopener\">link<\/a>.<\/p>\n\n\n\n<p>The probe requests in the example files will differ from those in the challenge tasks since they will be collected at different times and with different devices.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Evaluation<\/h3>\n\n\n\n<p>Every task will be evaluated with a score between 0 and 100. The score in Tasks 1 and 2 will be calculated as the v-measure multiplied by the percentage of discarded samples. The score in Task 3 will be calculated as the percentage error multiplied by the percentage of discarded samples. The total score will be the sum of the task scores.<\/p>\n\n\n\n<p class=\"has-text-align-center\"><em>score<sub>tot<\/sub> = score<sub>1<\/sub> + score<sub>2<\/sub> + score<sub>3<\/sub><\/em><\/p>\n\n\n\n<p class=\"has-text-align-center\"><em>score<sub>1<\/sub> = v<sub>measure<\/sub> x discarded<sub>%<\/sub><\/em><\/p>\n\n\n\n<p class=\"has-text-align-center\"><em>score<sub>2<\/sub> = v<sub>measure<\/sub> x discarded<sub>%<\/sub><\/em><\/p>\n\n\n\n<p class=\"has-text-align-center\"><em>score<sub>3<\/sub> = error<sub>%<\/sub> x discarded<sub>%<\/sub><\/em><\/p>\n\n\n\n<p>The <em>v<sub>measure<\/sub><\/em> is calculated as follows:<\/p>\n\n\n\n<p class=\"has-text-align-center\"><em>v<sub>measure<\/sub> = ((1 + beta) x homogeneity x completeness ) \/ ((beta x homogeneity) + completeness) <\/em><\/p>\n\n\n\n<p>Where beta&nbsp;is a ratio of weight attributed to homogeneity versus completeness and is set to 1. The <em>homogeneity<\/em> is a metric to evaluate how clusters calculated by an algorithm contain only samples which are members of a single class. This metric is independent of the absolute values of the labels: a permutation of the class or cluster label values won\u2019t change the score value in any way. Homogeneity is not symmetric: switching the true labels with the predicted labels will return the <em>completeness<\/em> score which might be different in general. More details about the  <em>v<sub>measure<\/sub><\/em> can be found in \u201cV-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure\u201d by Rosenberg and Hirschberg (EMNLP-CoNLL 2007).<\/p>\n\n\n\n<p>The discaded percentage is calculated as the ratio between the number of samples and the number of discarded samples multiplied by 100. The percentage error is calculated as follows:<\/p>\n\n\n\n<p class=\"has-text-align-center\"><em>error<sub>%<\/sub> = (|devices<sub>estimated<\/sub> &#8211; devices<sub>real<\/sub>|) <em>x 100<\/em><\/em> <em>\/ devices<sub>real<\/sub> <\/em><\/p>\n\n\n\n<p>The scores will be published on this website. &nbsp;All teams will be invited by email to write a paper containing the methodologies used to achieve that score.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Conference<\/h3>\n\n\n\n<p>We are in the process of organizing a special session at the EuCNC &amp; 6G Summit 2024 conference. All teams will have the opportunity to publish a paper with the methodology used to achieve their results in this special session. These papers will be reviewed by our committee. Accepted papers will be part of the Conference Proceedings, but they will not be submitted to IEEE Xplore.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Organisers<\/h3>\n\n\n\n<p><strong><a href=\"https:\/\/sites.unica.it\/net4u\/luigi-atzori\/\" data-type=\"post\" data-id=\"1492\">Luigi Atzori<\/a><\/strong> is a Full Professor at the Department of Electrical and Electronic Engineering at the University of Cagliari (Italy), where he leads the activities of the Networks for Humans laboratory. His research interests are in multimedia communications and computer networking, with emphasis on multimedia QoE, multimedia streaming, NGN service management, service management in wireless sensor networks, architecture and services in the Internet of Things. Luigi Atzori has been the coordinator of the Marie Curie Initial Training Network on QoE for multimedia services (2015-2018), involving ten European Institutions in Europe and one in South Korea. He has been the associate editor for major journals, including ACM\/Springer Wireless Networks, IEEE IoT Journal, Elsevier Ad Hoc Networks, and Advances on Multimedia. He has been the guest editor for the IEEE Communications Magazine, the Springer Monet Journal, and the Elsevier Signal Processing: Image Communications Journal. He is currently the associate editor of the Digital Communications and Networks and the IEEE Open Journal of the Communications Society.<\/p>\n\n\n\n<p><strong><a href=\"https:\/\/sites.unica.it\/net4u\/lucia-pintor\/\" data-type=\"post\" data-id=\"1617\">Lucia Pintor<\/a><\/strong> has been a researcher at the Italian National Inter-University Consortium for Telecommunications (CNIT &#8211; Consorzio Nazionale Interuniversitario per le Telecomunicazioni) since November 2023. She is also a PhD student at the University of Cagliari, where she also worked as a researcher from 2018. Her research concerns mobility as a service (MaaS) and methods to anonymously track the flows of people moving in a Smart City. In the last years, she specialised in the fingerprinting of Wi-Fi devices through the analysis of management messages with the aim of tracking mobile devices. She also has experience in modeling and developing web platforms, APIs, and user interfaces.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Contacts<\/h3>\n\n\n\n<p>lucia.pintor[at]unica.it<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Acknowledgements<\/h3>\n\n\n\n<p>This challenge is partially supported by the European Union under the Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU, \u201cSustainable Mobility Center\u201d (Centro Nazionale per la Mobilit\u00e0 Sostenibile), CNMS, CN 00000023.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"412\" height=\"291\" src=\"https:\/\/sites.unica.it\/net4u\/files\/2024\/01\/MOST_logo.png\" alt=\"\" class=\"wp-image-2804\" style=\"width:234px;height:auto\" srcset=\"https:\/\/sites.unica.it\/net4u\/files\/2024\/01\/MOST_logo.png 412w, https:\/\/sites.unica.it\/net4u\/files\/2024\/01\/MOST_logo-300x212.png 300w, https:\/\/sites.unica.it\/net4u\/files\/2024\/01\/MOST_logo-250x177.png 250w\" sizes=\"auto, (max-width: 412px) 100vw, 412px\" \/><\/figure><\/div>","protected":false},"excerpt":{"rendered":"<p>Results We have finally released the results of the challenge CONFRONT \u2013 \u201cChallenge ON wifi FRame fingerprinting for people cOunting aNd Tracking\u201d. Seven international research groups participated by applying their own algorithm to our dataset. We are very happy now to share the news that the winner is Tom\u00e1s Santos (Iscte &#8211; Instituto Universit\u00e1rio de&hellip;&nbsp;<a href=\"https:\/\/sites.unica.it\/net4u\/confront-challenge-on-wifi-frame-fingerprinting-for-people-counting-and-trackingconfront\/\" rel=\"bookmark\">Leggi tutto &raquo;<span class=\"screen-reader-text\">CONFRONT &#8211; Challenge ON wifi FRame fingerprinting for people cOunting aNd Tracking<\/span><\/a><\/p>\n","protected":false},"author":3512,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","neve_meta_sidebar":"","neve_meta_container":"","neve_meta_enable_content_width":"","neve_meta_content_width":0,"neve_meta_title_alignment":"","neve_meta_author_avatar":"","neve_post_elements_order":"","neve_meta_disable_header":"","neve_meta_disable_footer":"","neve_meta_disable_title":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-2784","post","type-post","status-publish","format-standard","hentry","category-senza-categoria"],"_links":{"self":[{"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/posts\/2784","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/users\/3512"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/comments?post=2784"}],"version-history":[{"count":9,"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/posts\/2784\/revisions"}],"predecessor-version":[{"id":2828,"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/posts\/2784\/revisions\/2828"}],"wp:attachment":[{"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/media?parent=2784"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/categories?post=2784"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.unica.it\/net4u\/wp-json\/wp\/v2\/tags?post=2784"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}