您的位置 > 首页 > 会议讲座 > 讲座:Aggregating and Evaluating the Crowd Intelligence in...

讲座:Aggregating and Evaluating the Crowd Intelligence in...

来源:上海交通大学安泰经济与管理学院 | 2019-07-09 | 发布:ope电竞之家

题目:Aggregating and Evaluating the Crowd Intelligence in Microtask Crowdsourcing

嘉宾:魏煊博士生美国亚利桑那大学

主持人:宋婷婷 助理教授安泰经济与管理学院管理信息系统系

时间:2019年7月15日(周一)10:00-11:30

地点:上海交通大学徐汇校区 新上院 S204

讲座摘要:

Microtask crowdsourcing has emerged as a cost-effective approach to obtaining large-scale labeled data in a wide range of applications. However, significant concerns still remain for the major stakeholders—task requesters and crowdsourcing platforms. Task requesters attempt to maximize the data quality given the limited budget and the crowdsourcing platforms need to evaluate the participating workers to foster the creation of a healthy and sustainable crowdsourcing ecosystem. Existing literature on learning from crowds has mainly focused on the single-label (i.e., binary and multi-class) setting, which prevents the application of microtask crowdsourcing to a wide range of business applications in which each item can be associated with multiple labels simultaneously. In this paper, we consider the problem of learning from crowds in the general multi-label setting, which includes previously studied single-label crowdsourcing problems as special cases. We propose a new Bayesian hierarchical model for the underlying annotation process of crowd workers and introduce a mixture of Bernoulli distribution to capture the unknown label dependency. An efficient variational inference procedure is then developed to jointly infer ground truth labels, worker reliability in terms of sensitivity and specificity, and label dependency. Results based on extensive simulation experiments and a real-world MTurk experiment indeed confirm that the proposed approach outperforms other competing methods, highlighting the necessity to model both worker quality and label dependency when learning from crowdsourced multi-label annotations.

嘉宾简介:

Xuan Wei is a Ph.D. candidate in the Department of Management Information Systems at the University of Arizona. His research interests include crowd intelligence, false news detection, intention mining in social media, etc. He received his B.S. degree in Mathematics and Applied Mathematics from the Shanghai Jiao Tong University, China. He has published papers in journals and conference proceedings such as TKDD, International Journal of Intelligent Systems, PACIS, and ICDE. He also has several working papers targeted at journals such as MISQ, ISR, JOC, TKDE, and DSS. He has presented his research at major conferences and workshops including INFORMS, CIST, and the INFORMS Workshop on Data Science. He received Best Paper Award in WITS 2018, and Best Paper Award Runner-up in INFORMS Workshop on Data Science 2017.


欢迎感兴趣的师生参加!


本文已经过优化显示,查看原文请点击以下链接:
查看原文:http://www.acem.sjtu.edu.cn/news_center/scholarship/40067.html

看图学经济more

  • 【ope电竞之家】 P2P网贷行业流量之伤与评级之伤 08-10
  • 【ope电竞之家】 财富管理论:从理财师到智能投顾 08-10
  • 【ope电竞之家】 轮回的学生贷江湖,你可懂?(下) 04-05
  • 【ope电竞之家】 互联网票据理财之二:风险辨识不容易 03-30
  • 【ope电竞之家】 互联网票据理财之一:业务运作模式详解! 03-29
  • 院校点评more

    京ICP备11001960号  京ICP证090565号 京公网安备1101084107号 论坛法律顾问:王进律师知识产权保护声明免责及隐私声明   主办单位:人大经济论坛 版权所有
    联系QQ:2881989700  邮箱:service@pinggu.org
    合作咨询电话:(010)62719935 广告合作电话:13661292478(刘老师)

    投诉电话:(010)68466864 不良信息处理电话:(010)68466864