{"id":2584,"date":"2024-02-07T09:55:54","date_gmt":"2024-02-07T12:55:54","guid":{"rendered":"https:\/\/icc.fcen.uba.ar\/?p=2584"},"modified":"2024-02-07T09:55:54","modified_gmt":"2024-02-07T12:55:54","slug":"apparent-personality-prediction-from-speech-using-expert-features-and-wav2vec-2-0","status":"publish","type":"post","link":"https:\/\/icc.fcen.uba.ar\/en\/apparent-personality-prediction-from-speech-using-expert-features-and-wav2vec-2-0\/","title":{"rendered":"Apparent personality prediction from speech using expert features and wav2vec 2.0"},"content":{"rendered":"<div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 fusion-flex-container has-pattern-background has-mask-background nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"max-width:1144px;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:20px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-text fusion-text-1\"><p>Authors: R. Barchi, L. Pepino, L. Gauder, L. Estienne, M. Meza, P. Riera, L. Ferrer.<\/p>\n<p>Abstract:<br \/>\nStudies have shown that virtual assistants that adapt to the personality of the speaker are more effective and improve the overall experience of the user. For this\u00a0reason, automatic detection of a user\u2019s personality has recently become a task of interest. In this work, we explore the task of detecting a person\u2019s personality using\u00a0their speech. To this end, we use the \u201cFirst impressions Dataset\u201d consisting of videos annotated with apparent personality labels. We train various systems using\u00a0different modeling techniques and features extracted from the speech recordings including expert features commonly used for emotion recognition, and self-supervised\u00a0representations given by wav2vec 2.0. We analyze the importance of each of these feature sets and relevant subsets for predicting the \u201cBig-five\u201d personality traits.<br \/>\nOur results show that wav2vec 2.0 features are the most useful ones, and that their combination with expert features can result in additional gains.<\/p>\n<p>More information:<br \/>\n<a href=\"https:\/\/www.isca-archive.org\/smm_2023\/barchi23_smm.html\" target=\"_blank\" rel=\"noopener\">https:\/\/www.isca-archive.org\/smm_2023\/barchi23_smm.html<\/a><\/p>\n<\/div><\/div><\/div><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":9,"featured_media":2585,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[98],"tags":[],"class_list":["post-2584","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-papers"],"_links":{"self":[{"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/posts\/2584","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/comments?post=2584"}],"version-history":[{"count":1,"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/posts\/2584\/revisions"}],"predecessor-version":[{"id":2586,"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/posts\/2584\/revisions\/2586"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/media\/2585"}],"wp:attachment":[{"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/media?parent=2584"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/categories?post=2584"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/icc.fcen.uba.ar\/en\/wp-json\/wp\/v2\/tags?post=2584"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}