Artificial Intelligence and Natural Language

Andrey Filchenkov Lidia Pivovarova Jan Žižka (Eds.) Communications in Computer and Information Science 789 Artificial Intelligence and Natural Language 6th Conference, AINL 2017 St Petersburg, Russia, September 20–23, 2017 Revised Selected Papers 123 Communications in Computer and Information Science Commenced Publication in 2007 Founding and Former Series Editors: Alfredo Cuzzocrea, Xiaoyong Du, Orhun Kara, Ting Liu, Dominik Ślęzak, and Xiaokang Yang Editorial Board Simone Diniz Junqueira Barbosa Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Rio de Janeiro, Brazil Phoebe Chen La Trobe University, Melbourne, Australia Joaquim Filipe Polytechnic Institute of Setúbal, Setúbal, Portugal Igor Kotenko St Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, St Petersburg, Russia Krishna M Sivalingam Indian Institute of Technology Madras, Chennai, India Takashi Washio Osaka University, Osaka, Japan Junsong Yuan Nanyang Technological University, Singapore, Singapore Lizhu Zhou Tsinghua University, Beijing, China 789 More information about this series at http://www.springer.com/series/7899 Andrey Filchenkov Lidia Pivovarova Jan Žižka (Eds.) • Artificial Intelligence and Natural Language 6th Conference, AINL 2017 St Petersburg, Russia, September 20–23, 2017 Revised Selected Papers 123 Editors Andrey Filchenkov ITMO University St Petersburg Russia Jan Žižka Mendel University Brno Czech Republic Lidia Pivovarova University of Helsinki Helsinki Finland ISSN 1865-0929 ISSN 1865-0937 (electronic) Communications in Computer and Information Science ISBN 978-3-319-71745-6 ISBN 978-3-319-71746-3 (eBook) https://doi.org/10.1007/978-3-319-71746-3 Library of Congress Control Number: 2017960865 © Springer International Publishing AG 2018 This work is subject to copyright All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed The use of general descriptive names, registered names, trademarks, service marks, etc in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations Printed on acid-free paper This Springer imprint is published by Springer Nature The registered company is Springer International Publishing AG The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland Preface The 6th Conference on Artificial Intelligence and Natural Language Conference (AINL), held during September 20–23, 2017, in Saint Petersburg, Russia, was organized by the NLP Seminar and ITMO University Its aim was to (a) bring together experts in the areas of natural language processing, speech technologies, dialogue systems, information retrieval, machine learning, artificial intelligence, and robotics and (b) to create a platform for sharing experience, extending contacts, and searching for possible collaboration Overall, the conference gathered more than 100 participants The review process was challenging Overall, 35 papers were sent to the conference and only 17 were selected, for an acceptance rate of 48% In all, 56 researchers from different domains and areas were engaged in the double-blind reviewing process Each paper received at least three reviews, in many cases there were four reviews Beyond regular papers, the proceedings contain six papers about the Russian Paraphrase Detection shared task, which took place at the AINL 2016 conference These papers followed a slightly different review process and were not anonymized for reviews Altogether, 17 papers were presented at the conference, covering a wide range of topics, including social data analysis, dialogue systems, speech processing, information extraction, Web-scale data processing, word embedding, topic modeling, and transfer learning Most of the presented papers were devoted to analyzing human communication and creating algorithms to perform such analysis In addition, the conference program included several special talks and events, including tutorials on neural machine translation, deception detection in language, a hackathon for plagiarism detection in Russian texts, an invited talk on the shape of the future of computational science, industry talks and demos, and a poster session Many thanks to everybody who submitted papers and gave wonderful talks, and to whose who came and participated without publication We are indebted to our Program Committee members for their detailed and insightful reviews; we received very positive feedback from our authors even from those whose submissions were rejected And last but not the least, we are grateful to our organization team: Anastasia Bodrova, Irina Krylova, Aleksandr Bugrovsky, Natalia Khanzhina, Ksenia Buraya, and Dmitry Granovsky November 2017 Andrey Filchenkov Lidia Pivovarova Jan Žižka Organization Program Committee Jan Žižka (Chair) Jalel Akaichi Mikhail Alexandrov Artem Andreev Artur Azarov Alexandra Balahur Siddhartha Bhattacharyya Svetlana Bichineva Victor Bocharov Elena Bolshakova Pavel Braslavski Maxim Buzdalov John Cardiff Dmitry Chalyy Daniil Chivilikhin Dan Cristea Frantisek Darena Gianluca Demartini Marianna Demenkova Dmitry Granovsky Maria Eskevich Vera Evdokimova Alexandr Farseev Andrey Filchenkov Tatjana Gornostaja Mark Granroth-Wilding Jiří Hroza Tomáš Hudík Camelia Ignat Denis Kirjanov Goran Klepac Daniil Kocharov Artemy Kotov Miroslav Kubat Andrey Kutuzov Nikola Ljubešić Mendel University of Brno, Czech Republic King Khalid University, Tunisia Autonomous University of Barcelona, Spain Russian Academy of Science, Russia Saint Petersburg Institute for Informatics and Automation, Russia European Commission, Joint Research Centre, Ispra, Italy RCC Institute of Information Technology, India Saint Petersburg State University, Russia OpenCorpora, Russia Moscow State Lomonosov University, Russia Ural Federal University, Russia ITMO University, Russia Institute of Technology Tallaght, Dublin, Ireland Yaroslavl State University, Russia ITMO University, Russia A I Cuza University of Iasi, Romania Mendel University in Brno, Czech Republic University of Sheffield, UK Kefir Digital, Russia Yandex, Russia Radboud University, The Netherlands Saint Petersburg State University, Russia Singapore National University, Singapore ITMO University, Russia Tilde, Latvia University of Helsinki, Finland Rare Technologies, Czech Republic Think Big Analytics, Czech Republic Joint Research Centre of the European Commission, Ispra, Italy Higher School of Economics, Russia University of Zagreb, Croatia Saint Petersburg State University, Russia Kurchatov Institute, Russia University of Miami, FL, USA University of Oslo, Norway Jožef Stefan Institute, Slovenia VIII Organization Natalia Loukachevitch Kirill Maslinsky Vladislav Maraev George Mikros Alexander Molchanov Sergey Nikolenko Alexander Panchenko Allan Payne Jakub Piskorski Lidia Pivovarova Ekaterina Protopopova Paolo Rosso Eugen Ruppert Ivan Samborskii Arun Kumar Sangaiah Christin Seifert Serge Sharoff Jan Šnajder Maria Stepanova Hristo Tanev Irina Temnikova Michael Thelwall Alexander Troussov Vladimir Ulyantsev Dmitry Ustalov Natalia Vassilieva Mikhail Vink Wajdi Zaghouani Moscow State University, Russia National Research University Higher School of Economics, Russia University of Gothenburg, Sweden National and Kapodistrian University of Athens, Greece PROMT, Russia Steklov Mathematical Institute, St Petersburg, Russia Universität Hamburg, Germany American University in London, UK Joint Research Centre of the European Commission, Ispra, Italy University of Helsinki, Finland Saint Petersburg State University, Russia Technical University of Valencia, Spain TU Darmstadt - FG Language Technology, Germany Singapore National University, Singapore VIT University, Tamil Nadu, India University of Passau, Germany University of Leeds, UK University of Zagreb, Croatia ABBYY, Russia Joint Research Centre of the European Commission, Ispra, Italy Qatar Computing Research Institute, Qatar University of Wolverhampton, UK Russian Presidential Academy of National Economy and Public Administration, Russia ITMO University, Russia Lappeenranta University of Technology, Finland Hewlett Packard Labs, USA JetBrains, Germany Carnegie Mellon University Qatar Contents Social Interaction Analysis Semantic Feature Aggregation for Gender Identification in Russian Facebook Polina Panicheva, Aliia Mirzagitova, and Yanina Ledovaya Using Linguistic Activity in Social Networks to Predict and Interpret Dark Psychological Traits Arseny Moskvichev, Marina Dubova, Sergey Menshov, and Andrey Filchenkov Boosting a Rule-Based Chatbot Using Statistics and User Satisfaction Ratings Octavia Efraim, Vladislav Maraev, and João Rodrigues 16 27 Speech Processing Deep Learning for Acoustic Addressee Detection in Spoken Dialogue Systems Aleksei Pugachev, Oleg Akhtiamov, Alexey Karpov, and Wolfgang Minker Deep Neural Networks in Russian Speech Recognition Nikita Markovnikov, Irina Kipyatkova, Alexey Karpov, and Andrey Filchenkov Combined Feature Representation for Emotion Classification from Russian Speech Oxana Verkholyak and Alexey Karpov 45 54 68 Information Extraction Active Learning with Adaptive Density Weighted Sampling for Information Extraction from Scientific Papers Roman Suvorov, Artem Shelmanov, and Ivan Smirnov 77 Application of a Hybrid Bi-LSTM-CRF Model to the Task of Russian Named Entity Recognition The Anh Le, Mikhail Y Arkhipov, and Mikhail S Burtsev 91 X Contents Web-Scale Data Processing Employing Wikipedia Data for Coreference Resolution in Russian Ilya Azerkovich 107 Building Wordnet for Russian Language from Ru.Wiktionary Yuliya Chernobay 113 Corpus of Syntactic Co-Occurrences: A Delayed Promise Eduard S Klyshinsky and Natalia Y Lukashevich 121 Computation Morphology and Word Embeddings A Close Look at Russian Morphological Parsers: Which One Is the Best? Evgeny Kotelnikov, Elena Razova, and Irina Fishcheva 131 Morpheme Level Word Embedding Ruslan Galinsky, Tatiana Kovalenko, Julia Yakovleva, and Andrey Filchenkov 143 Comparison of Vector Space Representations of Documents for the Task of Information Retrieval of Massive Open Online Courses Julius Klenin, Dmitry Botov, and Yuri Dmitrin 156 Machine Learning Interpretable Probabilistic Embeddings: Bridging the Gap Between Topic Models and Neural Networks Anna Potapenko, Artem Popov, and Konstantin Vorontsov Multi-objective Topic Modeling for Exploratory Search in Tech News Anastasia Ianina, Lev Golitsyn, and Konstantin Vorontsov A Deep Forest for Transductive Transfer Learning by Using a Consensus Measure Lev V Utkin and Mikhail A Ryabinin 167 181 194 Russian Paraphrase Detection Shared Task ParaPhraser: Russian Paraphrase Corpus and Shared Task Lidia Pivovarova, Ekaterina Pronoza, Elena Yagunova, and Anton Pronoza Effect of Semantic Parsing Depth on the Identification of Paraphrases in Russian Texts Kirill Boyarsky and Eugeni Kanevsky 211 226 ... this series at http://www.springer.com/series/7899 Andrey Filchenkov Lidia Pivovarova Jan Žižka (Eds.) • Artificial Intelligence and Natural Language 6th Conference, AINL 2017 St Petersburg, Russia,... laws and regulations and therefore free for general use The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate... registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland Preface The 6th Conference on Artificial Intelligence and Natural Language Conference (AINL), held during September 20–23, 2017,