thematic segmentation of texts

... Thematic segmentation of texts: two methods for two kinds of texts Olivier FERRET LIMSI-CNRS B~t. 508 - BP 133 F-91403, Orsay ... process a large amount of texts, word-based approaches have been developed. Hearst (1997) and Masson (1995) make use of the word distribution in a text to find a thematic segmentation. These ... interested in the thematic dimension of the texts, they have to be represented by their significant features from that point of view. So, we only hold for each text the lemmatized form of its nouns,...

Ngày tải lên: 08/03/2014, 05:21

... iso- lated texts, to the problem of segmenting parallel parts of documents. The task of aligning each sentence of an abstract to one or more sentences of the body has been studied in the context of summarization ... facilitate the development of better user interfaces and im- prove the performance of summarization and in- formation retrieval systems. Discourse segmentation of the documents com- posed of parallel parts ... emergence of the Web 2.0 technologies: many texts on the web are now accompanied with com- ments and discussions. Segmentation of these par- allel parts into coherent fragments and discovery of hidden...

Ngày tải lên: 20/02/2014, 04:20

... 0.6 0.7 0.8 0.9 1 10 100 1000 10000 100000 1e+06 size(KB) recall precision 434 Proceedings of the COLING/ACL 2006 Main Conference Poster Sessions, pages 428–435, Sydney, July 2006. c 2006...

Ngày tải lên: 20/02/2014, 12:20

... volume constraints typical of DR systems. The modi~,cations are designed to recognize such aspects of discourse structure as establishment of topic; "setting of context; summarizing; concept ... of adjacency, which counted stop-list words, to one which ignores stop- list words. This is to correct for the distortion caused by the distribution of function words in the recognition of ... systems for each of the pro- posed modifications. In this experiment the original corpus of thirty abstracts (but not the prublem state- ments) is submitted to all versions of the analysis...

Ngày tải lên: 21/02/2014, 20:20

... number of words in utterances with only a single dialogue act is 7.5 (with a maximum of 34, and minimum of 1), and the average length of utterances with multiple dialogue acts is 15.7 (max- imum of ... 30 words or more). Figure 2 shows the histogram of the average error (absolute value of word offset) in the start and end of the dialogue act segmentation. Each dialogue act identified by Algorithm ... and (2) instead of using the product of the scores of all segments, use the average score per segment: (Score(C h,i ) · Score(S h−1 )) 1/(1+N(S h−1 )) where N (S i ) is the number of segments in...

Ngày tải lên: 07/03/2014, 22:20

... the thematic structure of the Qur’an based on a fundamental idea in data mining and related disciplines: that, with respect to some collection of texts, the lexical frequency profiles of the ... following: “Figure 6. Plot of groups C and D” Results from figure 6 are also supportive of the thematic structure of each group. Suras of group C are more abundant in the use of narratives and addressing ... following plot of number of content words per sura, sorted in order of descending magnitude. “Figure 1. Plot of number of words per sura” Clearly, given a word with some probability of occurrence,...

Ngày tải lên: 08/03/2014, 04:22

... be a graph of col- lection . Each subset is called a cut of ; stands for the complement . If are disjoint cuts then is a set of edges within cut ; is called weight of cut ; is a set of edges between ... weight of the connection between cuts and ; is the expected weight of edge in graph ; is the expected weight of cut ; is the expected weight of the connection between cut X and the rest of the ... parameter. This feature of the GRA has been designed for the sake of generalization, in order to not overfit the input sample. The input of the GRA consists of (i) a sam- ple set of document vectors...

Ngày tải lên: 08/03/2014, 04:22

... number of classes is small. Exploratory analysis of the corpus highlighted the importance of having a similar number of texts per class. This requirement made it impossible to use all the texts ... proportion of predictions that were within one level of the human-assigned 24 M. Brysbaert, M. Lange, and I. Van Wijnendaele. 2000. The effects of age -of- acquisition and frequency -of- occurrence ... generalisability of the formula, and also to check what sort of texts it does not fit (e.g. sta- tistical descriptive analyses have considered songs and poems as outliers). 4 Selection of lexical and...

Ngày tải lên: 08/03/2014, 21:20

... begins with a view of a city that is arbitrarily identified along with an exact date and time. The camera, seemingly at random, chooses first one of the many buildings and then one of the many windows ... that Hitchcock first introduces the notion of a split personality to the audience. Throughout the first part of the film, Marion's reflection is often noted in several mirrors and windows. ... height of its foreshadowing power as Marion battles both sides of her conscience while driving on an ominous and seemingly endless road toward the Bates Motel. Marion wrestles with the voices of...

Ngày tải lên: 21/03/2014, 21:55

... audience until the end of the film, Movies: A Thematic Analysis of Alfred Hitchcock's Psycho Alfred Hitchcock's Psycho has been commended for forming the archetypical basis of all horror films ... aspects of life. The effective use of character parallels and the creation of the audience's subjective role in the plot allows Hitchcock to entice terror and a convey a lingering sense of anxiety ... height of its foreshadowing power as Marion battles both sides of her conscience while driving on an ominous and seemingly endless road toward the Bates Motel. Marion wrestles with the voices of...

Ngày tải lên: 21/03/2014, 22:10

... 19 of the meetings, which seems to indicate that seg- ment identification is a feasible task. 2 4 Segmentation based on Lexical Cohesion Previous work on discourse segmentation of written texts ... error of P k = 15.79, while the average performance of the algorithm is P k = 15.31 on the WSJ test corpus (unknown number of segments). mean and the variance of the hypothesized probabil- ities of ... a segmentation algorithm that utilizes a metric of lex- ical cohesion and that performs as well as state -of- the-art text-based segmentation techniques. It works both with written and spoken texts. ...

Ngày tải lên: 23/03/2014, 19:20

... alue. 278 Automatic Segmentation of Multiparty Dialogue Pei-Yun Hsueh School of Informatics University of Edinburgh Edinburgh, EH8 9LW, GB p.hsueh@ed.ac.uk Johanna D. Moore School of Informatics University of ... for automatic segmentation of meetings at different levels of granularity, we will explore the use of 279 and van Mulbregt et al. (1999) use topic lan- guage models and variants of the hidden ... shifts to the problem of identifying subtopic boundaries. We then explore the impact on performance of using ASR output as opposed to human transcription. Exam- ination of the effect of features shows that...

Ngày tải lên: 24/03/2014, 03:20

... [%] Probabilistic Recursive MDL Linguistica No segmentation Figure 2: Expectation of the percentage of recog- nized morphemes for English data. a baseline of no segmentation fairly high. The no- segmentation baseline ... obtain a segmentation of the words in the corpus, since we can rewrite every word as a sequence of morphs. 2.1 Size of the morph lexicon We start the generation process by deciding the num- ber of ... segmenta- tion of a set of words consists of the following steps: (1) Segment the words in the corpus using the au- tomatic segmentation algorithm. (2) Divide the segmented data into two parts of equal...

Ngày tải lên: 31/03/2014, 03:20

Ngày tải lên: 21/06/2014, 02:20

Ngày tải lên: 22/06/2014, 00:20

Ngày tải lên: 22/06/2014, 01:20

Ngày tải lên: 22/06/2014, 06:20

Ngày tải lên: 22/06/2014, 20:20

Ngày tải lên: 23/06/2014, 01:20

Ngày tải lên: 23/06/2014, 01:20