Automatic correlation method for generating summaries for text documents

Claim 2

An automatic method for generating summaries for text documents, comprising steps of: generating a set of sentences for a set of documents by document discourse analysis and a set of words by morphologic process; initializing a word score for each word in the set of words, a sentence score for each sentence in the set of sentences and a score sum; computing an aggregated word score for said each word according to an aggregate of sentence scores of sentences containing said each word and to a degree of correlation between said each word and user related information; wherein said aggregated word score (SCORE[w]) has a weighted (λ) relationship with each of said aggregated sentence score (SCORE[s]), linguistic salience of said each word to a user profile (salience(w, user summarization profile)), similarities among said each word, a query and a provided topic (salience(w, user's query or topic)), similarities among said each word and terms in titles of the documents (salience(w, tile words)), a ratio of an occurrence number for said each word in a document to a total occurrence number for said each word in the set of documents (FREQUENCY(w/d)/FREQUENCY(w/D)), and a ratio of a number of documents including said each word to a total number of documents in the set of documents (NUMBER(d, d w)/NUMBER(D)), of the form SCORE[ w ]=λ 1 *salience( w , user summarization profile)+λ 2 *salience( w , user's query or topic)+λ 3 *Σ(SCORE[ s ], s ω)+λ 4 *salience( w , title words)+λ 5 *FREQUENCY( w/d )/FREQUENCY( w/D )+λ 6 *NUMBER( d, d w )/NUMBER( D ); computing an aggregated sentence score for said each sentence according to an aggregate of word scores composing said each sentence and a respective sentence position in a section and a paragraph; comparing an aggregate sum with said score sum, said aggregate sum being a sum of aggregated word scores and aggregated sentence scores; and if said aggregate sum is different than said score sum, returning to the step of computing the aggregated word scare; otherwise, outputting top-ranked sentences according to sentence score as a summary of the set of documents, top-ranked words according to word score as a keywords list of the set of documents.

Claim 3

An automatic method according to claim 1 , wherein the step of computing the aggregated word score for said each word comprises: computing a score for said each word according to linguistic salience of said each word to a user profile.

Claim 4

An automatic method according to claim 1 , wherein the step of computing the aggregated word score for said each word comprises: computing a score for said each word according to similarities among said each word, a query and a provided topic.

Claim 5

An automatic method according to claim 1 , wherein the step of computing the aggregated word score for said each word comprises: computing a score for said each word according to similarities among said each word and terms in titles of the documents.

Claim 6

An automatic method according to claim 1 , wherein the step of computing the aggregated word score for said each word comprises: computing a score for said each word according to a ratio of an occurrence number for said each word in a document to a total occurrence number for said each word in the set of documents.

Claim 7

An automatic method according to claim 1 , wherein the step of computing the aggregated word score for said each word comprises: computing a score for said each word according to a ratio of a number of documents including said each word to a total number of documents in the set of documents.

Claim 8

An automatic method according to claim 1 , wherein document discourse analysis comprises identifying titles, sections, lists, paragraph boundaries and sentence boundaries of the documents.

Claim 9

An automatic method according to claim 1 , wherein said aggregate sentence score further has a weighted relationship with each of said aggregated word score, sentence position (position(s, d)) and similarity (similarity(s, S)) of the form SCORE[ s ]=λ 7 *Σ(SCORE[ w], s w )+λ 8 *position( s, d )+λ 9 *similarity( s, S ).

Claim 10

A computer program product for automatically generating summaries for text documents, said computer program product comprising a computer usable medium having computer readable program code thereon, said computer readable program code comprising: computer program code means for generating a set of sentences for a set of documents by document discourse analysis and a set of words by morphologic process; computer program code means for initializing a word score for each word in the set of words, a sentence score for each sentence in the set of sentences and a score sum; computer program code means fix computing an aggregated word score for said each word according to an aggregate of sentence scores of sentences containing said each word and computing a degree of correlation between said each word and user related information; computer program code means for computing an aggregated sentence score for each sentence in the set of sentences according to an aggregate of word scores composing it and a respective sentence position in a section and a paragraph; wherein said aggregated word score (SCORE[w]) has a weighted (λ) relationship with each of said aggregated sentence score (SCORE[s]), linguistic salience of said each word to a user profile (salience(w user summarization profile)), similarities among said each word, a query and a provided topic (salience(w, user's query or topic)), similarities among said each word and terms in titles of the documents (salience(w, tile words)), a ratio of an occurrence number for said each word in a document to a total occurrence number for said each word in the set of documents (FREQUENCY(w/d)/FREQUENCY(w/D)), and a ratio of a number of documents including said each word to a total number of documents in the set of documents (NUMBER(d, d w)/NUMBER(D)), of the form SCORE[ w ]=λ 1 *salience( w , user summarization profile)+λ 2 *salience( w , user's query or topic)+λ 3 *Σ(SCORE[ s ], s ω)+λ 4 *salience( w , title words)+λ 5 *FREQUENCY( w/d )/FREQUENCY( w/D )+λ 6 *NUMBER( d, d w )/NUMBER( D ) computer program code means for computing an aggregate sum from aggregated word scores and aggregated sentence scores; computer program code means for determining if said aggregate sum is different than said score sum and for selectively replacing said score sum with said aggregate sum, each said word scare with a corresponding said aggregated word score and each said sentence score with a corresponding said aggregated sentence score; and computer program code means for outputting top-ranked sentences according to sentence score as a summary of the set of documents, top-ranked words according to word score as a keywords list of the set of documents.

Claim 11

A computer program product for automatically generating summaries for text documents, said computer program product comprising a computer usable medium having computer readable program code thereon, said computer readable program code comprising: computer program code means for generating a set of sentences for a set of documents by document discourse analysis and a set of words by morphologic process; computer program code means for initializing a word score for each word in the set of words, a sentence score for each sentence in the set of sentences and a score sum; computer program code means fix computing an aggregated word score for said each word according to an aggregate of sentence scores of sentences containing said each word and computing a degree of correlation between said each word and user related information; computer program code means for computing an aggregated sentence score for each sentence in the set of sentences according to an aggregate of word scores composing it and a respective sentence position in a section and a paragraph; wherein said aggregated word score (SCORE[w]) has a weighted (λ) relationship with each of said aggregated sentence score (SCORE[s]), linguistic salience of said each word to a user profile (salience(w user summarization profile)), similarities among said each word, a query and a provided topic (salience(w, user's query or topic)), similarities among said each word and terms in titles of the documents (salience(w, tile words)), a ratio of an occurrence number for said each word in a document to a total occurrence number for said each word in the set of documents (FREQUENCY(w/d)/FREQUENCY(w/D)), and a ratio of a number of documents including said each word to a total number of documents in the set of documents (NUMBER(d, d w)/NUMBER(D)), of the form SCORE[ w ]=λ 1 *salience( w , user summarization profile)+λ 2 *salience( w , user's query or topic)+λ 3 *Σ(SCORE[ s ], s ω)+λ 4 *salience( w , title words)+λ 5 *FREQUENCY( w/d )/FREQUENCY( w/D )+λ 6 *NUMBER( d, d w )/NUMBER( D ) computer program code means for computing an aggregate sum from aggregated word scores and aggregated sentence scores; computer program code means for determining if said aggregate sum is different than said score sum and for selectively replacing said score sum with said aggregate sum, each said word scare with a corresponding said aggregated word score and each said sentence score with a corresponding said aggregated sentence score; and computer program code means for outputting top-ranked sentences according to sentence score as a summary of the set of documents, top-ranked words according to word score as a keywords list of the set of documents.

Claim 12

A computer program product for automatically generating summaries according to claim 9 , wherein the computer program code means for computing the aggregated word score for said each word comprises: computer program code means for computing a score for said each word according to linguistic salience of said each word to a user profile.

Claim 13

A computer program product for automatically generating summaries according to claim 9 , wherein the computer program code means for computing the aggregated word score for said each word comprises: computer program code means for computing a score for said each word according to similarities among said each word, a query and a provided topic.

Claim 14

A computer program product for automatically generating summaries according to claim 9 , wherein the computer program code means for computing the aggregated word score for said each word comprises: computer program code means for computing a score for said each word according to similarities among said each word and terms in titles of the documents.

Claim 15

A computer program product for automatically generating summaries according to claim 9 , wherein the computer program code means for computing the aggregated word score for said each word comprises: computer program code means for computing a score for said each word according to a ratio of an occurrence number for said each word in a document to a total occurrence number for said each word in the set of documents.

Claim 16

A computer program product for automatically generating summaries according to claim 9 , wherein the computer program code means for computing the aggregated word score for said each word comprises: computer program code means for computing a score for said each word according to a ratio of a number of documents including said each word to a total number of documents in the set of documents.

Claim 17

A computer program product for automatically generating summaries according to claim 9 , wherein computer program code means for generating a set of sentences for a set of documents by document discourse analysis comprises computer program code means for identifying titles, sections, lists, paragraph boundaries and sentence boundaries of the documents.

Claim 18

A computer program product for automatically generating summaries according to claim 9 , wherein said aggregate sentence score further has a weighted relationship with each of said aggregated word score, sentence position (position(s, d)) and similarity (similarity(s, S)) of the form SCORE[ s ]=λ 7 *Σ(SCORE[ w ], s w )+λ 8 *position( s, d )+λ 9 *similarity( s, S ).