Claims Analysis
Total Claims: 9
Claim 1
Independent Claim
98 words
A method of generating descriptors for natural language texts, using a plurality of training texts having a plurality of words, comprising the steps of: extracting words from a text during a training phase on the basis of the training texts; predetermining a minimum structure of said descriptors; breaking down words in the text into shorter word segments, wherein each shorter word segment within a longer word segment must meet said minimum structure for said breaking down to be permitted; and matching said word segments that remain in the text against each other to generate a list of descriptors.
Claim 2
Independent Claim
98 words
A method of generating descriptors for natural language texts, using a plurality of training texts having a plurality of words, comprising the steps of: extracting words from a text during a training phase on the basis of the training texts; predetermining a minimum structure of said descriptors; breaking down words in the text into shorter word segments, wherein each shorter word segment within a longer word segment must meet said minimum structure for said breaking down to be permitted; and matching said word segments that remain in the text against each other to generate a list of descriptors.
Claim 3
Dependent Claim
53 words
A method according to claim 1 wherein the breakdown step is carried out repeatedly, with the word segments formed in preceding breakdown cycles being treated like word forms that occur in the text, and the descriptors are formed from the word forms and word segments which are left after the last breakdown cycle.
Claim 4
Dependent Claim
28 words
A method according to claim 1 wherein, during the formation of the descriptors from the remaining word forms and word segments, suffixes and prefixes are separated from them.
Claim 5
Dependent Claim
23 words
A method according to claim 3, wherein the suffixes and prefixes are statistically determined from the word forms occurring in the training texts.
Claim 6
Dependent Claim
24 words
A method according to claim 1, wherein a stop word list is predetermined and word forms contained therein are not considered in the text.
Claim 7
Dependent Claim
31 words
A method according to claim 5, wherein the word forms of the stop word list are statistically determined from the training texts as the word forms which most frequently occur therein.
Claim 8
Dependent Claim
30 words
A method according to claim 1, wherein a frequency threshold is predetermined for the descriptors and only those descriptors are used whose frequency in the training texts exceeds the threshold.
Claim 9
Dependent Claim
59 words
The method according to claim 4, comprising the following steps: removing word segments not meeting the minimum structure from consideration as descriptors, wherein the minimum structure includes word segments having at least three characters, one of which must be a vowel; and separating said prefixes and suffixes from said word segments at a conclusion of said breaking down step.