ROUGEスコア
ROUGEは、「Recall-Oriented Understudy for Gisting」の略です。 評価, is a set of metrics used to evaluate the quality of summaries produced by automatic summarization systems. It is particularly popular in 自然言語処理 (NLP) and is often employed to assess the performance of models that generate text, such as summarizers, 機械翻訳 systems, and other テキスト生成 ツール。
ROUGEは主に、生成された要約を1つ以上の参照要約（しばしば人間が作成）と比較し、その一致度を測定します。ROUGEに含まれる主な指標は次のとおりです：
- ROUGE-N： Measures n-grams (contiguous sequences of n items from a given sample of text). For instance, ROUGE-1 evaluates single words, whereas ROUGE-2 looks at pairs of consecutive words.
- ROUGE-L： Focuses on the longest common subsequence between the generated summary and the reference summaries, taking into account the order of the words.
- ROUGE-W： A weighted version of ROUGE-L that accounts for consecutive matches and penalizes gaps.
The scores generated by ROUGE are typically expressed as recall, precision, and F1-score. Recall measures the percentage of n-grams from the reference summaries that are found in the generated summary, while precision measures the percentage of n-grams in the generated summary that are also in the reference. The F1-score is the 調和平均 適合率とリコールのバランスを取る単一の指標を提供します。
Overall, ROUGE Score is a valuable tool in the field of NLP, helping researchers and practitioners objectively measure the effectiveness of their text generation systems by providing insights into how well they replicate 人間の書き方のパターン。