| Challenge: | Existing methods to make comments on articles are based on human-annotated subsets, but they are not suitable for online forums. |
| Approach: | They propose to use a large-scale Chinese corpus with millions of real comments and a human-annotated subset characterizing the comments’ varying quality to generalize a broad set of popular reference-based metrics. |
| Outcome: | The proposed model incorporates human-annotated subset characterizing the comments’ varying quality and shows that it is more accurate than previous models. |
Similar Papers
Automatic Argument Quality Assessment - New Datasets and Methods (D19-1)
Copied to clipboard
Assaf Toledo, Shai Gretz, Edo Cohen-Karlik, Roni Friedman, Elad Venezian, Dan Lahav, Michal Jacovi, Ranit Aharonov, Noam Slonim
| Challenge: | 6.3k arguments were collected from contributors of various levels, and are released as part of this work. |
| Approach: | They propose to use a language model to annotate arguments for argument ranking and argument-pair classification. |
| Outcome: | The proposed methods outperform state-of-the-art methods in the argument ranking task and argument-pair classification task. |
Automatic Comment Generation for Chinese Student Narrative Essays (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Existing studies focus on giving discrete scores for holistic quality or distinct traits, but real-world teachers usually provide detailed comments in natural language, which are more informative than single scores. |
| Approach: | They propose a model which generates comments for specified segments from given student narrative essays using a human-written Chinese dataset. |
| Outcome: | The proposed model outperforms baselines and has 91% success rate. |
Cross-Modal Commentator: Automatic Machine Commenting Based on Cross-Modal Information (P19-1)
Copied to clipboard
| Challenge: | Existing work on commenting based on textual content is focused on other modalities, such as graphics and images. |
| Approach: | They propose a task to integrate multiple modalities into automatic commenting . they construct a large-scale dataset and propose 'co-attention' model to capture dependency between textual and visual information. |
| Outcome: | The proposed model can achieve better performance than baselines. |
Automating Horizon Scanning in Future Studies (2022.lrec-1)
Copied to clipboard
Tatsuya Ishigaki, Suzuko Nishino, Sohei Washino, Hiroki Igarashi, Yukari Nagai, Yuichi Washida, Akihiko Murai
| Challenge: | Existing studies collect enough information to predict drastic social changes in the mid- or long-term future. |
| Approach: | They propose document retrieval and comment generation tasks for automating horizon scanning by analyzing a dataset that contains 2,266 manually collected news articles with comments written by experts. |
| Outcome: | The proposed tasks are more efficient than previous methods and the proposed models are more accurate. |
Coherent Comments Generation for Chinese Articles with a Graph-to-Sequence Model (P19-1)
Copied to clipboard
| Challenge: | Existing models for article comment generation are too long and often result in general and irrelevant comments. |
| Approach: | They propose to generate comments with a graph-to-sequence model that models the input news as a topic interaction graph. |
| Outcome: | The proposed model can generate coherent and informative comments compared with several strong baseline models. |
Learning to Update Natural Language Comments Based on Code Changes (2020.acl-main)
Copied to clipboard
| Challenge: | a novel approach to update comments based on code changes is proposed . a dataset of open-source software projects is used to train and evaluate the model . |
| Approach: | They propose an approach that learns to correlate changes across two distinct language representations to generate a sequence of edits that are applied to the existing comment to reflect the source code modifications. |
| Outcome: | The proposed model outperforms baselines and automatic metrics with respect to making edits. |
Forum 4.0: An Open-Source User Comment Analysis Framework (2021.eacl-demos)
Copied to clipboard
Marlo Haering, Jakob Smedegaard Andersen, Chris Biemann, Wiebke Loosen, Benjamin Milde, Tim Pietz, Christian Stöcker, Gregor Wiedemann, Olaf Zukunft, Walid Maalej
| Challenge: | Using Forum 4.0, we analyze, aggregate, and visualize user comments based on labels defined by domain experts. |
| Approach: | They introduce an open-source framework to semi-automatically analyze, aggregate, and visualize user comments based on labels defined by domain experts. |
| Outcome: | The proposed framework can analyze, aggregate, and visualize user comments based on labels defined by domain experts. |
One Comment from One Perspective: An Effective Strategy for Enhancing Automatic Music Comment (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for automatic comment generation generate common and meaningless comments for music. |
| Approach: | They propose a multi-perspective strategy to enhance automatic music comment generation by combining different perspectives on a music comment dataset. |
| Outcome: | The proposed model outperforms state-of-the-art models on two music comment datasets and outperformed existing models by a substantial margin. |
Automatic Generation of Personalized Comment Based on User Profile (P19-2)
Copied to clipboard
| Challenge: | Experimental results show that our model can generate natural, human-like and personalized comments. |
| Approach: | They propose a model that takes user profile into account when generating comments on social media and integrates it with a gated memory. |
| Outcome: | The proposed model can generate natural, human-like and personalized comments on social media. |
Toward a Task of Feedback Comment Generation for Writing Learning (D19-1)
Copied to clipboard
| Challenge: | Existing work on feedback comment generation has been limited . despite its usefulness, there is no publicly available dataset for research on feedback comments . |
| Approach: | They introduce a task of automatically generating feedback comments such as a hint or an explanatory note for writing learning for non-native learners of English. |
| Outcome: | The proposed task is based on a corpus of 1,900 essays with all preposition errors annotated with feedback comments. |