GenNI: Human-AI Collaboration for Data-Backed Text Generation

被引:12
作者
Strobelt, Hendrik [1 ,2 ]
Kinley, Jambay [3 ]
Krueger, Robert [4 ]
Beyer, Johanna [4 ]
Pfister, Hanspeter [4 ]
Rush, Alexander M. [3 ]
机构
[1] IBM Res, Cambridge, MA 02142 USA
[2] MIT IBM Watson AI Lab, Cambridge, MA 02142 USA
[3] Cornell Univ, New York, NY 10021 USA
[4] Harvard Univ, Cambridge, MA 02138 USA
关键词
Computational modeling; Visualization; Tools; Data models; Collaboration; Task analysis; Deep learning; Tabular Data; Text; Document Data; Machine Learning; Statistics; Modelling; Simulation Applications;
D O I
10.1109/TVCG.2021.3114845
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to generate freely these ML systems often produce misleading or unexpected outputs. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text. The tool utilizes a deep learning model designed with explicit control states. These controls allow users to globally constrain model generations, without sacrificing the representation power of the deep learning models. The visual interface makes it possible for users to interact with AI systems following a Refine-Forecast paradigm to ensure that the generation system acts in a manner human users find suitable. We report multiple use cases on two experiments that improve over uncontrolled generation approaches, while at the same time providing fine-grained control. A demo and source code are available at https://genni.vizhub.ai.
引用
收藏
页码:1106 / 1116
页数:11
相关论文
共 63 条
  • [51] Rush AM, 2020, 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020): SYSTEM DEMONSTRATIONS, P335
  • [52] Shen TX, 2017, ADV NEUR IN, V30
  • [53] Shen Xiaoyu, 2020, P 58 ANN M ASS COMPU, P7155, DOI 10.18653/v1/2020.acl-main.641
  • [54] SEQ2SEQ-VIS : A Visual Debugging Tool for Sequence-to-Sequence Models
    Strobelt, Hendrik
    Gehrmann, Sebastian
    Behrisch, Michael
    Perer, Adam
    Pfister, Hanspeter
    Rush, Alexander M.
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2019, 25 (01) : 353 - 363
  • [55] LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
    Strobelt, Hendrik
    Gehrmann, Sebastian
    Pfister, Hanspeter
    Rush, Alexander M.
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2018, 24 (01) : 667 - 676
  • [56] Sutskever I, 2014, ADV NEUR IN, V27
  • [57] Theune M., 2001, Natural Language Engineering, V7, P47
  • [58] Varshney L. R., 2019, Ctrl: A conditional transformer language model for controllable generation
  • [59] Vaswani A, 2017, ADV NEUR IN, V30
  • [60] Vig J, 2019, PROCEEDINGS OF THE 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: SYSTEM DEMONSTRATIONS, (ACL 2019), P37