可视化展示attention(seq2seq with attention in tensorflow)

时间:2023-03-09 00:47:56
可视化展示attention(seq2seq with attention in tensorflow)

目前实现了基于tensorflow的支持的带attention的seq2seq。基于tf 1.0官网contrib路径下seq2seq

由于后续版本不再支持attention,迁移到melt并做了进一步开发,支持完全ingraph的beam search(更快速)

以及outgraph的交互式beam search(更灵活),其中ougraph的beam search支持alignments的输出。

attention的可视化也就是alignments的展示如下图(输入句子预测用户可能的搜索词):

可视化展示attention(seq2seq with attention in tensorflow)

可视化展示attention(seq2seq with attention in tensorflow)

可视化展示attention(seq2seq with attention in tensorflow)

可视化展示attention(seq2seq with attention in tensorflow)

可视化展示attention(seq2seq with attention in tensorflow)

Out graph beam search

可视化展示attention(seq2seq with attention in tensorflow)

In graph beam search

可视化展示attention(seq2seq with attention in tensorflow)

Calc text to text prob (计算文本到文本的生成概率)

可视化展示attention(seq2seq with attention in tensorflow)

可视化展示attention(seq2seq with attention in tensorflow)

可视化展示attention(seq2seq with attention in tensorflow)

可视化展示attention(seq2seq with attention in tensorflow)