Full bibliography

Logic and the $2$-Simplicial Transformer

Resource type
Authors/contributors
Title
Logic and the $2$-Simplicial Transformer
Abstract
We introduce the $2$-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses this attention to update entity representations with tensor products of value vectors. We show that this architecture is a useful inductive bias for logical reasoning in the context of deep reinforcement learning.
Publication
arXiv:1909.00668 [cs, stat]
Date
2019-09-02
Accessed
2019-11-21T20:31:14Z
Library Catalog
Extra
ZSCC: 0000000 arXiv: 1909.00668 version: 1
Citation
Murfet, D., Clift, J., Doryn, D., & Wallbridge, J. (2019). Logic and the $2$-Simplicial Transformer. ArXiv:1909.00668 [Cs, Stat]. Retrieved from http://arxiv.org/abs/1909.00668
MODEL CHECKING AND STATE MACHINES
Attachment
Processing time: 0.02 seconds

Graph of references

(from Zotero to Gephi via Zotnet with this script)
Graph of references