Abstract The development of spatial transcriptomics technologies makes it possible to study tissue heterogeneity at the scale of spatial expressed microenvironment. However, most of the previous methods collapse the spatial patterns in the low spatial resolution. Existing reference based deconvolution methods integrate single-cell reference and spatial transcriptomics data to predict the proportion of cell-types, but the availability of suitable single-cell reference is often limited. In this paper, we propose a novel Transformer based model (TransfromerST) to integrate the spatial gene expression measurements and their spatial patterns in the histology image (if available) without single cell reference. TransfromerST enables the learning of the locally realistic and globally consistent constituents at nearly single cell resolution. TransfromerST firstly uses a transformer based variational autoencoder to explore the latent representation of gene expression, which is further embedded with the spatial relationship learned from adaptive graph Transformer model. The super-resolved cross-scale graph network improves the model-fit to enhanced structure-functional interactions. The public and in-house experimental results with multimodal spatial transcriptomics data demonstrate TransfromerST could highlight the tissue structures at nearly single cell resolution and detect the spatial variable genes and meta gene for each spatial domain. In summary, TransfromerST provides an effective and efficient alternative for spatial transcriptomics tissue clustering, super-resolution and gene expression prediction from histology image.

Transformer Enables Reference Free And Unsupervised Analysis of Spatial Transcriptomics