ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.
Keywords: protein, language models, language of life, representation learning, transformer, neural network, Python, PyTorch