flambe.nlp.transformers.gpt

Intergation of the pytorch_transformers openai and gpt2 modules.

Note that these objects are only to be used to load pretrained models. The pytorch-transformers library wasn’t designed to train these models from scratch.

Module Contents

class flambe.nlp.transformers.gpt.GPTTextField[source]

Bases: flambe.nlp.transformers.utils.TransformerTextField

Integrate the pytorch_transformers OpenAIGPTTokenizer.

Currently available aliases:
. openai-gpt
_cls[source]
class flambe.nlp.transformers.gpt.GPTEmbedder[source]

Bases: flambe.nlp.transformers.utils.TransformerEmbedder

Integrate the pytorch_transformers OpenAIGPTmodel.

Currently available aliases:
. openai-gpt
_cls[source]
class flambe.nlp.transformers.gpt.GPT2TextField[source]

Bases: flambe.nlp.transformers.utils.TransformerTextField

Integrate the pytorch_transformers GPT2Tokenizer.

Currently available aliases:
. gpt2 . gpt2-medium . gpt2-large
_cls[source]
class flambe.nlp.transformers.gpt.GPT2Embedder[source]

Bases: flambe.nlp.transformers.utils.TransformerEmbedder

Integrate the pytorch_transformers GPT2Model.

Currently available aliases:
. gpt2 . gpt2-medium . gpt2-large
_cls[source]