flambe.metric.dev.perplexity

Module Contents

class flambe.metric.dev.perplexity.Perplexity[source]

Bases: flambe.metric.Metric

Token level perplexity, computed a exp(cross_entropy).

compute(self, pred: torch.Tensor, target: torch.Tensor)[source]

Compute the preplexity given the input and target.

Parameters:
  • pred (torch.Tensor) – input logits of shape (B x N)
  • target (torch.LontTensor) – target tensor of shape (B)
Returns:

Output perplexity

Return type:

torch.float