Synthetic efficiency

Scenario introduced in this work to better understand inference runtime performance of various models.

  • Task: ?
  • What: n/a
  • When: n/a
  • Who: n/a
  • Language: synthetic

  1. # eval

  2. # train

  3. truncated

  4. # prompt tokens

  5. # output tokens

  6. # trials