Issues

• Try pytorch inference mode

  bigcode-project/bigcode-inference-benchmark#12 · Filter by author jlamypoirier opened on Jan 30, 2023

• Inference tasks and milestones

  bigcode-project/bigcode-inference-benchmark#11 · Filter by author jlamypoirier opened on Jan 26, 2023

• Improve inference speed of multi-query attention model

  help wanted
  bigcode-project/bigcode-inference-benchmark#3 · Filter by author harm-devries opened on Sep 23, 2022
  2