Code

Ft llama opt#762

Code

Open

dypshong wants to merge 60 commits intoNVIDIA:mainNVIDIA/FasterTransformer:mainfrom shongshong2:ft-llama-optshongshong2/FasterTransformer:ft-llama-optCopy head branch name to clipboard

+5,430-497

Commits

Commits on Sep 11, 2023

• fix readme

  dypshong

  committed
  bf93524

• add lamma template

  dypshong

  committed
  6bbba86

Commits on Sep 12, 2023

• rename varaible

  dypshong

  committed
  a0276fb

• dump

  dypshong

  committed
  a590e94

• add examples

  dypshong

  committed
  a763d18

Commits on Sep 13, 2023

• llama......

  dypshong

  committed
  2cb06f1

• remove gpt dependency

  dypshong

  committed
  ca0a25a

Commits on Sep 15, 2023

• fix loadModel to load llama & fix invokeGeneralLLaMALayerNorm to invoke RMSNorm

  dypshong

  committed
  662d3b6

• remove debug code and bug fix

  dypshong

  committed
  dbe0657

• only contextdecoder is necessary

  dypshong

  committed
  29c7b69

• dump

  dypshong

  committed
  1494d2f

Commits on Sep 16, 2023

• dump

  dypshong

  committed
  81dc94a

• for junsik

  dypshong

  committed
  d5b2c12

• first success

  dypshong

  committed
  8ec39b5

• remove debugging code print

  dypshong

  committed
  4434e65

• remove debugging code

  dypshong

  committed
  95a7efe

Commits on Sep 18, 2023

• LLaMA Constructor fix

  dypshong

  committed
  0a0015d

• llama-opt

  dypshong

  committed
  6ed3747

• buf fix

  dypshong

  committed
  321bc73

• dump

  dypshong

  committed
  837e9d7

• add gemm_cofing.in

  dypshong

  committed
  56c3325

Commits on Sep 19, 2023

• remove backup file trace

  dypshong

  committed
  4a0a9d7

• remove gemm_config.in

  dypshong

  committed
  e63b85b

Commits on Sep 20, 2023

• dumdump

  dypshong

  committed
  3a10308

Commits on Sep 22, 2023

• test done

  dypshong

  committed
  be29883

Commits on Sep 23, 2023

• debug code

  dypshong

  committed
  d403986

Commits on Sep 24, 2023

• dump

  dypshong

  committed
  db6efdd

• dmpdmp

  dypshong

  committed
  6e09959

• dp

  dypshong

  committed
  cf8087a

Commits on Sep 25, 2023

• dmp

  dypshong

  committed
  13478f4

• no cache version

  dypshong

  committed
  df743e0

• no-cache version bug fix

  dypshong

  committed
  220aec0

• cache version

  dypshong

  committed
  4fb06e7

• Merge pull request #1 from shongshong2/llama-cache

  Show description for 5f10b4e
  dypshong

  authored
  5f10b4e

• remove logging

  dypshong

  committed
  857d956

• Merge branch 'llama-cache' into main

  dypshong

  committed
  2609e97

Commits on Sep 26, 2023

• remove README

  dypshong

  committed
  3074afa

• Merge branch 'main' of https://github.com/shongshong2/FasterTransformer into main

  dypshong

  committed
  d472912

• overlap

  dypshong

  committed
  8092007

Commits on Sep 27, 2023

• overlapping versino

  dypshong

  committed
  1187340

Commits on Sep 29, 2023

• start_pos for each sample

  dypshong

  committed
  949c4e7

• get back start_pos

  dypshong

  committed
  083f3bb

• debug

  dypshong

  committed
  f08ada9

• chkpt

  dypshong

  committed
  e5d92df

• ckpt

  dypshong

  committed
  433f2c9

Commits on Sep 30, 2023

• ckpt

  dypshong

  committed
  b63b496

• 08:42

  dypshong

  committed
  6ee6105

• # input check bug fix

  dypshong

  committed
  1955508

• code rf

  dypshong

  committed
  57dded4

• add macro

  dypshong

  committed
  d3a83aa

• 07_03

  dypshong

  committed
  1365462

• add multiple devent

  dypshong

  committed
  305540f

Commits on Oct 1, 2023

• ft_llama-06_48

  dypshong

  committed
  294a6fc

• ref

  dypshong

  committed
  a7e7089

• Merge pull request #2 from shongshong2/ft_llama-06_48

  Show description for b8f34e0
  dypshong

  authored
  b8f34e0

• remove mpi requirement

  dypshong

  committed
  5515d83

• Merge pull request #3 from shongshong2/ft-llama-opt

  Show description for 9b38f6e
  dypshong

  authored
  9b38f6e

• add mpi_cxx

  dypshong

  committed
  ce8c72a

• ref

  dypshong

  committed
  48b35f7

Commits on Oct 2, 2023

• final

  dypshong

  committed
  baca61b