Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: messy draft for llama #220

Closed
wants to merge 77 commits into from
Closed

WIP: messy draft for llama #220

wants to merge 77 commits into from

Commits on Apr 26, 2023

  1. stop using the generation builder

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    0b159f1 View commit details
    Browse the repository at this point in the history

  2. fix partial issues

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    f928d60 View commit details
    Browse the repository at this point in the history

  3. test use accelerate

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    203bf5b View commit details
    Browse the repository at this point in the history

  4. test use accelerate

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    8058a38 View commit details
    Browse the repository at this point in the history

  5. fix devices hopefully

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    3c0178c View commit details
    Browse the repository at this point in the history

  6. fix partial

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    ec5a436 View commit details
    Browse the repository at this point in the history

  7. print the accelerate device

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    4035ac4 View commit details
    Browse the repository at this point in the history

  8. give up on accelerate

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    b22c0dc View commit details
    Browse the repository at this point in the history

  9. add fsdp

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    02c2f11 View commit details
    Browse the repository at this point in the history

  10. save changes

    @thejaminator
    thejaminator committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    b384b8a View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. commit wroking

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    bae6e1e View commit details
    Browse the repository at this point in the history

  2. refactor exception

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    9c0845d View commit details
    Browse the repository at this point in the history

  3. remove unneeded

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    e5c132f View commit details
    Browse the repository at this point in the history

  4. commit working dumb method

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    a8d161f View commit details
    Browse the repository at this point in the history

  5. set format in main process

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    c4a17f6 View commit details
    Browse the repository at this point in the history

  6. clone tensor

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    8b5d0d3 View commit details
    Browse the repository at this point in the history

  7. change fsdp to disable cpu_offload

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    538b119 View commit details
    Browse the repository at this point in the history

  8. set format to torch in test

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    808b152 View commit details
    Browse the repository at this point in the history

  9. fix closure bug not sharing memory

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    8ce7326 View commit details
    Browse the repository at this point in the history

  10. more logs

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    15834e8 View commit details
    Browse the repository at this point in the history

  11. log the output sent back

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    99c1cb9 View commit details
    Browse the repository at this point in the history

  12. more logs

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    08f6fbc View commit details
    Browse the repository at this point in the history

  13. shift it back to float32

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    f509688 View commit details
    Browse the repository at this point in the history

  14. print loaded closure

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    439cf8f View commit details
    Browse the repository at this point in the history

  15. add logging of sentinel

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    ae4e052 View commit details
    Browse the repository at this point in the history

  16. fix deadlock maybe?

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6ab5e53 View commit details
    Browse the repository at this point in the history

  17. add print for breaking

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    ae5eb25 View commit details
    Browse the repository at this point in the history

  18. more prints

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    0a0fc40 View commit details
    Browse the repository at this point in the history

  19. set low min mem for fsdp

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6d7fa08 View commit details
    Browse the repository at this point in the history

  20. set low min mem for fsdp

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    820388f View commit details
    Browse the repository at this point in the history

  21. add counter

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    bfb8e12 View commit details
    Browse the repository at this point in the history

  22. stop destroying the process group

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    943ae48 View commit details
    Browse the repository at this point in the history

  23. re log

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    f3aa91c View commit details
    Browse the repository at this point in the history

  24. replicate it by 2

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    e813a64 View commit details
    Browse the repository at this point in the history

  25. add assertions

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6649635 View commit details
    Browse the repository at this point in the history

  26. add type of exception

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    61cfce8 View commit details
    Browse the repository at this point in the history

  27. try increasing timeout

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    44ec152 View commit details
    Browse the repository at this point in the history

  28. try out not sending the sentinel

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    d24ded8 View commit details
    Browse the repository at this point in the history

  29. fix typo

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    7ffcbaf View commit details
    Browse the repository at this point in the history

  30. log more

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    eaf3f42 View commit details
    Browse the repository at this point in the history

  31. try waiting

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    ea2e2ff View commit details
    Browse the repository at this point in the history

  32. add sleep

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6fbacce View commit details
    Browse the repository at this point in the history

  33. make it 5

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    ea7694e View commit details
    Browse the repository at this point in the history

  34. skip destroying group

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    fdd854c View commit details
    Browse the repository at this point in the history

  35. try while true

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6b77cbb View commit details
    Browse the repository at this point in the history

  36. Revert "try while true" 

    This reverts commit 6b77cbb.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    e5960ef View commit details
    Browse the repository at this point in the history

  37. Revert "skip destroying group" 

    This reverts commit fdd854c.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    2e823ef View commit details
    Browse the repository at this point in the history

  38. Revert "make it 5" 

    This reverts commit ea7694e.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    659309b View commit details
    Browse the repository at this point in the history

  39. Revert "add sleep" 

    This reverts commit 6fbacce.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    9eac600 View commit details
    Browse the repository at this point in the history

  40. Revert "try waiting" 

    This reverts commit ea2e2ff.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    f5b8a53 View commit details
    Browse the repository at this point in the history

  41. Revert "log more" 

    This reverts commit eaf3f42.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    e644ec9 View commit details
    Browse the repository at this point in the history

  42. Revert "fix typo" 

    This reverts commit 7ffcbaf.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    322c9d8 View commit details
    Browse the repository at this point in the history

  43. Revert "try out not sending the sentinel" 

    This reverts commit d24ded8.
    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    a2bae35 View commit details
    Browse the repository at this point in the history

  44. set num workeres to 8

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    34448dc View commit details
    Browse the repository at this point in the history

  45. add commit

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    835562e View commit details
    Browse the repository at this point in the history

  46. fsdp_single rename

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6cf1c76 View commit details
    Browse the repository at this point in the history

  47. more logs

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    f81e6bf View commit details
    Browse the repository at this point in the history

  48. add range

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    d50cda7 View commit details
    Browse the repository at this point in the history

  49. disable cpu offload

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    00de896 View commit details
    Browse the repository at this point in the history

  50. set min memory by dividng

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    155e91f View commit details
    Browse the repository at this point in the history

  51. add more logs for tests

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    9b42104 View commit details
    Browse the repository at this point in the history

  52. rename tests

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    5accebb View commit details
    Browse the repository at this point in the history

  53. use a sentinel class

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    4fe807d View commit details
    Browse the repository at this point in the history

  54. add log for FSDP

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    cfa854b View commit details
    Browse the repository at this point in the history

  55. save changes

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    b1af49e View commit details
    Browse the repository at this point in the history

  56. add tol and better test

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    3804a84 View commit details
    Browse the repository at this point in the history

  57. fix fsdp?? with imap??

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    4d20887 View commit details
    Browse the repository at this point in the history

  58. add assert for outputs

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    2cd4401 View commit details
    Browse the repository at this point in the history

  59. add comment

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    72fc632 View commit details
    Browse the repository at this point in the history

  60. check it again

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    1fca929 View commit details
    Browse the repository at this point in the history

  61. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6c9920d View commit details
    Browse the repository at this point in the history

  62. fix imap

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    78c5847 View commit details
    Browse the repository at this point in the history

  63. fix assertion

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    192385b View commit details
    Browse the repository at this point in the history

  64. try second

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    edd67de View commit details
    Browse the repository at this point in the history

  65. try second

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    fceb165 View commit details
    Browse the repository at this point in the history

  66. fix intiialization

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    2772300 View commit details
    Browse the repository at this point in the history

  67. remove len hack

    @thejaminator
    thejaminator committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    0fd5411 View commit details
    Browse the repository at this point in the history