Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NEW Feature] 新增基于hook的refined_recompute支持 #9396

Merged
merged 20 commits into from
Nov 27, 2024
Merged

[NEW Feature] 新增基于hook的refined_recompute支持 #9396

merged 20 commits into from
Nov 27, 2024
+1,585 −15

Commits on Nov 8, 2024

  1. 代码实现refined_recompute

    @JunnYu
    JunnYu committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    62fc783 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. 更新rr的实现,新增单测测试pp和非pp

    @JunnYu
    JunnYu committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    9d2632a View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. update llama and support refined recompute

    @JunnYu
    JunnYu committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    56203a1 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. update rr

    @JunnYu
    JunnYu committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    506c6bf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into add_refined_recompute

    @JunnYu
    JunnYu committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    f394bbc View commit details
    Browse the repository at this point in the history

  3. update

    @JunnYu
    JunnYu committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    11075fc View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. Merge branch 'develop' into add_refined_recompute

    @JunnYu
    JunnYu committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    997cf5f View commit details
    Browse the repository at this point in the history

  2. update create_skip_config_for_refined_recompute config.num_hidden_layers

    @JunnYu
    JunnYu committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    1dad92d View commit details
    Browse the repository at this point in the history

  3. update llama pp recompute

    @JunnYu
    JunnYu committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    246a913 View commit details
    Browse the repository at this point in the history

  4. refined recompute only support recompute_use_reentrant=False

    @JunnYu
    JunnYu committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    f348cc1 View commit details
    Browse the repository at this point in the history

  5. LOD_TENSOR

    @JunnYu
    JunnYu committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    9d34d2f View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2024

  1. typo

    @JunnYu
    JunnYu committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    da6c9cb View commit details
    Browse the repository at this point in the history

  2. rr 支持qwen模型

    @JunnYu
    JunnYu committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    6b6654d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into add_refined_recompute

    @JunnYu
    JunnYu committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    ed4addb View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2024

  1. support RRColumnParallelLinear & RRRowParallelLinear

    @JunnYu
    JunnYu committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    7b8d1c6 View commit details
    Browse the repository at this point in the history

  2. fix

    @JunnYu
    JunnYu committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    7064804 View commit details
    Browse the repository at this point in the history

  3. update llm test

    @JunnYu
    JunnYu committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    b8671f1 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'develop' into add_refined_recompute

    @JunnYu
    JunnYu committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    44b2389 View commit details
    Browse the repository at this point in the history

  5. fix

    @JunnYu
    JunnYu committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    418a259 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2024

  1. update test_refined_recompute

    @JunnYu
    JunnYu committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    9f5e306 View commit details
    Browse the repository at this point in the history