Skip to content
@foundation-model-stack

Foundation Model Stack

IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Pinned Loading

  1. foundation-model-stack foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    Python 130 35

  2. fms-fsdp fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    Python 135 24

  3. fms-hf-tuning fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    Python 15 38

  4. fms-acceleration fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    Python 2 6

  5. fms-guardrails-orchestrator fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    Rust 9

Repositories

Showing 10 of 19 repositories
  • fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    foundation-model-stack/fms-hf-tuning’s past year of commit activity
    Python 15 Apache-2.0 38 20 (2 issues need help) 15 Updated Aug 15, 2024
  • fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    foundation-model-stack/fms-acceleration’s past year of commit activity
    Python 2 Apache-2.0 6 8 2 Updated Aug 15, 2024
  • fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    foundation-model-stack/fms-fsdp’s past year of commit activity
    Python 135 Apache-2.0 24 11 6 Updated Aug 15, 2024
  • fms-dgt Public

    Synthetic Data Generation for Foundation Models

    foundation-model-stack/fms-dgt’s past year of commit activity
    Python 10 Apache-2.0 11 1 3 Updated Aug 14, 2024
  • fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    foundation-model-stack/fms-guardrails-orchestrator’s past year of commit activity
    Rust 0 Apache-2.0 9 17 (1 issue needs help) 3 Updated Aug 14, 2024
  • foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    foundation-model-stack/foundation-model-stack’s past year of commit activity
    Python 130 Apache-2.0 35 33 (4 issues need help) 29 Updated Aug 14, 2024
  • fm-training-estimator Public

    Estimate resources needed to train LLMs

    foundation-model-stack/fm-training-estimator’s past year of commit activity
    Python 7 Apache-2.0 2 2 1 Updated Aug 13, 2024
  • hf-resource-scanner Public

    Scan resources consumed during LLM training

    foundation-model-stack/hf-resource-scanner’s past year of commit activity
    Python 7 Apache-2.0 1 0 0 Updated Jul 31, 2024
  • foundation-model-stack/fms-lm-eval-service’s past year of commit activity
    Go 1 Apache-2.0 1 10 1 Updated Jul 30, 2024
  • moe-distributed-training Public

    Demonstration of MoE distributed training using various techniques

    foundation-model-stack/moe-distributed-training’s past year of commit activity
    Python 0 0 0 0 Updated Jul 30, 2024

Top languages

Loading…

Most used topics

Loading…