Skip to content

@xlite-dev xlite-dev

Change the repository type filter

All

    Repositories list

    60 repositories

    • ffpa-attn

      Public
      FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA.
      cudatensor-coresflash-attention
      cudatensor-coresflash-attention
      Cuda
      •
      Apache License 2.0
      •16•276•1•0•Updated Apr 30, 2026Apr 30, 2026

    • diffusers

      Public
      🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.
      Python
      •
      Apache License 2.0
      •7k•1•0•0•Updated Apr 28, 2026Apr 28, 2026

    • cutlass

      Public
      CUDA Templates and Python DSLs for High-Performance Linear Algebra
      C++
      •
      Other
      •1.8k•2•0•0•Updated Apr 28, 2026Apr 28, 2026

    • quack

      Public
      A Quirky Assortment of CuTe Kernels
      Python
      •
      Apache License 2.0
      •123•2•0•0•Updated Apr 28, 2026Apr 28, 2026

    • cache-dit

      Public
      A PyTorch-native inference engine with cache, parallelism, quantization for Diffusion Transformers.
      Python
      •
      Apache License 2.0
      •70•4•0•0•Updated Apr 22, 2026Apr 22, 2026

    • LeetCUDA

      Public
      📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉
      cudacuda-kernelscuda-demo
      cudacuda-kernelscuda-democuda-toolkitcuda-librarycuda-kernellearn-cudacuda-cpphgemmflash-attention
      Cuda
      •
      GNU General Public License v3.0
      •1.1k•11k•2•0•Updated Apr 20, 2026Apr 20, 2026

    • Awesome-LLM-Inference

      Public
      📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
      mlavllmllm-inference
      mlavllmllm-inferenceawesome-llmflash-attentiontensorrt-llmpaged-attentiondeepseekflash-attention-3deepseek-v3
      Python
      •
      GNU General Public License v3.0
      •372•5.2k•0•3•Updated Apr 20, 2026Apr 20, 2026

    • sglang

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      Python
      •
      Apache License 2.0
      •5.6k•1•0•0•Updated Apr 2, 2026Apr 2, 2026

    • TensorRT-LLM

      Public
      TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inferen…
      Python
      •
      Other
      •2.3k•1•0•0•Updated Apr 1, 2026Apr 1, 2026

    • nunchaku

      Public
      [ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
      Python
      •
      Apache License 2.0
      •245•3•0•0•Updated Mar 31, 2026Mar 31, 2026

    • Awesome-DiT-Inference

      Public
      📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉
      fluxwandiffusion
      fluxwandiffusionditsorastable-diffusionsdxlsd15deepcacheopen-sora-plan
      Python
      •
      GNU General Public License v3.0
      •26•544•0•0•Updated Mar 19, 2026Mar 19, 2026

    • lite.ai.toolkit

      Public
      🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
      tensorrtmnnncnn
      tensorrtmnnncnnonnxonnxruntimeyolov5tnnmnn-modelyoloxrobustvideomatting
      C++
      •
      GNU General Public License v3.0
      •777•4.4k•0•0•Updated Mar 19, 2026Mar 19, 2026

    • vllm-omni

      Public
      A framework for efficient model inference with omni-modality models
      Python
      •
      Apache License 2.0
      •861•1•0•0•Updated Mar 12, 2026Mar 12, 2026

    • Triton-distributed

      Public
      Distributed Compiler based on Triton for Parallel Systems
      Python
      •
      MIT License
      •139•0•0•0•Updated Mar 11, 2026Mar 11, 2026

    • ao

      Public
      PyTorch native quantization and sparsity for training and inference
      Python
      •
      Other
      •501•1•0•0•Updated Mar 10, 2026Mar 10, 2026

    • ComfyUI-CacheDiT

      Public
      Cache-DiT Node for Comfyui
      Python
      •
      Apache License 2.0
      •14•1•0•0•Updated Feb 3, 2026Feb 3, 2026

    • SageAttention

      Public
      Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics a…
      Cuda
      •
      Apache License 2.0
      •402•0•0•0•Updated Jan 22, 2026Jan 22, 2026

    • flux-fast

      Public
      A forked version of flux-fast that makes flux-fast even faster with cache-dit.
      Python
      •17•4•0•0•Updated Jan 5, 2026Jan 5, 2026

    • Qwen-Image

      Public
      Qwen-Image is a powerful image generation foundation model capable of complex text rendering and precise image editing.
      Python
      •
      Apache License 2.0
      •490•1•0•0•Updated Jan 1, 2026Jan 1, 2026

    • Z-Image

      Public
      Python
      •
      Apache License 2.0
      •752•1•0•0•Updated Dec 25, 2025Dec 25, 2025

    • ptx-isa-markdown

      Public
      PTX ISA 9.1 documentation converted to searchable markdown. Includes Claude Code skill for CUDA development.
      Python
      •34•0•0•0•Updated Dec 24, 2025Dec 24, 2025

    • cutile-learn

      Public
      NVIDIA cuTile learn
      Python
      •2•0•0•0•Updated Dec 9, 2025Dec 9, 2025

    • .github

      Public
      0•1•0•0•Updated Nov 25, 2025Nov 25, 2025

    • ImageReward

      Public
      [NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation
      Python
      •
      Apache License 2.0
      •91•0•0•0•Updated Oct 30, 2025Oct 30, 2025

    • longcat-video-fast

      Public
      🔥LongCat-Video 1.7x🎉 speedup: cache acceleration and 4/8-bits weight only.
      longcatlongcat-video
      longcatlongcat-video
      Python
      •0•8•1•0•Updated Oct 28, 2025Oct 28, 2025

    • LongCat-Video

      Public
      Python
      •
      MIT License
      •358•0•0•0•Updated Oct 28, 2025Oct 28, 2025

    • ComfyUI

      Public
      The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
      Python
      •
      GNU General Public License v3.0
      •13k•0•0•0•Updated Oct 27, 2025Oct 27, 2025

    • qwen-image-fast

      Public
      ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs
      qwen-imageqwen-image-lightningqwen-image-edit
      qwen-imageqwen-image-lightningqwen-image-editqwen-image-apiqwen-image-lora
      Python
      •
      Apache License 2.0
      •0•17•4•0•Updated Oct 24, 2025Oct 24, 2025

    • Kandinsky-5

      Public
      Kandinsky 5.0: A family of diffusion models for Video & Image generation
      Python
      •
      Apache License 2.0
      •59•0•0•0•Updated Oct 22, 2025Oct 22, 2025

    • Wan2.1

      Public
      Wan: Open and Advanced Large-Scale Video Generative Models
      Python
      •
      Apache License 2.0
      •2.7k•0•0•0•Updated Oct 17, 2025Oct 17, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.