MoBA: Mixture of Block Attention for Long-Context LLMs
MoBA's block-sparse attention enables Lightbulb Partners's long-context RAG queries and extended agent reasoning chains efficiently.
MoBA's block-sparse attention enables Lightbulb Partners's long-context RAG queries and extended agent reasoning chains efficiently.