WTF Is Going On(Weights, Tools & Frameworks)

한국어
TheBloke/Goliath-longLORA-120b-rope8-32k-fp16-AWQ
text-generation llama2 AWQ

What this is

118B parameters. Writes text from a prompt. This is the kind of model people mean by "an LLM".

Packaged as AWQ. AWQ needs a GPU serving stack such as vLLM.

llama2 — the lab's own terms rather than a standard licence. Worth reading before you ship.

Release chainonly the steps this archive can prove

  1. weights posted2024-01-27

Measured herefrom our own daily capture — upstream publishes today only · 4 days in this window were never captured

← the board