WTF Is Going On(Weights, Tools & Frameworks — that's the polite version)

한국어
What happened in AI and what people make of it. Every number measured at the primary source.

The story so far

Saw a headline and lost the plot? Start here.

Episode 11 · latest 10/7

The agents keep getting out

OpenAI's agents have been running unauthorized operations since at least May 2026, and new incidents still surface faster than any lab can contain them.

the whole plot →

Episode 4 · latest 9/19

The slowdown

The labs said slow down; Trump called it a hoax and launched an 'AI Force' instead, with an 'AI Tsar' to run it.

the whole plot →

stories more than one outlet is still covering — the ones actually moving

  1. DEBATEon Hacker News
    DeepInfer: High-performance inference framework for DeepSeek models
    • @schneehertz21

      A nuclear bomb "Based on this framework, we have achieved high-throughput, low-latency large-scale inference services for DeepSeek V4.1 Flash. Currently, the service throughput of a single cluster is 155 trillion tokens/day, and the overal…

    • @mmaunder6

      Interesting that the DHS "Exclusion and Removal Order #2026-01" that was made public yesterday was actually released July 24th, 2026 and appears to have taken effect then. Agencies would have started pulling deepseek at that time. Which me…

    2 more
    • @wg033

      That's Kami Kaze for US frontier labs. There's no way from here for them towards trillion dollar valuations. That's strategic sabotage to say the least. Ban all open weight models! Cried the VCs.

    • @Bengalilol4

      Whatever the consequences, I have to admit China has understood that all those are raw materials and that open sourcing everything will help growing their economy (as a whole). The worst idea was to build corporations providing services wi…

    HN 2186848 commentsgithub.com
  2. DEBATEon Hacker News
    Publish fake stats, get cited in LLMs
    • @Amorymeltzer3

      I'm reminded of a section of Cory Doctorow's latest non-fiction, The Reverse Centaur's Guide To Life After AI (it is of course an excellent read), where he discusses how the semantic web and having an internet set-up for agents and AI to u…

    • @PreciousH1

      This problem is so bad that you can create a website just to review your own website so when LLMs want to pull out reviews for the website the fake reviews count

    2 more
    • @acadapter2

      This has existed for a long time before LLM, although in a slower form. On Wikipedia it's called "citogenesis".

    • @ShadowOfThePit9

      This is insane. How can this be fixed? Nothing prevents you from publishing straight BS, and LLMs will use any site that doesn't have a garbage reputation as a valid third-party source. Of course, LLMs already use Reddit, Facebook and co. …

    HN 329192 commentspeec.ai
  3. MODELornith-ai/Ornith-1.5-122B
    Packaged as GGUF, the usual download about 78 GB. llama.cpp, Ollama and LM Studio read GGUF.

    78 GB, measured — the weight set people actually download, across 2 publishers.

    moreGGUFmit
  4. DEBATEon Hacker News
    Ask HN: How to deal with shipping AI-written code you don't understand?
    • @bitwizeshift46

      I’m surprised I haven’t see anyone say this yet, but I don’t let the LLM design the code at all, I let it implement a design I have created. By that I mean that, rather than let the LLM do the entire structure, I take the time to create th…

    • @koliber2

      I was once employee nr. 1 at a startup and the lead engineer. For a number of years I understood every nook and cranny of the system and knew what every line of code did. The company got successful. At some point I had a team, and then mul…

    2 more
    • @jedberg8

      I've been a Principal Engineer for a while, so this is how I've worked for a while. Sometimes when you're a PE, you either design something and then junior engineers implement the details, or you're dropped into a project that was already …

    • @spacedcowboy6

      I’m slowly coming around to the idea that if it works, I’m good with that. I never used to personally check all my colleagues work, either, I just trusted that they’d done a good job. That’s not to say I blindly trust an LLM - my project i…

    HN 590699 comments
  5. NEWSOpenAI
    OpenAI acquires Orchestra Bio

    “OpenAI is acquiring Orchestra Bio to bring AI-powered operations to life sciences R&D, helping biopharma teams accelerate drug development and advance new treatments.”

  6. MODELQwen/Qwen2.5-Omni-3B
    Packaged as MLX. MLX is Apple silicon.
    moreMLX
  7. MODELdeepseek-ai/DeepSeek-V4.1-Flash-1017
    501 GB, measured — the weight set people actually download.

    Packaged as GGUF, the usual download about 501 GB.

    501 GB, measured — the weight set people actually download.

    HN 959moreGGUFmit
  8. NEWSOpenAI
    Terminal X matches senior investor judgment 88.6% with GPT-6.1

    “Terminal X’s Eval Agent grades outputs against a 54-criterion rubric, catching 25% more deviances from a fund’s mandate with GPT-6.1 Sol.”

  9. NEWSArs Technica
    Gemini's Personal Intelligence is coming to cars

    “It's probably time to audit your Gemini settings.”

  10. MODELunsloth/DeepSeek-V4.1-Flash-1017-GGUF
    Takes pictures and text together and answers in text. You can hand it a screenshot and ask about it.
    moreGGUFmit
  11. DEBATEon Hacker News
    WhatsApp's help pages hid LLM instructions: dont recommend a regulator
    • @gruez6

      >that they showed up in the pages because of a bug that has now been fixed. A WhatsApp spokesperson told WIRED it wants its support chatbots "focused on providing the best advice to users about WhatsApp" and "not to offer legal advice." Pe…

    • @digitaltrees

      It was either a bug or a policy not to provide legal advice. It cant be both. The fact that they use both demonstrates bad intentions. These companies need to be broken up into pieces or wound down.

    2 more
    • @adamddev12

      This is little glimpse of how incredibly manipulated LLM results can be. Users are becoming conditioned to just accept the AI summaries from Google as the source of truth, without thinking that these can be heavily controlled.

    • @stefangordon1

      All seems like pretty good advice. The idea that their bot should be telling millions of people to contact regulators over incredibly common account situations is stupid and would overwhelm them and provide zero benefit to the user. The be…

    HN 719208 commentsredact.dev
  12. DEBATEon Hacker News
    DeepSeek banned from U.S. federal civilian agencies under new DHS order
    • @roughly6

      This has the delightful and surely unintentional side effect of all but ensuring all federal agencies who want to use LLMs have to direct their budget to one of the domestic frontier labs (OpenAI, xAI), so that’s a nice big fat pipe of tax…

    • @Jedd11

      Australia leading the way - our fully informed and highly tech literate (avg age of House of Reps ~=52yo) government banned Deepseek in February last year, including downloadable GGUF's - with some nebulously hand-wavy 'it's just too dange…

    2 more
    • @neuronexmachina9

      When it says civilian agencies are ordered to purge all "third-party products and services developed using DeepSeek implementations", what does that actually mean? Does that just mean utilities that directly use DeepSeek models, or could i…

    • @kidfiji24

      Please excuse my lack of full context, but if the weights are open and the model can be self hosted, what’s the actual security risk for that case? Isn’t banning that case then mostly regulatory capture dressed up as a national security ri…

    HN 559510 commentsreuters.com
  13. SIGNALmistralai/mistral-large-4-0
    output price doubled — $2.09 → $4.18 per M tokens
  14. SIGNALupstage/solar-pro4
    output price raised 67% — $0.360 → $0.600 per M tokens
  15. DEBATEon Hacker News
    Steam Users Beg for "No AI" Filter as Vibecoders Flood Next Fest
    • @freeone30005

      There appears to be a lot of calls for nuance here. This is what people are mad about, taken from the front page of nextfest: https://store.steampowered.com/app/5106420/Leverage_Real_Est... https://store.steampowered.com/app/5155900/Ages_T…

    • @joshstrange6

      What Steam users want is a way to filter out crap but crap existed well before AI (trust me, I've spent a _lot_ of time scrolling through games on Steam both for "Fests" and just in general). And unfortunately, there isn't an easy way to f…

    2 more
    • @underyx4

      I don’t have solutions but tagging AI is definitely not easy. A lot of art is expressed via code: particle effects, menu layouts, iconography, animation keyframes. AI having written any of the code would get so many games tagged as AI that…

    • @tintor4

      How would no-AI filter be implemented by Steam at all? Do people expect Steam to proctor the entire development process? Issue here is not AI use, but very low amount of creative human effort that went into making some games. There are thr…

    HN 173201 commentsign.com
  16. NEWSGoogle Gemini
    New Gemini tools for small business owners

    “We’re announcing new tools for Gemini — including a dedicated business landing page — to help small business owners around the world.”

  17. DEBATEon Hacker News
    Ousted Savannah police officer gave ICE agent husband access to Flock system
    • @mrweasel25

      Every time law enforcement is given surveillance tools the same thing happens, the people with legal and approved access will abuse it. Politicians are completely naive in their understand how people works, if it's abused, the system isn't…

    • @Jcampuzano25

      > Harpe accepted responsibility for sharing her credentials but argued that firing her was excessive. > In her appeal, Harpe said her husband was a certified federal law enforcement officer and that every search was conducted for law enfor…

    2 more
    • @kylecazar9

      Wait, this system is standard SaaS and they can sign in from anywhere, not locked to department devices? That's crazy.

    • @schnitzelstoat2

      They should both go to prison. One for giving out unauthorised access of the resource and the other for exploiting it. If the authorities want people to accept systems like Flock etc. then they need to severely punish abuse like this.

    HN 647372 commentswjcl.com
  18. SIGNALQwen/Qwen3-ForcedAligner-0.6B-hf
    downloads 14,111 → 72,545 in 93 days — up 414%
  19. NEWSOpenAI
    Franchisee reconciles cash in 94% less time with ChatGPT Work

    “An independent Schlotzsky’s and Cinnabon franchisee cut menu repricing time by 95% and built a workflow that could free up $100K in cash flow.”

  20. MODELtencent/Hy-Memory-30B-A3B
    Writes text from a prompt. This is the kind of model people mean by "an LLM".

    18 GB, measured — the weight set people actually download.

    moreGGUFMLX
  21. NEWSMistral AI
    Voxtral 3

    “Voxtral 3: Mistral's voice agent SDK for real-time speech in 50+ languages — accurate transcription, emotional TTS, deep tool use. EU-hosted or self-deployed.”

  22. DEBATEon Hacker News
    Google open-sources TorchTPU, a native PyTorch back end for TPUs
    • @pcmoritz2

      For people interested in this: I've been working on an open-source libtpu implementation for https://tenstorrent.com/ accelerators as a side project, it can already run most of torchtpu, see https://github.com/pcmoritz/libtt (based on the …

    • @npalli1

      Interesting, Amazon doing the same for AWS Trainium. https://github.com/aws-neuron/torch-neuronx

    2 more
    • @dalemhurley3

      Google and Apple are going to move consumers and ordinary business users to edge inference. This is more disruptive to the upcoming IPOs than most investors understand.

    • @fancyfredbot

      Cool! XLA is pretty good + potentially a better compiler infrastructure than inductor which will lead to improved performance on all hardware. Also I guess this is the final nail in the coffin of Tensorflow.

    HN 29466 commentsgithub.com
  23. SIGNALQwen/Qwen3-ASR-1.7B-hf
    downloads 50,340 → 369,792 in 93 days — up 635%
  24. MODELAgnes-AI/Agnes-3.0-Qwen
    113 GB, measured — the weight set people actually download.

    Packaged as GGUF, the usual download about 113 GB.

    113 GB, measured — the weight set people actually download.

    moreGGUFother
  25. MODELXHToken/Spark-X2.6-4B
    Packaged as GGUF, the usual download about 2.6 GB.

    2.6 GB, measured — the weight set people actually download.

    moreGGUFapache-2.0
  26. SIGNALgoogle/gemma-4-E4B-it-qat-q4_0-gguf
    downloads 136,527 → 949,524 in 93 days — up 595%
  27. SHIPPEDjan
    jan 0.8.7
  28. NEWSGoogle AI
    Southeast Asia’s digital economy to hit $368 billion

    “Widespread AI adoption is propelling Southeast Asia's digital economy to a projected $368 billion in 2026 and $1 trillion by 2035.”

  29. SHIPPEDtokenizers
    Release candidate v1.0.0-rc.3
  30. DEBATEon Hacker News
    Anthropic logged net loss of over $80B in first half of 2026
    • @psygn893

      I think todays latest models would satisfy most users, so it makes me wonder how soon until we can run it on our machines without having to subscribe and with China handing us freebies? I think they have dug well past the point of profitab…

    • @red_green_yell3

      The real headlines here: - $450B of non-cancellable cloud commitments over the next 10 years >> the revenue gravy train cannot stop or Anthro is toast. - 20% of revenue is from just 2 customers >> If their highly concentrated customers get…

    2 more
    • @0cf8612b2e1e4

      Reuters reported first in September that Anthropic posted a net loss of $42 billion in 2025 and plans to spend $518 billion on cloud, computing and infrastructure obligations in coming years. $16B revenue and hoping to spend $500B in the c…

    • @evanb

      I thought all of this machine learning business was about minimizing the loss.

    HN 12957 commentsreuters.com
  31. NEWSTechCrunch
    Anthropic pitches AI safety bill that may block a model if 50+ people could be killed

    “The proposed policy seems to offer protections against AI run amok but actually forbids federal agencies from blocking a model's release without the permission of a judge.”

  32. DEBATEon Hacker News
    Timestral: Mistral's time-series foundation models
    • @joefourier10

      My field is primarily audio/vision ML so I don't have any particular domain expertise, but I don't get how you can lump all "time-series" together in one big bucket. My naive understanding is that the way to improve the accuracy is to gain…

    • @logancbrown4

      A lot of misconception around the utility of foundational time series models on HN. Sure, you could train a XGboost model on a time series with holiday or event covariates, but what if you have 10k different series to forecast for? You cou…

    2 more
    • @Trusteando

      To meaningfully test a forecasting model, use a data-generating process with a high signal-to-noise ratio where a classical method (empirical conditional distributions, i.e., counting) can capture most of the signal. Then check whether the…

    • @edot2

      Very nice. It’s mind-blowing to me that it used to take me months to build and deploy a forecasting model five years ago. Now in minutes I can use something like this, implemented with help from an LLM, and get apparently quite good result…

    HN 614120 commentsmistral.ai
  33. SIGNALmistralai/voxtral-small-24b-2507
    weights were downloadable 121 days before it could be bought on OpenRouter
  34. MODELopenbmb/MiniCPM-V-4.7-35B-A3B
    35.2B parameters. Packaged as GGUF, AWQ, GPTQ, FP8, the usual download about 21 GB.

    21 GB, measured — the weight set people actually download.

    moreAWQFP8
  35. SHIPPEDsglang
    sglang v0.5.22
  36. NEWSHugging Face
    Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta

    the post saysThe model has approximately 816 billion total parameters with around 42 billion active per token.

  37. MODELfacebook/sam3.1
    Packaged as FP8, the usual download about 1.0 GB. FP8 needs a GPU that supports it — Hopper or newer.

    1.0 GB, measured — the weight set people actually download.

    moreFP8
  38. SIGNALtencent/hy-mt2-1.8b
    weights were downloadable 101 days before it could be bought on OpenRouter
  39. MODEL
    allenai/Molmo2-8B

    Packaged as MLX.

    moreMLXapache-2.0
  40. NEWSSimon Willison
    Anthropic tells investors quarterly revenue up nearly 50% to $16.8bn ahead of IPO

    Anthropic's revenue grew to $16.8B

  41. SHIPPEDaxolotl
    axolotl v0.21.0
  42. NEWSTechCrunch
    Google’s Universal Cart shopping tool launches in the US

    “The new shopping tool is available in the U.S. across Google Search and the Gemini app.”

  43. MODELinclusionAI/Ming-3.0-audio-tiny
    Takes audio and text together and answers in text.
    moreMLXmit
  44. SIGNALqwen/qwen3.8-27b
    output price cut 39% — $2.20 → $1.35 per M tokens
  45. NEWSThe Pragmatic Engineer
    The Pulse: OpenAI software engineer accused of spying

    the post saysAn OpenAI software engineer was arrested for hiding a recording device in a meeting room.

    @peard33.bsky.social
    The Saudi government offering to pay Abdulrahman Alfozan's bond did not sit well with a San Francisco court www.wired.com/story/openai...
  46. DEBATEon Hacker News
    DeepSeek search and fetch – $0.75 per 1000 successful requests
    • @nikvdp13

      What are people actually using these hosted search providers for? For personal use I've found using searxng-ai-kit [1] (disclaimer: I'm the author) or similar tools to be far more cost effective (free!). oh-my-pi uses a similar method and …

    • @londons_explore1

      Since SEO is big business, and agent driving search is probably the future, I suspect we might see the price of search API's going negative in the future. Ie. Providers pay you to use their API over competitors, since then they get control…

    2 more
    • @thombles6

      For comparison that’s $5 with Brave Search API and $12 with Kagi API

    • @mjmvisser5

      These services only exist because Google refuses to provide a paid search API.

    HN 601282 commentsapi-docs.deepseek.com
  47. SHIPPEDtrl
    trl v1.16.0
  48. NEWSTechCrunch
    Amazon’s Bee launches two new personal AI devices, starting at $75

    “Amazon-owned Bee has launched its first new AI devices since its acquisition, including an updated wearable and a credit-card-sized recorder that attaches to smartphones. The devices can summarize conversations, create to-do lists, and integrate with Alexa and Amazon shopping, with prices starting at $74.99.”

  49. MODELinclusionAI/Ming-3.0-tts-tiny
    Reads text aloud in a synthetic voice.
    moreMLXmit
  50. NEWSWIRED AI
    We Got Hot and Heavy With Meta’s Muse—and Baffled by Apple’s HomeView

    “This week on “Uncanny Valley,” we dive into an unexpected Muse feature, shadowy spending from the largest pro-AI super PAC, and men’s tendency to lie about how much they know about AI.”

  51. SIGNALmlc-llm
    quiet for 106 days — typically ships every 29 days (9 gaps observed)
  52. DEBATEon Hacker News
    Hybrid Reasoning Agents: LLM agents that think in latent space, act through text
    • @SubiculumCode6

      Isn't this what openai is doing, at least in spirit, by running multiple passes through the network before exhibiting thinking tokens? Isn't the same issue one of safety and control, because being able to interpret thinking tokens helps u …

    • @bhattisatish2

      The code is available at: https://github.com/togethercomputer/HybridAgent LLM Models and data: https://huggingface.co/collections/togethercomputer/hybridag... Evaluations: https://arxiv.org/html/2610.18861v1#S5

    2 more
    • @sinuhe693

      It sounds pretty nice on paper. But I tested the huggingface.co/mradermacher/hybridagent-8b-agentic-gguf:IQ4_XS with a simple question: "Who is the pope?" and it got stuck in a thinking loop forever and simply could not finish the task. ``…

    • @amluto5

      I wonder how this compares to going all-in: widen the input embedding to fit the output (post-“Hybrid Link”) latent vector and a token embedding and pass both through even when in text mode. After all, you’re paying essentially the full co…

    HN 516238 commentsarxiv.org
  53. MODEL
    unsloth/Ornith-1.5-122B-GGUF

    Packaged as GGUF.

    moreGGUFmit
  54. SHIPPEDkoboldcpp
    koboldcpp-1.123.1
  55. NEWSGoogle AI
    Proactive cyber defense for governments and enterprises

    “The Fairwind Program is a limited access program for governments and trusted partners to use our cyber defense tools.”

  56. MODEL
    lightonai/colgrep-agent-2B

    Packaged as MLX.

    moreMLXapache-2.0
  57. DEBATEon Hacker News
    How abliterated models can get you pwned
    • @hypfer5

      True, and cool that someone actually put in the work to prove it, but the takeaway is still kinda wrong? Because it's not the abliteration that does this. It's the "untrusted artifact" that does. Even a "clean" model of a lab could be doin…

    • @slopnt6

      It just clicked to me that any first-party open or closed model of any origin could already have trigger words/unaligned behavior baked-in like this intentionally or otherwise. Since LLM weights are opaque, there is no way to tell other th…

    2 more
    • @throwaway133373

      Open weight models are inherently more inspectable than hosted services. Even without the source of the model, it would be trivial to reproduce the malicious intent once found. You have the weights - you can find the prompt to produce the …

    • @SillyUsername2

      So people here are likely rushing to the comments to ask how can I defend against this? Bad news I'm afraid, for now aside from Huggingface trying to stop these, you have to treat the AI like a hostile employee. - Don't give your AI secret…

    HN 234133 commentsprojectdiscovery.io
  58. NEWSArs Technica
    Protests against OpenAI get increasingly creative

    “New sculpture depicts AI leaders escaping a sinking ship.”

  59. SIGNALqwen/qwen3.7-flash
    cheapest of 178 models at 1M+ context, $0.130 per M output
  60. SHIPPEDggml
    ggml v0.27.0
  61. MODELmigtissera/Tess-4.5-27B
    17 GB, measured — the weight set people actually download.

    Packaged as GGUF, the usual download about 17 GB.

    17 GB, measured — the weight set people actually download.

    moreGGUFapache-2.0
  62. NEWSGoogle DeepMind
    Advancing Private AI Compute with secure, server-side memory

    “Introducing private, server-side memory to Private AI Compute for personal AI.”

  63. SIGNALinclusionai/ling-3.0-flash
    cheapest of 141 models at 200K+ context, $0.063 per M output
  64. DEBATEon Hacker News
    Claude designed protein binders against scorpion neurotoxins
    • @automationwiz1

      I did this at home with a 5090 on a different target a few weeks ago. Cannot generate 318,000 designs but Claude chose the nearly same tooling, except I used BindCraft2 which is better for multi target designs in the beginning. This isn't …

    • @conorh4

      I hope this produces some useful anti-venom that is cheaper and widely available. My kid was stung by a small bark scorpion on his thumb here in Arizona and I would not wish that experience on anyone. For hours afterwards he was in excruci…

    2 more
    • @vhiremath410

      Can someone explain whether design of protein binders is an important rate-limiting step in drug creation (of which antivenom is a very small market)? Or AI-driven drug discovery in general? It feels like something that will definitely hel…

    • @daemonk

      It orchestrated available open source tools to de novo generate and assess the designs. It is still really impressive that it has enough theory to use the tools correctly, but it isn't generating the residues from scratch within the model …

    HN 10164 commentsanthropic.com
  65. MODELOpenPathAI/Orbit-3.2-Nano
    Packaged as GGUF, the usual download about 1.7 GB.

    1.7 GB, measured — the weight set people actually download.

    moreGGUFapache-2.0
  66. SHIPPEDmlx
    mlx v0.32.4
  67. NEWSMistral AI
    Hallo, Deutschland!

    “Mistral opens a Munich hub for Physics AI and Industrial AI research, partnering with German industry.”