Daily digest for 2026-11-07 · 6 new stories (previously covered stories are never reposted)
Quoting Nilay PatelSimon Willison · 2026-11-06
The products aren't good enough to sell people on the costs. You cannot tell people that you have to listen to the whine of a data center in their backyard for AI overviews and some of the most hilarious deep fake slop in history. It's not worth it. It just isn't worth it to anyo
b12181: hexagon: fuse post-norm residual add into RMS_NORM_MUL (#31822)llama.cpp Releases · 2026-11-07
hexagon: fuse post-norm residual add into RMS_NORM_MUL hex-fusion: refactor RMS_NORM fusion and add dedicated RMS_NORM_MUL_ADD opcode Improves performance by keeping things in HVX registers. Also simplifies overall fusion logic and logging. Co-authored-by: Max Krasnyansky maxk@qt
b12189llama.cpp Releases · 2026-11-07
metal : fix GROUP_NORM for ne03 > 1 and non-contiguous inputs ( #31852 ) The kernel_group_norm_f32 kernel and its host dispatch ignored the batch dimension (ne03) of the source tensor: only ngrp threadgroups were dispatched and each normalized the flat range [tgpig gs, (tgpig+1)
b12188llama.cpp Releases · 2026-11-07
server: visit parent slots before child slots ( #30779 ) server: visit parent slots before child slots A parent slot wakes its waiting child slots once it finishes the shared prompt prefix, while slots are visited in id order. When a child task lands on a lower slot id than its p