Fresh off Red Hat Summit, Chris is eyeing an exit from NixOS. What's luring him back to the mainstream? Our highlights, and the signal from the noise from open source's biggest event of the year.
Red Hat Enterprise Linux 10 Officially Released, Here's What's New β Red Hat Enterprise Linux 10 highlights include Red Hat Enterprise Linux Lightspeed for integrating generative AI directly within the platform to provide users with context-aware guidance and actionable recommendations through a natural language interface.
FIPS 203/204/205 β These standards specify key establishment and digital signature schemes that are designed to resist future attacks by quantum computers, which threaten the security of current standards.
llm-d β llm-d is a Kubernetes-native high-performance distributed LLM inference framework
What is vLLM? β vLLM is an inference server that speeds up the output of generative AI applications by making better use of the GPU memory.
Image mode for Red Hat Enterprise Linux β Image mode leverages the bootc tool to build and deploy Red Hat Enterprise Linux. Bootc stands for bootable container, and the image will include the kernel, bootloader, and other items typically excluded from application containers.
Bluefin β Featuring automatic image-based updates and a simple graphical application store, Bluefin is designed to get out of your way. Get what you want without sacrificing system stability.
KongrooParadox's nixfiles β This was my second nixos release since getting into Nix last year (February I think), and this strategy made it really painless. No surprises about deprecated options since I saw these cases slowly when these changes hit unstable.
Pick: RamaLama β Make working with AI boring through the use of OCI containers.
ramalama on GitHub β RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.