Nexteam is sponsoring this newsletter. Please tell your friends and colleagues about this publication. Thank you.
Courtesy of NASA - Unsplash
Rethinking Datacenters: Schneider Electric Addresses AI Workload Challenges and Advocates for Liquid Cooling
Schneider Electric's recent white paper suggests that accommodating AI workloads requires reevaluating data centre construction due to their demand for low-latency, high-bandwidth networking and intense power consumption. Existing data centres face challenges, as AI workloads push the limits of what most facilities can manage, potentially introducing bottlenecks that hinder performance. The paper recommends changes to power delivery, cooling, and rack configurations, including a shift towards liquid cooling, particularly direct liquid cooling, for efficient thermal management beyond 20kW per rack.
Self-hosted GitHub runners on AWS
https://cloudonaut.io/self-hosted-github-runners-on-aws/
Serverless Bun vs Node: Benchmarking on AWS Lambda
NodeJS has long been the industry standard for JavaScript server environments. Still, a new runtime, Bun, has shown promising results in benchmarks for CPU-bound tasks and is on par with Node in I/O-bound tasks, even without official Lambda support. While Bun has faster processing and potential cost benefits, it suffers from longer cold-start times. Though promising, Bun's newness means it has some kinks to iron out before it's ready for broad production use. The author believes that, with further development and optimization, Bun could replace Node as the go-to runtime for JavaScript server applications.
https://medium.com/@mitchellkossoris/serverless-bun-vs-node-benchmarking-on-aws-lambda-ecd4fe7c2fc2
Lambda layer: not a package manager, but a deployment optimization
https://theburningmonk.com/2021/05/lambda-layer-not-a-package-manager-but-a-deployment-optimization/
AWS shuts down its first-gen compute and network infrastructure
https://www.theregister.com/2023/09/05/aws_ec2_classic_deprecated/
Introducing Fermyon Serverless AI
Fermyon introduces its new Serverless AI service, offering developers the ability to integrate AI seamlessly into serverless applications using WebAssembly, achieving efficient GPU utilization without the need for dedicated setups, and is partnering with Civo for a sustainable, carbon-neutral GPU Compute Service.
https://www.fermyon.com/blog/introducing-fermyon-serverless-ai
Run any web app on Lambda | Serverless Office Hours
AWS Lambda web adapter can translate the JSON payload received by a Lambda function to a request processable by a web framework like Flask.
Automating cloud infrastructure: Do you want APIs with that?
Cloud automation often starts with scripts, but as companies scale, this method becomes inefficient, says Oren Teich, CPO of Upbound. Crossplane, an open-source project initiated in 2018, allows for the creation of control planes to manage cloud services such as Kubernetes. Upbound, built on Crossplane, recently introduced "Spaces", enabling customers to deploy managed control planes in their data centres. Teich highlights that the complexity of cloud computing necessitates an API-driven approach, as this helps manage various cloud resources and integrates them as API-based abstractions. Even as cloud computing dominates, many businesses prefer to maintain parts of their operations on-premises, hence the introduction of Spaces which offers on-premises control plane deployments via a command line interface.
https://www.theregister.com/2023/09/12/cloud_infrastructure_automation_interview
OpenTF forks Terraform insists HashiCorp is the splinter group
https://www.theregister.com/2023/08/28/opentf_forks_terraform_code/
Second Wave DevOps
An enthusiastic plea for the next generation of DevOps tools to truly realize the movement's potential. There are insightful remarks here regarding the developments and constants over the past decade.
https://www.systeminit.com/blog-second-wave-devops/
How Spotify Achieved a Voluntary 99% Internal Platform Adoption Rate
https://thenewstack.io/how-spotify-achieved-a-voluntary-99-internal-platform-adoption-rate/
OpenSSF Releases Source Code Management Best Practices Guide
https://openssf.org/blog/2023/09/14/openssf-releases-source-code-management-best-practices-guide/
Kubernetes vulnerability allows RCE on Windows endpoints (CVE-2023-3676)
https://www.helpnetsecurity.com/2023/09/18/cve-2023-3676/
Learning llms and genai for Dev,Sec,Ops
https://github.com/jedi4ever/learning-llms-and-genai-for-dev-sec-ops
kr8s
A Python client library can be really familiar if you are used to Kubectl.
https://github.com/kr8s-org/kr8s
Newsletter sponsor: Nexteam
Technology, Experience, Delivered.
Thanks for reading the Infra Weekly Newsletter! Subscribe for free to receive new posts and support my work.