This is Infra Weekly Newsletter, a newsletter about infrastructure, cloud, DevOps, automation, servers, Linux and related subjects.
Please subscribe now.
This is the fifth issue and I have reached 188 subscribers. Thank you for your interest.
A data engineer’s perspective on AWS Managed Airflow vs. AWS Step Function (State Machine)
An article about AWS-managed Airflow and AWS Step Function. He prefers AWS Managed Airflow, AWS State Machine Workflow Studio is a useful feature and when a pipeline needs direct intervention, AWS State Machine seems to be better at it.
Introducing PostgreSQL interface for Spanner: availability at scale with the interface you know
PostgreSQL is becoming like a lingua franca for DBMS systems, it is everywhere.
https://cloud.google.com/blog/products/databases/postgresql-interface-for-spanner-now-ga
Amazon Aurora now supports PostgreSQL 14
https://aws.amazon.com/about-aws/whats-new/2022/06/amazon-aurora-supports-postgresql-14/
PostgreSQL upgrades are hard!
A list of edge cases when upgrading PostgreSQL
https://andreas.scherbaum.la/blog/archives/1116-PostgreSQL-Upgrades-are-hard!.html
StopRansomware: MedusaLocker
A cybersecurity advisory to stop MedusaLocker
https://www.cisa.gov/uscert/ncas/current-activity/2022/06/30/stopransomware-medusalocker
Property-Based Testing In Python: Hypothesis is awesome
A 21-minute video on property testing. Property testing is coming from Quickcheck, a testing framework for Haskell. Property testing can generate tests and especially catch edge case bugs.
From zero to production in less than a day
Media Distillery explains how they create a Python service and how they deploy it.
https://mediadistillery.com/news/from-zero-to-production-in-less-than-a-day
Multiprocessing in Python: The Complete Guide
An extremely extensive tutorial on multi-processes with Python.
https://superfastpython.com/multiprocessing-in-python/
PyTorch 1.12: TorchArrow, Functional API for Modules and nvFuser, are now available
It has a beta version of AWS S3 Integration
https://pytorch.org/blog/pytorch-1.12-released/
Haskell in production: Channable
Another blog post from Serokell, this time how Channable is using Haskell in production, including NixOS, Nix, stack and more.
https://serokell.io/blog/haskell-in-production-channable
Things you should know about databases
An introduction to important concepts behind databases.
https://architecturenotes.co/things-you-should-know-about-databases/
Vim 9.0
Any certification that is worth it? Legitimately helped your career?
https://news.ycombinator.com/item?id=31874802
Don't use Kubernetes, yet
The author says: Early-stage startups shouldn't run on Kubernetes yet. Kubernetes is complex and ECS, Serverless, and Google Cloud Functions are more high level providing a faster development time.
https://matt-rickard.com/dont-use-kubernetes-yet/
PRQL
Pipelined Relational Query Language, pronounced "Prequel".
Introducing the new AWS Step Functions Workflows Collection
A fresh experience that makes it easier to discover, deploy, and share Step Functions workflows
https://aws.amazon.com/blogs/compute/introducing-the-new-aws-step-functions-workflows-collection/
Vercel Edge Functions are now in public beta
https://vercel.com/changelog/vercel-edge-functions-are-now-in-public-beta
The state of AWS serverless development
Daniele talks about the current state of AWS serverless offering
https://dev.to/aws-builders/the-state-of-aws-serverless-development-h5a
Chef Conf 2022
SEPTEMBER 11-14, 2022
Snowflake Terraform
If you are managing Snowflake I suggest you automate and document with the Terraform provider.
https://registry.terraform.io/providers/Snowflake-Labs/snowflake/latest
Built with BigQuery: how Exabeam delivers a petabyte-scale cybersecurity solution
Why containers and WebAssembly work well together
Docker talks about how Docker containers and Web Assembly can work together.
https://www.docker.com/blog/why-containers-and-webassembly-work-well-together/
Three trends with AWS IAM
There are some new useful features on AWS, like AWS:PrincipalOrgID conditional key and policy generation.
https://blog.symops.com/2022/06/24/aws-whats-new-iam/
https://aws.amazon.com/about-aws/whats-new/2022/03/aws-lambda-principalorgid-resource-policies/
AWS IAM now supports WebAuthn and Safari browser for multi-factor authentication with security keys
AWS: Disaster recovery considerations with Amazon EMR on Amazon EC2 for Spark workloads
Disaster recovery is a critical aspect of data reliability engineering
Mist Cloud Management Platform - Community Edition
Mist is an open-source platform for managing heterogeneous computing infrastructure, aka a Multicloud Management Platform.
https://github.com/mistio/mist-ce
The Open Cloud Vulnerability & Security Issue Database
An open project to list all known cloud vulnerabilities and Cloud Service Provider security issues
netboot.xyz
A PXE tool you should check out
Introducing Delta Sharing: an open protocol for secure data sharing
Zomato: powering Zomato’s data analytics using Trino
Zomato writes about its Trino infrastructure and how it enables data analytics across the organization
https://www.zomato.com/blog/powering-data-analytics-with-trino
Thank you for reading, please ask your friends and colleagues to subscribe.