Accessing Data at Scale with Justin Borgman

C++ is a powerful programming language that has been in use for several decades. Its importance lies in its versatility and efficiency, making it a popular choice for developing software and systems across different domains. The impact of C++ is significant, as it has been used to create numerous high-performance applications, including operating systems, browsers, The post Hardening C++ with Bjarne Stroustrup appeared first on Software Engineering Daily.

A SIEM platform provides organizations with a powerful tool for improving their security posture, by providing insights into potential security threats and enabling proactive security measures. Panther is a Cloud based security monitoring platform that helps teams detect and respond to security breaches quickly and intelligently. Jack Naglieri is the Founder and CEO of Panther The post Seamless SecOps with Jack Naglieri appeared first on Software Engineering Daily.

DataSet is a log analytics platform provided by Sentinel One that helps DevOps, IT engineering, and security teams get answers from their data across all time periods, both live streaming and historical. It’s powered by a unique architecture that uses a massively parallel query engine to provide actionable insights from the data available. John Hart The post Observability Trends with John Hart appeared first on Software Engineering Daily.

Vercel is the platform for frontend developers, providing the speed and reliability innovators need to create at the moment of inspiration. Vercel’s Edge Functions enable you to deliver dynamic, personalized content with the lightweight Edge Runtime. Guillermo Rauch is the CEO at Vercel and he joins us today. This episode is hosted by Mike Bifulco. To The post Building Delightful User Experiences with Guillermo Rauch appeared first on Software Engineering Daily.

What are the reasons why we need to improve performance? The JVM is a powerful piece of software – this is the reason why Java has maintained its popularity over the past 26+ years. But… there are some ways that the JVM works that can impact the performance of your applications. One of the biggest The post Improved Java Performance Sans Code Changes with Simon Ritter appeared first on Software Engineering Daily.

There are many types of early stage funding available from friends and family to seed to series A.  Some firms invest across a wide set of technologies and seek only to provide capital. Others are in it for the long haul – they focus on specific areas of technology and develop both long term relationships The post Data Investing and the MAD with Matt Turck appeared first on Software Engineering Daily.

eBPF stands for “extended Berkeley Packet Filter” and is a technology that allows developers to write and run highly efficient and secure programs that can analyze and modify data packets as they move through a system. eBPF programs can be used for a wide range of purposes, including network monitoring, security, and performance optimization. Thomas The post eBPF with Thomas Graf appeared first on Software Engineering Daily.

Netlify is a cloud-based platform that provides web developers with an all-in-one workflow to build, deploy, and manage modern web projects. Matt Biilmann is the CEO of Netlify and he joins us today. This episode is hosted by Mike Bifulco. To learn more about Mike visit mikebifulco.com Sponsorship inquiries: sponsor@softwareengineeringdaily.com     The post Netlify with Mathias Biilmann Christensen appeared first on Software Engineering Daily.

ChatGPT is an artificial intelligence language model developed by OpenAI. It is part of the GPT (Generative Pre-trained Transformer) family of models, which are designed to generate human-like text based on input prompts. ChatGPT is specifically trained to carry out conversational tasks, such as answering questions, completing sentences, and engaging in dialogue. It has been The post Surviving ChatGPT with Christian Hubicki appeared first on Software Engineering Daily.

Lee Edwards is a Partner at Root Ventures, a venture capital firm that invests in early-stage startups that are focused on solving hard engineering problems. Lee is an investor in Privacy Dynamics, a company that offers data anonymisation as a service. You can listen to our interview with the CTO of Privacy Dynamics, John Craft The post Seeding Bold Engineers with Lee Edwards appeared first on Software Engineering Daily.

API mocking is a technique used to simulate the behavior of an API without actually connecting to the real API. It is useful for various reasons, including testing, isolation, development, and cost reduction. By using API mocking, developers can test their code without relying on the availability of the real API, isolate the code being The post Creating Mock APIs with Tom Akehurst appeared first on Software Engineering Daily.

Keith Adams has worked previously at Facebook and has also been a Chief Architect at Slack. He joins us today to discuss technology, startups, investing, and like all conversations that exist today, ChatGPT. The post Pebblebed with Keith Adams appeared first on Software Engineering Daily.

As companies move more and more workloads to the cloud, cost management in the cloud is becoming critically important. Modern application development methodology increasingly involves moving to service and microservice architectures enabled by the cloud and kubernetes is the backbone of this modern infrastructure trend. Managing costs of kubernetes clusters is therefore becoming increasingly important. The post Kubernetes Cost Management with Matt Ray appeared first on Software Engineering Daily.

Jeli.io is an end to end incident management tool. Jeli helps you understand why an incident took place, how it could’ve been prevented, and allows you to dive deep into uncovered themes, patterns, or problem areas! Nora Jones is the Founder and CEO at Jeli.io and she joins us today. Full disclosure: Jeli.io is a The post Learning From Incidents with Nora Jones appeared first on Software Engineering Daily.

Data observability is the idea of creating a unified view of all the data so you can head off problems early, identify outages, and address any conflicts in real time. Today we’re interviewing Streamdal’s founders Ustin Zarubin and Dan Selans. They’re gonna share with us how they’re using an application monitoring approach to address the The post Streamdal: Streaming Data Performance Monitoring with Ustin Zarubin and Dan Selans appeared first on Software Engineering Daily.

Let’s say you have a set of microservices running on a Kubernetes cluster. In the past, developers used to program features like service discovery, observability, who’s allowed to talk to whom and other security related features directly into the application code. This slowed down the dev cycle and it made these microservices bigger and just The post Istio Ambient Mesh with Brian Gracely appeared first on Software Engineering Daily.

Kubernetes is an open-source platform for automating the deployment, scaling, and management of containerized applications. The company Komodor started as a Kubernetes diagnostics platform focusing on Kubernetes troubleshooting for the entire Kubernetes stack. More recently, Komodor is taking a step towards becoming a single-pane-of-glass to simplify Kubernetes for developers. In the past, they were more The post Dev-First Kubernetes Operations Platform with Itiel Shwartz appeared first on Software Engineering Daily.

Permissions are Hard! And they are becoming harder as we move more into the Cloud-native ecosystem. If we go back in time to the point where it was just a single monolith that you were building on your own. You’ll probably have a framework to manage the permissions for you. But when you are working The post Permit Elements and Fullstack Authorization with Or Weis appeared first on Software Engineering Daily.

Data catalogs are one way to address the tension between wanting to use all the data for business advantage and needing to govern all the data for compliance. Today, Zeashan Pappa, a Databricks Product Specialist for the Unity Catalog, joins us to discuss how catalogs can help companies capture the full value of their data. The post Databricks Unity Catalog with Zeashan Pappa appeared first on Software Engineering Daily.

Webhooks are used in connecting two different online applications. Webhooks allow one program to send data to another as soon as a certain event takes place.And because they are event-driven, webhooks are ideal for things like real-time notifications and data updates. The company Hookdeck helps build webhook integrations at scale. In this episode, we talk The post Webhooks at Scale with Alexandre Bouchard appeared first on Software Engineering Daily.

Twitter is a social media platform that does some incredibly complex stuff when it comes to distributed systems engineering to keep the website up and running. Twitter has open sourced a lot of projects for others to use. Twitter created a fork of Memcached called Twemcache and also a fork of Redis to handle the The post Caching at Twitter with Yao Yue appeared first on Software Engineering Daily.

Java is a write once run anywhere programming language. The way you do that is you use the javac compiler and compile the source files down to the class files. Those class files can run on any system in interpreted mode. But those class files that are run in interpreted mode, they are not machine The post Cloud Native Compiler with John Ceccarelli appeared first on Software Engineering Daily.

Although we like to think about ML workflows as straight-line narratives from experiment to training to production, and then finally monitoring; the reality for large companies is that all the steps are happening at one time in concert with other models, with shifting data, and, sometimes, misaligned key feature inputs. Moreover, regulated firms are required The post MLOps Systems at Scale with Krishna Gade appeared first on Software Engineering Daily.

Mingsheng Hong, is CEO and co-founder (along with Zheng Shao) of Bluesky. He is a thought leader for machine learning and has built data infrastructure to support some of the world’s most challenging workloads. Most recently, Mingsheng was at Google, where he led teams to build storage and querying stacks that power Google’s $100 billion The post Optimizing Cloud Data Platforms with Mingsheng Hong appeared first on Software Engineering Daily.

Show host: Jordi Mon Companys Guest: Dan Lorenc The post Software Supply Chain with Dan Lorenc appeared first on Software Engineering Daily.

In this episode we talk with Varun Badhwar, Founder and CEO of Endor Labs. Show host: Sean Falconer Transcript The post Open Source Software Lifecycle Management and Security with Varun Badhwar appeared first on Software Engineering Daily.

Show Host: Jordi Mon Companys Guest: Sam Alba Transcript The post Pipelines as Code with Sam Alba appeared first on Software Engineering Daily.

As applications grow in size and complexity, and as they increasingly move to microservice architectures, it becomes harder for individual developers to perform end-to-end tests of an entire application stack. Connecting development services to production services is off limits. Test environments are limited to automated tests. Staging environments are woefully inadequate with the amount of The post API Testing in Kubernetes with Matthew LeRay appeared first on Software Engineering Daily.

Show Host: Jordi Mon Companys Heather Meeker Scott Jenson Pablo Ruiz-Múzquiz Transcript The post Open Source Design Collaboration appeared first on Software Engineering Daily.

Transcript The post API Observability with Jean Yang appeared first on Software Engineering Daily.

Silicon Valley has many investors and Venture Capital firms, but most are not trying to solve hard technical problems. Engineering Capital partners with companies that are taking a technical risk. These are the companies who have some innovation where there is a doubt on whether it can even be built. Ideally, the market for this The post Startup Investing with Ashmeet Sidana appeared first on Software Engineering Daily.

We do it every day. We search on the internet for some information. Many ask, why is that easy? And yet doing the same thing at my company is hard sometimes, not even possible. And when you do get the data, it’s unclear where it’s from or the degree you can trust it or use The post The Enterprise Data Catalog with Ole Olesen-Bagneux appeared first on Software Engineering Daily.

Data anonymisation is an ever more important problem with many pitfalls, and the legal context requires more and more companies to find a solution to it. In this episode, we talk to John Craft from Privacy Dynamics, who offer data anonymisation as a service. Privacy Dynamics is powering a world where ethics, data insights and The post Minimizing PII in Dev Environments with John Craft appeared first on Software Engineering Daily.

Fintechs and traditional finance firms want to help their small business customers replace disorganized competing manual processes and multiple data sources with a single unified set of services and data. They could do that. They could more easily offer quicker decisions, better customer experience, and even get more first time customers founded in 2017. Codat The post Financial Data Aggregation for SMB with Jason Dryhurst-Smith appeared first on Software Engineering Daily.

OpenSSL is a free, open-source cryptographic library that provides secure communications over computer networks. It’s widely used to implement the secure socket layer (SSL) and transport layer security (TLS) protocols, which are the basis for secure, encrypted connections on the internet. On Oct 25th, the OpenSSL project informed its users of a critical vulnerability that The post OpenSSL Vulnerability with Ilkka Turunen appeared first on Software Engineering Daily.

Comma is a startup aimed at solving self-driving cars. A lot of the new cars in the market have built-in stock Advanced driver assistance systems. Comma takes this system to the next level with Openpilot. Openpilot is an open-source driver assistance system. Currently, with features like Adaptive Cruise Control (ACC), Automated Lane Centering (ALC), Forward The post Special Episode with George Hotz appeared first on Software Engineering Daily.

Monolithic relational databases are the traditional foundation of financial core ledger systems. Nevertheless, the process of building and operating mission critical financial ledgers on these databases, and implementing homegrown accounting models, is a journey fraught with engineering challenges. Twisp has set out to rethink the underlying technology for financial ledger systems by combining the operational The post Twisp: Reinventing Accounting Systems with Michael Parsons appeared first on Software Engineering Daily.

Java Applications became the go-to preference of most developers because of the write-once-run-anywhere advantage it gave over other languages. And it didn’t take much time for Java to become the language for the enterprise. Consequently, most enterprises are still running legacy Java Monoliths on their infrastructure. Breaking up a monolith is not an easy process–nor The post Modernizing the Monolith with Moti Rafalin and Amir Rapson appeared first on Software Engineering Daily.

When Web Assembly was created it was supposed to be a compile target, where you could compile your favorite programming language and then execute it inside of a web browser. This made it possible for developers to choose a programming language like C++ for compute intensive applications. Fermyon is taking Web Assembly to the cloud. The post Cloud-native WebAssembly with Matt Butcher appeared first on Software Engineering Daily.

If you are a company with a large pool of physical servers, and compute resources sitting in the data center, and you want to use them efficiently, one way to do that would be to virtualize them. Then you can use those smaller virtual compute resources to run whatever workloads you need. VMware is a The post VMware Tanzu with Betty Junod appeared first on Software Engineering Daily.

With an increasing number of data breaches impacting customer trust, prioritizing data privacy and security is more important than ever. However, as you layer on security and privacy, the overall complexity of a system grows and the data gets harder to use. There’s a constant push and pull between securing and locking down the data The post Secure Workflows on Sensitive Data with Amruta Moktali appeared first on Software Engineering Daily.

The complexity of the software infrastructure has been increasing as companies have migrated towards kubernetes, containers, microservices and other distributed systems. However the tools around observability and monitoring have not seen much improvement. These tools are usually managed by teams distributed across different locations and time zones, which results in siloing of knowledge of your The post Collaborative Notebooks for DevOps and SRE with Micha Hernandez appeared first on Software Engineering Daily.

Building and managing data-intensive applications has traditionally been costly and complex, and has placed an operational burden on developers to maintain as their organization scales. Todays’ developers, data scientists, and data engineers need a streamlined, single cloud data platform for building applications, pipelines, and machine learning models — without having to move or copy their The post Building on the Data Cloud with Torsten Grabs appeared first on Software Engineering Daily.

Companies are rapidly moving to the cloud, and modern businesses are operating faster with a myriad of SaaS tools in their day-to-day operations. Provisioning resources has been easier than ever. With a few clicks you can spin up resources in any part of the world. While we all love the cloud because of the scalability The post Cloud Asset Management with Serhat Can appeared first on Software Engineering Daily.

Mikko Hypponen is the CRO of WithSecure and a principal research Officer at F-Secure. In this interview with our host, Jordi Mon, he discusses the eventful and rocky early start of his software engineering career, hybrid warfare, reverse engineering, recent exploits like Log for Shell and heart bleed, and more. This episode is packed with The post The Cyber Frontier with Mikko Hypponen appeared first on Software Engineering Daily.

React is the most widely used front-end framework. It pioneered the component model and influenced the software design of all modern web applications. React is not an opinionated tool, allowing engineers to shape their applications in a way that fits the problems at hand. However, this freedom of expression can be very confusing to newcomers. The post Tao of React with Alex Kondov appeared first on Software Engineering Daily.

Observability is a critical aspect of modern digital applications. You can’t operate an application at scale that satisfies your customer needs without understanding how the application is currently performing, whether it’s understanding the current operating needs of the application, adjusting resource usage, detecting issues before they become serious or solving an ongoing technical issue as The post Modern Application Observability with Berkay Mollamustafaoglu appeared first on Software Engineering Daily.

The classical computing power has doubled every two years – a pattern known as Moore’s law. However, the ability to fabricate more and more transistors in a computer chip is approaching saturation as we are approaching atomic dimensions. Quantum Computing is a promising technology to take us beyond this. A quantum Computer uses qubits to The post The Quantum Leap with Dmitri Maslov appeared first on Software Engineering Daily.

The Java Virtual Machine is an abstract machine that makes it possible for you to write Java code once and run it across multiple devices and operating system types. While you can use the OpenJDK it comes with various issues like Security Vulnerabilities and compliance. Azul is a company that specializes in Java for the The post Azul with John Ceccarelli appeared first on Software Engineering Daily.

Passwordless Authentication is a technique in which users are given access to an environment without entering a password or answering a security question. This allows users to access an environment securely and protects organizations against attack vectors like Keylogging, Brute force methods, and phishing. The company SuperTokens provides secure login and session management for your The post Open Source Authentication with Advait Ruia and Rishabh Poddar appeared first on Software Engineering Daily.

Monolithic relational databases are the traditional foundation of financial core ledger systems. Nevertheless, the process of building and operating  mission-critical ledgers to track and reconcile payments and money movement is complex.  Twisp is rethinking core accounting and financial orchestration on a cloud-native ledger system, so developers can stop re-inventing the ledger and focus on building The post Twisp: Reinventing the Ledger with Jarred Ward appeared first on Software Engineering Daily.

PostgreSQL is a free and open-source relational database management system. Postgres-based databases are widespread and are used by a variety of organizations, from Reddit to the International Space Station, and Postgres databases are a common offering from cloud providers such as AWS, Alibaba Cloud, and Heroku. Neon is a serverless open-source alternative to AWS Aurora The post Open-source Serverless Postgres with Nikita Shamgunov appeared first on Software Engineering Daily.

Today, we spoke with Daniel Situnayake of Edge Impulse. We discussed AI, machine learning, edge devices, TinyML and AI tool chain.             Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Edge Impulse with Daniel Situnayake appeared first on Software Engineering Daily.

Today, we spoke with Toma Puljak and Vedran Jukic of Codeanywhere. We discussed Cloud-based dev environments, Cloud-based IDEs, Infrastructure as code, Dev containers and Live collaboration.                Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Codeanywhere with Toma Puljak and Vedran Jukic appeared first on Software Engineering Daily.

The default configuration in most databases is meant for broad compatibility rather than performance. Database tuning is a process in which the configurations of a database are modified to achieve optimal performance. Databases have hundreds of configuration knobs that control various factors, such as the amount of memory to use for caches or how often The post Automatic Database Tuning with Andy Pavlo appeared first on Software Engineering Daily.

Cloud computing provides tools, storage, servers, and software products through the internet. Securing these resources is a constant process for companies deploying new code to their cloud environments. It’s easy to overlook security flaws because company applications are very complex and many people work together to develop them. Wyze Labs, for example, had millions of The post Bridgecrew: Cloud Security with Guy Eisenkot appeared first on Software Engineering Daily.

Originally published on January 1, 2022. Charlie Gerard is an incredibly productive developer.  In addition to being the author of Practical Machine Learning in JavaScript, her website charliegerard.dev has a long list of really interesting side projects exploring the intersection of human computer interaction, computer vision, interactivity, and art.  In this episode we touch on The post Practical Machine Learning in JavaScript with Charlie Gerard appeared first on Software Engineering Daily.

Software engineering can be a surprisingly grueling career. It is both physically and mentally demanding to sit in front of a screen for hours on end producing code. Andy Johns is our guest in this episode. Andy previously worked on growth at Facebook, Twitter, and Quora as an early employee. He’s also an investor in The post Mental Health in Tech with Andy Johns appeared first on Software Engineering Daily.

Data analytics technology and tools have seen significant improvements in the past decade. But, it can still take weeks to prototype, build and deploy new transformations and deployments, usually requiring considerable engineering resources. Plus, most data isn’t real-time. Instead, most of it is still batch-processed. Tinybird Analytics provides an easy way to ingest and query The post Serverless Clickhouse for Developers with Jorge Sancha appeared first on Software Engineering Daily.

Originally published on August 23, 2021. Application security is usually done with a set of tools and services known as SIEM – Security Information and Event Management. SIEM tools usually try to provide visibility into an organization’s security systems, as well as event log management and security event notifications.  The company Panther takes traditional SIEM The post Panther: Security as Code with Jack Naglieri appeared first on Software Engineering Daily.

Maintaining availability in a modern digital application is critical to keeping your application operating and available and to keep meeting your customers growing demands. There are many observability platforms out there and certainly Prometheus is a popular open source solution for cloud native companies yet operating an observability platform, costs money, and all of the The post Cloud Native Observability with Martin Mao appeared first on Software Engineering Daily.

As software engineering teams start to build products that become more and more mature, it becomes necessary to be able to debug complex issues with tooling that enables understanding of the full scenario. This can come from application scenarios where APIs are running multiple versions, where users are using your app from multiple devices, device The post Developer-first Observability with Liran Haimovitch appeared first on Software Engineering Daily.

Web infrastructure has evolved from individual servers to shared hosting services to virtual machines and virtual functions. The future of the internet however is looking toward a much more distributed computation model . Blockchain technology is central to the future of this modern internet . Blockchains are still in their infancy.  And the most people The post Modular Blockchain Architecture with Nader Dabit appeared first on Software Engineering Daily.

Originally published on February 12, 2022. Lee Atchison spent seven years at Amazon working in retail, software distribution, and Amazon Web Services. He then moved to New Relic, where he has spent four years scaling the company’s internal architecture. From his decade of experience at fast-growing web technology companies, Lee has written the book Architecting The post Architecting for Scale with Lee Atchison appeared first on Software Engineering Daily.

Data is becoming a bank’s biggest asset. These complex enterprises have a huge opportunity ahead – to transform themselves to become a trusted hub of a much broader data ecosystem that goes beyond the financial industry and helps to form a new class of cross-industry experience architectures that are scalable and transparent. The data physics The post Data Infrastructure for Finance appeared first on Software Engineering Daily.

Cloud native applications utilizing microservice architectures has grown into one of the most popular application architectural patterns in recent years. The value of leveraging dynamic cloud resources, along with the flexibility and scalability of microservice architectures, creates a strong paradigm that’s hard to miss. The strong adoption of Kubernetes has strengthened the pattern enormously. The The post K8s Troubleshooting with Itiel Shwartz appeared first on Software Engineering Daily.

Permissions are Hard! And they are becoming harder as we move more into the Cloud-native ecosystem. If we go back in time to the point where it was just a single monolith that you were building on your own. You’ll probably have a framework to manage the permissions for you. But when you are working The post Permissions and Access-control with Or Weis appeared first on Software Engineering Daily.

Enabling authorization policies across disparate cloud-native environments such as containers, microservices and modern application delivery infrastructure is complex and can be a roadblock for software engineering teams. Open Policy Agent, or OPA, is an open, declarative, policy-as-code approach to authorization that reduces security and compliance burden for engineering teams.  Business context is translated into declarative The post Cloud-native Authorization with Tim Hinrichs appeared first on Software Engineering Daily.

Ian Coe CEO Adam Kamor Head of Engineering Companies that gather data about their users have an ethical obligation and legal responsibility to protect the personally identifiable information in their dataset.  Ideally, developers working on a software application wouldn’t need access to production data. Yet without high-quality example data, many technology groups stumble on avoidable The post Faking Data Using Tonic.ai with Ian Coe and Adam Kamor appeared first on Software Engineering Daily.

Couchbase is a distributed NoSQL cloud database. Since its creation, Couchbase has expanded into edge computing, application services, and most recently, a database-as-a-service called Capella.  Couchbase started as an in-memory cache and needed to be rearchitected to be a persistent storage system. In this episode, We interviewed Ravi Mayuram, SVP Products, and Engineering at Couchbase. The post Couchbase with Ravi Mayuram appeared first on Software Engineering Daily.

Originally published on April 12, 2016. Negotiation is an important skill for software engineers. The salary you negotiate at the beginning of your job could be a difference of tens of thousands of dollars over the course of an engineer’s career, but intimidating recruiters and exploding offers scare many engineers from negotiating at all. Today, The post Salary Negotiation with Haseeb Qureshi appeared first on Software Engineering Daily.

Remix is a full stack web framework that lets you focus on the user interface and work back through web fundamentals to deliver a fast, slick, and resilient user experience that deploys to any Node.js server and even non-Node.js environments at the edge like Cloudflare Workers. In this episode, we interviewed Ryan Florence, co-founder at The post Remix with Ryan Florence appeared first on Software Engineering Daily.

Profiling has been a part of the software engineering toolbox since the 1970s, but it was long regarded to be too high in overhead, so it was only done ad hoc. The problem with profiling that way is that you never catch the moment in time where for example an incident happened. Continuous profiling is The post Continuous Profiling using eBPF with Frederic Branczyk appeared first on Software Engineering Daily.

Enterprise-grade authentication is often an essential ingredient to virtually all applications in today’s world. However, companies often have a hard time understanding the value of that authentication especially during the early stages of product development. And hardening of an application is often left as an afterthought. Add enterprise-level requirements such as single sign-on and two-factor The post WorkOS with Michael Grinich appeared first on Software Engineering Daily.

Build automation tools automate the process of building code, including steps such as compiling, packaging binary code, and running automated tests. Because of this, build automation tools are considered a key part of a continuous delivery pipeline. Build automation tools read build scripts to define how they should perform a build. Common build scripts include The post Earthly Builds with Adam Gordon Bell appeared first on Software Engineering Daily.

Creating great creative tools is extremely difficult. There are thousands of paths a user could take, and every aspect of the user experience has to be carefully considered and optimized for performance. And when you try to add real-time collaboration on top of that, you can be sure that you’re left with almost no time The post LiveBlocks with Guillaume Salles appeared first on Software Engineering Daily.

Most technology companies rely on open source software projects. But open source software projects are often maintained by a group of people that is not affiliated with any particular company. When an open source project develops too much technical debt, it can become a tragedy of the commons. Who is responsible for maintaining these open The post Gitcoin Ecosystem with Gloria Kimbwala appeared first on Software Engineering Daily.

Mailchimp is an all-in-one marketing platform for growing businesses, empowering millions of customers around the world to launch, build, and grow their businesses with world-class marketing technology, award-winning customer support, and inspiring content. Eric Muntz is Mailchimp’s CTO, responsible for the engineering teams that design, implement, and maintain Mailchimp’s products and infrastructure. He joins the The post Mailchimp Engineering with Eric Muntz appeared first on Software Engineering Daily.

Venture capital investment has continued to flow into technology startups.  No one builds technology from scratch.  There are cloud services, software libraries, 3rd party services, and software platforms that modern entrepreneurs must adopt to build their products efficiently and quickly.  These layers of infrastructure are a key area for many investors. Tim is a partner The post Technical Venture Capital with Tim Tully appeared first on Software Engineering Daily.

Between hyper financialisation and the growth of automation in the world, trade and investments have become an ever more prevalent and important tool for the mass market. But the relative knowledge of professional and hobbyist investors is different, and so is the access to opportunities. Coinrule empowers regular people to compete with professional traders by The post Coinrule Automated Crypto Trading with Zdenek Hofler appeared first on Software Engineering Daily.

Breakthroughs from labs that are exclusively or mostly focused on research tend to stay buried as papers. Sometimes the lag is natural, the research is far ahead of its broad applicability. But we find that there are hundreds of breakthroughs useful long before they reach users. It can take many years, even decades, before breakthroughs The post Protocol Labs Research with Jeromy Johnson appeared first on Software Engineering Daily.

As crypto gains worldwide attention, the most scalable, resilient and performant systems are required for the industry to thrive. Products must be designed for a mix of technical and non-technical users. Blockchain.com’s VP of Engineering Lewis Tuff takes us behind the scenes for a look at the architecture, programming languages and database choices required to The post Building for Crypto with Lewis Tuff appeared first on Software Engineering Daily.

This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments. Lee is the host The post Kubernetes Spend with Webb Brown appeared first on Software Engineering Daily.

Web3 promises to change the way we interact and transact online, but today’s dapps and wallets are hard to use. They are typically optimized for desktop machines and domain experts. In particular, it can be hard to bring value on-chain, and hard to know what to do once you’ve onboarded. Charlie Andrews-Jubelt is a software The post Valora Decentralized Venmo with Charlie Andrews-Jubelt appeared first on Software Engineering Daily.

While Kubernetes has many benefits, there is often a need for teams to deploy a monitoring and observability stack to troubleshoot issues that happen within the cluster and the applications themselves. ContainIQ, an out-of-the-box solution, allows engineers to monitor the health of their cluster and troubleshoot issues faster.  ContainIQ is unique in its approach in The post ContainIQ with Matthew Lenhard appeared first on Software Engineering Daily.

This episode is hosted by Alex DeBrie. Alex is the author of The DynamoDB Book, the comprehensive guide to data modeling with DynamoDB, as well as The DynamoDB Guide, a free guided introduction to DynamoDB. He runs a consulting company where he assists clients with DynamoDB data modeling, serverless architectures, and general AWS usage. You can find The post Open-Source Cloud Asset Management with Yevgeny Pats appeared first on Software Engineering Daily.

How to build a rocket ship while flying it? In this episode, Cos returns to the show to discuss the technologies and approach Brex chose to create an engineering organization and innovation engine for the long term, while navigating shifts as the company continued to scale at a rapid pace. Cos and Jeff also cover The post CTO Decisions with Cos Nicolaescu appeared first on Software Engineering Daily.

Convex makes storing your application’s data as easy as using React state management. If you can use React hooks, you can also manage your backend data using Convex. James Cowling is a former Dropbox infrastructure engineer turned startup founder. James joins the show to discuss how Convex offers a simpler full-stack developer experience than the The post Global State Management with James Cowling appeared first on Software Engineering Daily.

Developers looking for read or write access to Ethereum, Polygon, IPFS or other Web3 networks in order to get their idea in the hands of users need reliable RPC endpoints they can count on, whether they are working on a hackathon project or running hybrid architecture for a production application. Infura provides a platform for The post Infura Ethereum Infrastructure with E.G. Galano appeared first on Software Engineering Daily.

Streaming data platforms like Kafka, Pulsar, and Kinesis are now common in mainstream enterprise architectures, providing low-latency real-time messaging for analytics and applications. However, stream processing – the act of filtering, transforming, or analyzing the data inside the messages – is still an exercise left to the receiving microservice or datastore, a custom programming exercise The post Decodable Streaming with Eric Sammer appeared first on Software Engineering Daily.

The Kubernetes ecosystem has drastically changed how development teams ship software. While Kubernetes has provided many advancements in cloud infrastructure, it has also left organizations with massive security blindspots. KSOC was created to give developers and security teams a single control plane to harden multi-cluster Kubernetes environments through event-driven analysis, least privilege enforcement, and remediation-as-code. The post Kubernetes Security Compliance with Jimmy Mesta appeared first on Software Engineering Daily.

In software engineering, telemetry is the data that is collected about your applications. Unlike logging, which is used in the development of apps to pinpoint errors and code flows, telemetry data includes all operational data including logs, metrics, events, traces, usage, and other analytical data. Companies usually visualize this information to troubleshoot problems and understand The post New Relic Architecture with Nic Benders appeared first on Software Engineering Daily.

One of the challenges with Microservices architecture is how you manage dependencies between your services when implementing workflows. Conductor is an open-source microservices and workflow orchestration platform. Boney Sekh co-founded Orkes Inc – a company focused on offering Conductor as a service. Boney joins the show to discuss how engineers leverage Conductor to build highly The post Conductor Orchestration with Boney Sekh appeared first on Software Engineering Daily.

Notifications have typically been an area of a product where building in-house has been the only option. However, building a best-in-class notifications system that delivers a great customer experience requires a significant investment when you start to layer in complexities like batching, cross channel orchestration, and user preferences. Chris Bell of Knock joins the show The post Notifications Infrastructure with Chris Bell appeared first on Software Engineering Daily.

The advent of the cloud introduced a new form of technical debt in which organizations can lose track of what infrastructure they have and how it relates to the business.  While the cloud’s native APIs offer some transparency into your infrastructure, these offerings are often described as necessary but not sufficient.  When companies have a The post CloudGraph with Tyson Kunovsky appeared first on Software Engineering Daily.

Highlight is a tool that helps teams reproduce end-to-end user sessions to troubleshoot their applications faster, more efficiently, and with all the context they need. With Highlight, engineering teams can replay errors with high precision, which includes complete session replay, outgoing network requests, dense stack traces and insight into the app’s state management system. Jay The post Browser Observability With Jay Khatri appeared first on Software Engineering Daily.

Lee Atchison spent seven years at Amazon working in retail, software distribution and Amazon Web Services. He then moved to New Relic, where he spent eight years scaling the company’s internal architecture. Lee has deep expertise in building and managing fast growing web applications, and he used this knowledge to write architecting for scale from The post Technical Debt With Lee Atchison appeared first on Software Engineering Daily.

There’s an increasing regulatory and consumer pressure on companies to do a better job protecting sensitive customer data. Yet, despite this pressure, data breaches and compliance issues continue to plague the tech industry. Companies like Apple, Netflix, and Google have solved these challenges by pioneering a new type of technology, the data privacy vault. Skyflow The post Skyflow Privacy and Compliance with Sean Falconer appeared first on Software Engineering Daily.

Data-as-a-service is a company category type that is not as common as API-as-a-service, software-as-a-service, or platform-as-a-service. In order to vend data, a data-as-a-service provider needs to define how that data will be priced, stored, and delivered to users: streaming over an API or served via static files. Naqeeb Memon of Safegraph joins the show The post Data Delivery with Naqeeb Memon appeared first on Software Engineering Daily.