Software Engineering Daily

Software Engineering Daily Podcast

Technical interviews about software topics.

Dagster with Nick Schrock
Data engineering is difficult.  Companies want to be able to maximize the value they get from their large data sets, but there are so many steps required for deriving that value that most companies feel like they are always far behind the ideal state of where they could be.  The cloud makes it cheap to The post Dagster with Nick Schrock appeared first on Software Engineering Daily....

GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard
Java programs run in a different environment than they did ten years ago. Modern infrastructure runs on containers sitting in a Kubernetes cluster. The optimal configuration for a Java program in that context is different than it was for an environment dominated by virtual machines and bare metal. When you are co-scheduling your services with The post GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard appeared first on Software Engineering Daily....

GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard
Java programs run in a different environment than they did ten years ago. Modern infrastructure runs on containers sitting in a Kubernetes cluster. The optimal configuration for a Java program in that context is different than it was for an environment dominated by virtual machines and bare metal. When you are co-scheduling your services with The post GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard appeared first on Software Engineering Daily....


Bugsnag Business with James Smith
Crash monitoring emerged as a software category over the last decade. Crash monitoring software allows developers to understand when their applications are crashing on client devices. For example, we have an app for Software Engineering Daily that people download on Android or iOS. Users download the app to their smartphone. When the user is playing The post Bugsnag Business with James Smith appeared first on Software Engineering Daily....

Incident Response Machine Learning with Chris Riley
Software bugs cause unexpected problems at every company.  Some problems are small. A website goes down in the middle of the night, and the outage triggers a phone call to an engineer who has to wake up and fix the problem. Other problems can be significantly larger. When a major problem occurs, it can cause The post Incident Response Machine Learning with Chris Riley appeared first on Software Engineering Daily....

Incident Response Machine Learning with Chris Riley
Software bugs cause unexpected problems at every company.  Some problems are small. A website goes down in the middle of the night, and the outage triggers a phone call to an engineer who has to wake up and fix the problem. Other problems can be significantly larger. When a major problem occurs, it can cause The post Incident Response Machine Learning with Chris Riley appeared first on Software Engineering Daily....


Gatsby with Kyle Mathews and Sam Bhagwat
Frontend software development has become as complex as backend development. There was a time when frontend web development was simple. There was a small number of JavaScript frameworks and templating systems. Your CSS was simple configuration for the colors on your webpage. Today, there is a giant ecosystem of frontend tools, APIs, and middleware delivering The post Gatsby with Kyle Mathews and Sam Bhagwat appeared first on Software Engineering Daily....

Gatsby with Kyle Mathews and Sam Bhagwat
Frontend software development has become as complex as backend development. There was a time when frontend web development was simple. There was a small number of JavaScript frameworks and templating systems. Your CSS was simple configuration for the colors on your webpage. Today, there is a giant ecosystem of frontend tools, APIs, and middleware delivering The post Gatsby with Kyle Mathews and Sam Bhagwat appeared first on Software Engineering Daily....

Drones with Chris Anderson
Drones will deliver food to us. Drones will be able to extinguish fires. Drones will be used to relay Internet signals and make the world more connected.  These all sound like great ideas, so why aren’t there more drones in the sky today? There are many answers to that question, some of which relate to The post Drones with Chris Anderson appeared first on Software Engineering Daily....


LinkedIn Data Engineering with Kapil Surlaker
A large social network needs to develop systems for ingesting, storing, and processing large volumes of data. Data engineering at scale requires multiple engineering teams that are responsible for different areas of the infrastructure. Data needs to be structured coherently in order to minimize the data cleaning process. Machine learning models need to be developed, The post LinkedIn Data Engineering with Kapil Surlaker appeared first on Software Engineering Daily....

FOSSA: Open Source Management with Kevin Wang
Every company has a software supply chain. A company builds its products from custom code, paid APIs, paid proprietary binaries, and open source software libraries. As the types of software available have increased, the management of the software supply chain has become complex.  Large software companies have always needed to ensure the security of their The post FOSSA: Open Source Management with Kevin Wang appeared first on Software Engineering Daily....

Scale with Alexandr Wang
Machine learning is widely understood by the software community. But it is still hard to build a company around machine learning, because there is not easy access to large, unique data sets. Scale is a platform for training and validating data that is used for machine learning. Most machine learning models are built with supervised The post Scale with Alexandr Wang appeared first on Software Engineering Daily....


Leadership with Ben Horowitz
Photo credit: Elisabeth Fall Ben Horowitz started Loudcloud with Marc Andreessen in 1999. He ran the company for eight years and chronicled his experience in his first book The Hard Thing About Hard Things. In his time running Loudcloud, the dotcom bubble burst, but Loudcloud needed cash so badly that he took the company public The post Leadership with Ben Horowitz appeared first on Software Engineering Daily....

Facebook Leadership with Arturo Bejar
Facebook leadership has a significant amount of engineers in its ranks, and engineers understand how to create an environment that appeals to other engineers.  Engineers do not like working on projects that they are not interested in, so Facebook optimizes for matching engineers to enjoyable work. Engineers do not like taking orders from managers, so The post Facebook Leadership with Arturo Bejar appeared first on Software Engineering Daily....

Facebook Leadership with Arturo Bejar
Facebook leadership has a significant amount of engineers in its ranks, and engineers understand how to create an environment that appeals to other engineers.  Engineers do not like working on projects that they are not interested in, so Facebook optimizes for matching engineers to enjoyable work. Engineers do not like taking orders from managers, so The post Facebook Leadership with Arturo Bejar appeared first on Software Engineering Daily....


Facebook Fallout with Antonio Garcia Martinez
Chaos Monkeys is a book about Silicon Valley startups and Facebook. It is one of the most accurate books written about the modern technology industry, and captures both the negatives and the positives of software companies. Antonio Garcia Martinez is the author of Chaos Monkeys. He wrote the book after going through a gauntlet of The post Facebook Fallout with Antonio Garcia Martinez appeared first on Software Engineering Daily....

Facebook Fallout with Antonio Garcia Martinez
Chaos Monkeys is a book about Silicon Valley startups and Facebook. It is one of the most accurate books written about the modern technology industry, and captures both the negatives and the positives of software companies. Antonio Garcia Martinez is the author of Chaos Monkeys. He wrote the book after going through a gauntlet of The post Facebook Fallout with Antonio Garcia Martinez appeared first on Software Engineering Daily....

Facebook Reflections with Pete Hunt and Nick Schrock
Facebook engineering is unique. Software is built at Facebook in a way that is distinctly different than any other company. In our series of shows about Facebook engineering, we have mostly covered the positive side of Facebook’s practices. In today’s show, we explore the downsides.  Facebook moves fast. Engineers within the company must move fast, The post Facebook Reflections with Pete Hunt and Nick Schrock appeared first on Software Engineering Daily....


Facebook Reflections with Pete Hunt and Nick Schrock
Facebook engineering is unique. Software is built at Facebook in a way that is distinctly different than any other company. In our series of shows about Facebook engineering, we have mostly covered the positive side of Facebook’s practices. In today’s show, we explore the downsides.  Facebook moves fast. Engineers within the company must move fast, The post Facebook Reflections with Pete Hunt and Nick Schrock appeared first on Software Engineering Daily....

Facebook Products with Peter Deng
Peter Deng has worked on most of Facebook’s major products: Newsfeed, Instagram, Oculus, and Messenger. These different products have different requirements, but are all part of the same ethos of connecting people through social networks.  Facebook is a consumer product company that is powered by a strong engineering workforce. The relationship between product managers and The post Facebook Products with Peter Deng appeared first on Software Engineering Daily....

Facebook Products with Peter Deng
Peter Deng has worked on most of Facebook’s major products: Newsfeed, Instagram, Oculus, and Messenger. These different products have different requirements, but are all part of the same ethos of connecting people through social networks.  Facebook is a consumer product company that is powered by a strong engineering workforce. The relationship between product managers and The post Facebook Products with Peter Deng appeared first on Software Engineering Daily....


Facebook Entrepreneurship with Jeff Rothschild
Jeff Rothschild was one of the earliest engineers to join Facebook. In the 1990s, Jeff had co-founded Veritas Software and helped it to its IPO in 2004. After Veritas, Jeff worked on several other of his own companies. He was working with Accel Partners on investments when he started to learn about Facebook. Accel was The post Facebook Entrepreneurship with Jeff Rothschild appeared first on Software Engineering Daily....

Alluxio: Data Orchestration with Haoyuan Li
In 2013, the Berkeley AMPLab was a center of innovation.  Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has The post Alluxio: Data Orchestration with Haoyuan Li appeared first on Software Engineering Daily....

Alluxio: Data Orchestration with Haoyuan Li
In 2009, the Berkeley AMPLab was a center of innovation.  Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has The post Alluxio: Data Orchestration with Haoyuan Li appeared first on Software Engineering Daily....


Redis with Alvin Richards
Redis is an in-memory database that persists to disk. Redis is commonly used as an object cache for web applications. Applications are composed of caches and databases. A cache typically stores the data in memory, and a database typically stores the data on disk. Memory has significantly faster access times, but is more expensive and The post Redis with Alvin Richards appeared first on Software Engineering Daily....

LinkedIn Data Platform with Carl Steinbach
LinkedIn is a social network with petabytes of data.  In order to store that data, LinkedIn distributes and replicates that data across a large cluster of machines running the Hadoop Distributed File System. In order to run calculations across its large data set, LinkedIn needs to split the computation up using MapReduce-style jobs. LinkedIn has The post LinkedIn Data Platform with Carl Steinbach appeared first on Software Engineering Daily....

LinkedIn Data Platform with Carl Steinbach
LinkedIn is a social network with petabytes of data.  In order to store that data, LinkedIn distributes and replicates that data across a large cluster of machines running the Hadoop Distributed File System. In order to run calculations across its large data set, LinkedIn needs to split the computation up using MapReduce-style jobs. LinkedIn has The post LinkedIn Data Platform with Carl Steinbach appeared first on Software Engineering Daily....


Crypto Businesses with Haseeb Qureshi
Cryptocurrencies are a fundamental computer science invention.  Cryptocurrencies crashed in 2018 but the technology remains as promising as ever. Bitcoin is a decentralized currency, and a plausible end state that is implied by Bitcoin’s current trajectory is a permissionless, decentralized financial system. This idea of decentralized finance or “DeFi” begs numerous questions: who will build The post Crypto Businesses with Haseeb Qureshi appeared first on Software Engineering Daily....

Crypto Businesses with Haseeb Qureshi
Cryptocurrencies are a fundamental computer science invention.  Cryptocurrencies crashed in 2018 but the technology remains as promising as ever. Bitcoin is a decentralized currency, and a plausible end state that is implied by Bitcoin’s current trajectory is a permissionless, decentralized financial system. This idea of decentralized finance or “DeFi” begs numerous questions: who will build The post Crypto Businesses with Haseeb Qureshi appeared first on Software Engineering Daily....

Dark Lang with Ellen Chisa and Paul Biggar
Dark Lang is a programming language that is tightly integrated with the cloud.  Dark takes an opinionated approach that most developers are going to want to run their applications in the cloud, and this perspective influences how Dark looks at deployments, IDEs, exception handling, and other aspects of software development. Paul Biggar is the founder The post Dark Lang with Ellen Chisa and Paul Biggar appeared first on Software Engineering Daily....


LinkedIn Kafka with Nacho Solis
Apache Kafka was created at LinkedIn. Kafka was open sourced in 2011, when the company was eight years old. By that time, LinkedIn had developed a social network with millions of users. LinkedIn’s engineering team was building a range of externally facing products and internal tools, and many of these tools required a high-throughput system The post LinkedIn Kafka with Nacho Solis appeared first on Software Engineering Daily....

Gravity: Distributed Application Delivery with Ev Kontsevoy
Modern applications are distributed systems. These applications require an installation mechanism that can run and update the software across multiple nodes.  When a SaaS company starts to work with large enterprise customers, that company needs to figure out a way to deliver their product to the enterprise. This requires the SaaS company to deploy the The post Gravity: Distributed Application Delivery with Ev Kontsevoy appeared first on Software Engineering Daily....

Gravity: Distributed Application Delivery with Ev Kontsevoy
Modern applications are distributed systems. These applications require an installation mechanism that can run and update the software across multiple nodes.  When a SaaS company starts to work with large enterprise customers, that company needs to figure out a way to deliver their product to the enterprise. This requires the SaaS company to deploy the The post Gravity: Distributed Application Delivery with Ev Kontsevoy appeared first on Software Engineering Daily....


Incident Reproduction with Tammy Butow
Databases go offline. Services fail to scale up. Deployment errors can cause an application backend to get DDoS’d. When an event happens that prevents your company from operating as expected, it is known as an incident. Software teams respond to an incident by issuing a fix. Sometimes that fix returns the software to its ideal The post Incident Reproduction with Tammy Butow appeared first on Software Engineering Daily....

Diffbot Infrastructure with Mike Tung
Diffbot is a knowledge graph that allows developers to interface with the unstructured web as if it was a structured database. In today’s show, Diffbot CEO Mike Tung returns for a second discussion about how he has built Diffbot and how Diffbot is used. The web has many different entities. Web pages, topics, people, stories, The post Diffbot Infrastructure with Mike Tung appeared first on Software Engineering Daily....

How To Build A Cloud Provider with Anurag Goel
Render is a cloud provider built on top of Amazon Web Services and Google Cloud. Render uses the compute abstractions provided by the major cloud providers to build a second layer cloud provider with the goal of providing a better user experience. Anurag Goel is the founder of Render, and he returns to the show The post How To Build A Cloud Provider with Anurag Goel appeared first on Software Engineering Daily....


How To Build A Cloud Provider with Anurag Goel
Render is a cloud provider built on top of Amazon Web Services and Google Cloud. Render uses the compute abstractions provided by the major cloud providers to build a second layer cloud provider with the goal of providing a better user experience. Anurag Goel is the founder of Render, and he returns to the show The post How To Build A Cloud Provider with Anurag Goel appeared first on Software Engineering Daily....

freeCodeCamp’s Quincy Larson interviews Jeff Meyerson
We are republishing a podcast from the freeCodeCamp Podcast as a weekend episode. Jeff Meyerson is the creator and host of the Software Engineering Daily podcast. Jeff grew up in Texas. He spent most of his childhood playing competitive strategy games like Magic: the Gathering. This lead him to making a lot of money – The post freeCodeCamp’s Quincy Larson interviews Jeff Meyerson appeared first on Software Engineering Daily....

Webflow: No-Code with Vlad Magdalin
Webflow is a platform for building applications without programming. Software engineering has barely been around for 30 years. Over that period of time, there have been many attempts to create a platform that allows for the creation of software without writing a line of code. Most of these systems have not been able to fulfill The post Webflow: No-Code with Vlad Magdalin appeared first on Software Engineering Daily....


Webflow: No-Code with Vlad Magdalin
Webflow is a platform for building applications without programming. Software engineering has barely been around for 30 years. Over that period of time, there have been many attempts to create a platform that allows for the creation of software without writing a line of code. Most of these systems have not been able to fulfill The post Webflow: No-Code with Vlad Magdalin appeared first on Software Engineering Daily....

Data Visualization with Sherman Wood and Chad Lumley
Data visualization is the presentation of data in a way that emphasizes certain qualities about that data. Data visualization can be used to prove a specific point, or it can be used as a depiction of a data set to be explored. Data visualization is used in consumer software products as well as backend engineering The post Data Visualization with Sherman Wood and Chad Lumley appeared first on Software Engineering Daily....

Treehouse: Business and Education with Ryan Carson
The ability to create software is a superpower. But software education is not evenly distributed. Ryan Carson started Treehouse to provide a high quality education system for anyone to learn how to build software. On a previous episode, Ryan and I discussed the field of programming education. Ryan returns to the show for a conversation The post Treehouse: Business and Education with Ryan Carson appeared first on Software Engineering Daily....


Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh
Video surveillance impacts human lives every day.  On most days, we do not feel the impact of video surveillance. But the effects of video surveillance have tremendous potential. It can be used to solve crimes and find missing children. It can be used to intimidate journalists and empower dictators. Like any piece of technology, video The post Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh appeared first on Software Engineering Daily....

Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh
Video surveillance impacts human lives every day.  On most days, we do not feel the impact of video surveillance. But the effects of video surveillance have tremendous potential. It can be used to solve crimes and find missing children. It can be used to intimidate journalists and empower dictators. Like any piece of technology, video The post Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh appeared first on Software Engineering Daily....

GDPR in Practice with Joshua Prismon
Data privacy policies have changed how software organizations need to operate. As consumer preferences have shifted in favor of strong privacy, software companies are having to examine their policies around data collection and retention. Many software companies were started in a time with different norms around data.  Building a new application that is compliant with The post GDPR in Practice with Joshua Prismon appeared first on Software Engineering Daily....


Indie Hackers (3 Years Later) with Courtland Allen
Indie Hackers is a platform for independent software businesses to discuss strategy and find inspiration. Courtland Allen founded Indie Hackers with the goal of sharing the stories of these businesses, and the company has become a thriving community of entrepreneurs, engineers, and creators. Business is a creative medium. The definition of a successful business is The post Indie Hackers (3 Years Later) with Courtland Allen appeared first on Software Engineering Daily....

The Messy Middle with Scott Belsky
Scott Belsky founded Behance in 2006. Behance is a social platform where designers and creators share their work. Scott was motivated to start Behance due to his desire to combine his love for creativity with his desire to create a business. After 6 years of work, Behance was acquired by Adobe for more than $150 The post The Messy Middle with Scott Belsky appeared first on Software Engineering Daily....

The Messy Middle with Scott Belsky
Scott Belsky founded Behance in 2006. Behance is a social platform where designers and creators share their work. Scott was motivated to start Behance due to his desire to combine his love for creativity with his desire to create a business. After 6 years of work, Behance was acquired by Adobe for more than $150 The post The Messy Middle with Scott Belsky appeared first on Software Engineering Daily....


Fivetran: Data Connectors with George Fraser
Large companies have multiple databases, multiple data formats, and multiple applications that need to use the data. Every data engineer needs to move data between these different components of a system. Moving data between different parts of a system is often called “ETL”, an acronym for “Extract, Transform, Load.” Data engineers spend much of their The post Fivetran: Data Connectors with George Fraser appeared first on Software Engineering Daily....

Cruise: Self-Driving Engineering with Mo Elshenawy
The development of self-driving cars is one of the biggest technological changes that is under way. Across the world, thousands of engineers are working on developing self-driving cars. Although it still seems far away, self-driving cars are starting to feel like an inevitability. This is especially true if you spend much time in downtown San The post Cruise: Self-Driving Engineering with Mo Elshenawy appeared first on Software Engineering Daily....

Cruise: Self-Driving Engineering with Mo Elshenawy
The development of self-driving cars is one of the biggest technological changes that is under way. Across the world, thousands of engineers are working on developing self-driving cars. Although it still seems far away, self-driving cars are starting to feel like an inevitability. This is especially true if you spend much time in downtown San The post Cruise: Self-Driving Engineering with Mo Elshenawy appeared first on Software Engineering Daily....


Software Moats with Astasia Myers
Investors often use the term “moat” to describe the durable competitive advantage of a company. When an investor puts money into a company, they are making that investment based on a valuation. That valuation is subjective–it is how much the investor thinks the company is worth. A valuation is determined by the present value of The post Software Moats with Astasia Myers appeared first on Software Engineering Daily....

Stripe Infrastructure Management with Uma Chingunde
Software engineering is a new field. There are theories about how we should be building our systems, but these theories might change over time. The same is true for engineering management.  There are many successful examples of companies scaling with the management hierarchies pioneered by Microsoft and Google, but since everyone knows that those techniques The post Stripe Infrastructure Management with Uma Chingunde appeared first on Software Engineering Daily....

Life Insurance Engineering with Vipul Sharma and Lingke Wang
Ethos Life Insurance is a software company that sells life insurance products. Software is reshaping established industries such as banking, insurance, and manufacturing. In these large, established industries, incumbents are adopting new technology as fast as they can, but the new technology needs to be integrated with the old technology. The slow rate of technology The post Life Insurance Engineering with Vipul Sharma and Lingke Wang appeared first on Software Engineering Daily....


Life Insurance Engineering with Vipul Sharma and Lingke Wang
Ethos Life Insurance is a software company that sells life insurance products. Software is reshaping established industries such as banking, insurance, and manufacturing. In these large, established industries, incumbents are adopting new technology as fast as they can, but the new technology needs to be integrated with the old technology. The slow rate of technology The post Life Insurance Engineering with Vipul Sharma and Lingke Wang appeared first on Software Engineering Daily....

WebAssembly Isolation with Tyler McMullen
Isolation is a fundamental concept in computer science. Software workloads are isolated from each other in order to keep resource access cleanly separated.  When programs are properly isolated, it is easier for the programmer to reason about the memory safety of that program. When a program is not properly isolated, it can lead problems such The post WebAssembly Isolation with Tyler McMullen appeared first on Software Engineering Daily....

Cloud Foundry with Abby Kearns
Cloud Foundry is a system for managing distributed applications. Cloud Foundry was released in 2011, and has been widely adopted by enterprises that need a platform for deploying and scaling the applications that run within their company. The ecosystem around Cloud Foundry includes systems for continuous delivery, pubsub messaging, and containerization. Abby Kearns is the The post Cloud Foundry with Abby Kearns appeared first on Software Engineering Daily....


Cloud Foundry with Abby Kearns
Cloud Foundry is a system for managing distributed applications. Cloud Foundry was released in 2011, and has been widely adopted by enterprises that need a platform for deploying and scaling the applications that run within their company. The ecosystem around Cloud Foundry includes systems for continuous delivery, pubsub messaging, and containerization. Abby Kearns is the The post Cloud Foundry with Abby Kearns appeared first on Software Engineering Daily....

Kafka Data Pipelines with Robin Moffatt
A new software product usually starts with a single database. That database manages the tables for user accounts and basic transactions. When a product becomes popular, the database grows in size. There are more transactions and more users. A company grows around that product, and the company starts to accumulate more data in different sources. The post Kafka Data Pipelines with Robin Moffatt appeared first on Software Engineering Daily....

ReadMe with Greg Koberger
A software company needs to get many things right in order to be successful. Having a useful product with solid engineering is only the beginning. ReadMe was started five years ago. The company solved a seemingly simple problem: documentation for software products. If you have worked as a software engineer, you have looked at documentation. The post ReadMe with Greg Koberger appeared first on Software Engineering Daily....


Open Source Ecosystem with Dirk Hohndel
Open source software is very new. Open source has existed for less than 30-40 years, depending on who you ask. The idea of open source was popularized by Linux, and open source software started to get heavily commercialized in the 1990s. By the early 2000s, open source was used by nearly every large software company. The post Open Source Ecosystem with Dirk Hohndel appeared first on Software Engineering Daily....

Open Source Ecosystem with Dirk Hohndel
Open source software is very new. Open source has existed for less than 30-40 years, depending on who you ask. The idea of open source was popularized by Linux, and open source software started to get heavily commercialized in the 1990s. By the early 2000s, open source was used by nearly every large software company. The post Open Source Ecosystem with Dirk Hohndel appeared first on Software Engineering Daily....

Distributed Databases with Aly Cabral
Modern databases consist of multiple servers that host the data in a distributed fashion. Using multiple servers allows a database to be resilient to the failure of any one database node, because copies of the data are shared to other servers. A multi-node setup also lets the database grow beyond the size of data that The post Distributed Databases with Aly Cabral appeared first on Software Engineering Daily....


Kafka Applications with Tim Berglund
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout The post Kafka Applications with Tim Berglund appeared first on Software Engineering Daily....

Kafka Applications with Tim Berglund
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout The post Kafka Applications with Tim Berglund appeared first on Software Engineering Daily....

Okta Engineering with Hector Aguilar
A new employee at a software company needs access to a variety of tools. In order to get started working, the employee might need Slack, email, Google Docs, and Amazon Web Services, and all of these require an account with a username and password. Setting up all of these accounts can be time consuming, because The post Okta Engineering with Hector Aguilar appeared first on Software Engineering Daily....


Okta Engineering with Hector Aguilar
A new employee at a software company needs access to a variety of tools. In order to get started working, the employee might need Slack, email, Google Docs, and Amazon Web Services, and all of these require an account with a username and password. Setting up all of these accounts can be time consuming, because The post Okta Engineering with Hector Aguilar appeared first on Software Engineering Daily....

Cloud-Native Applications with Cornelia Davis
Amazon Web Services first came out in 2006. It took several years before the software industry realized that cloud computing was a transformative piece of technology. Initially, the common perspective around cloud computing was that it was a useful tool for startups, but would not be a smart option for large, established businesses. Cloud computing The post Cloud-Native Applications with Cornelia Davis appeared first on Software Engineering Daily....

Talking Python with Michael Kennedy
Python is one of the most popular programming languages in the software world. After working with Python and developing a love for the language, Michael Kennedy started to wonder why there was not a high quality podcast dedicated to covering the community and new technologies of the Python ecosystem. Michael started Talk Python To Me The post Talking Python with Michael Kennedy appeared first on Software Engineering Daily....


MongoDB Data Platform with Andrew Davidson
A new software application has simple requirements for a database.  The database needs to be written to and read from. The database fulfills simple needs such as storing user information and providing the application frontend with the necessary data to render a simple webpage of financial transactions or blog posts. As an application becomes successful, The post MongoDB Data Platform with Andrew Davidson appeared first on Software Engineering Daily....

MongoDB Data Platform with Andrew Davidson
A new software application has simple requirements for a database.  The database needs to be written to and read from. The database fulfills simple needs such as storing user information and providing the application frontend with the necessary data to render a simple webpage of financial transactions or blog posts. As an application becomes successful, The post MongoDB Data Platform with Andrew Davidson appeared first on Software Engineering Daily....

Google Spanner with Deepti Srivastava
Spanner is a globally distributed, transactionally consistent database.  Spanner initially emerged as a paper that came out of Google in 2012. Around this time, database scalability was difficult to solve, even for Google. The Spanner paper offered some breakthroughs in distributed systems which allowed Google to take some of the learnings from BigTable’s eventual consistency The post Google Spanner with Deepti Srivastava appeared first on Software Engineering Daily....


Open Source Policy with Bruce Perens
Open source plays a key role in today’s world of technology businesses. Today, the impact of open source seems obvious. From Kubernetes to distributed databases to cloud providers, so much of our software is powered by open source. But it was not always this way.   Bruce Perens was one of the earliest figures in the The post Open Source Policy with Bruce Perens appeared first on Software Engineering Daily....

JavaScript Jabber with Jeff Meyerson
Host: Charles Max Wood of JavaScript Jabber Joined by Special Guest: Jeffrey Meyerson Jeffrey Meyerson, founder of FindCollabs and host at Software Engineering Daily joins Charles Max Wood for a discussion about latest trends in the developer world, ways of monetizing podcasts, and finding ads for podcasts. Jeffrey shares how he started to host podcasts and how he became The post JavaScript Jabber with Jeff Meyerson appeared first on Software Engineering Daily....

Repl.it: Browser Coding with Amjad Masad
The browser has become the central application of the consumer operating system. Every piece of client software, from email to document management, has become usable through the browser. Even modern desktop software such as Slack is built using Electron, a tool for building client applications that essentially run inside of a browser without an address The post Repl.it: Browser Coding with Amjad Masad appeared first on Software Engineering Daily....


Monday: Business Management Software with Eran Zinman
Modern software is built with cloud services, APIs, and other high level tools. Technical software development is moving beyond the realm of writing code. Individuals who do not have a background in computer science or programming can create increasingly complex tools. Higher level APIs include Twilio for managing phone communications, and Stripe for managing financial The post Monday: Business Management Software with Eran Zinman appeared first on Software Engineering Daily....

Cassandra Business with Jonathan Ellis
Cassandra was initially released in 2008 as a project out of Facebook. Cassandra offered an open source solution to database scalability issues that were being tackled internally by large companies like Amazon, Google and Facebook. 2008 was a golden age of new infrastructure, with systems such as Hadoop and Kafka gaining traction around the same The post Cassandra Business with Jonathan Ellis appeared first on Software Engineering Daily....

DevOps at Delta Air Lines with Jasmine James
Airlines have always had an emphasis on new technology. Over the years, airlines have needed to develop more and more software. Digital transformation is causing every large company to adopt the tools and practices of software companies, and that includes Delta Airlines. Delta Airlines has existed for more than 90 years. Over that period of The post DevOps at Delta Air Lines with Jasmine James appeared first on Software Engineering Daily....


DevOps at Delta Air Lines with Jasmine James
Airlines have always had an emphasis on new technology. Over the years, airlines have needed to develop more and more software. Digital transformation is causing every large company to adopt the tools and practices of software companies, and that includes Delta Airlines. Delta Airlines has existed for more than 90 years. Over that period of The post DevOps at Delta Air Lines with Jasmine James appeared first on Software Engineering Daily....

Facebook Parse Acquisition (Part 2) with Ilya Sukhar
Ilya Sukhar founded Parse in 2011 to make cloud services for mobile developers. Parse was a newer kind of cloud provider called “backend-as-a-service”, built to simplify the complexities of Amazon Web Services and the complexities of the mobile ecosystem.  During this time, Facebook was in the middle of its shift toward becoming a mobile application The post Facebook Parse Acquisition (Part 2) with Ilya Sukhar appeared first on Software Engineering Daily....

Facebook Parse Acquisition (Part 1) with Charity Majors
Parse was a backend-as-a-service company that started in 2011 with the initial focus of making the cloud easier to use for mobile developers. Parse had several novel engineering challenges. In 2011, it was not easy to build on top of AWS, nor was it easy to build within the young mobile ecosystem. Charity Majors was The post Facebook Parse Acquisition (Part 1) with Charity Majors appeared first on Software Engineering Daily....


Facebook Engineering Process with Kent Beck
Kent Beck is a legendary figure in the world of software engineering.  Kent was an early advocate of Test-Driven Development (TDD), and popularized the idea of writing unit tests before writing code that would satisfy those unit tests. A unit test isolates and tests a small piece of functionality within a large piece of software. The post Facebook Engineering Process with Kent Beck appeared first on Software Engineering Daily....

Facebook Release Engineering with Chuck Rossi
When Chuck Rossi joined Facebook in 2008, he was one of the most experienced release engineers at the company. As he began to explore the engineering practices of the organization, he was surprised, confused, and impressed by the release engineering system that he encountered. Release engineering is the process by which software is released to The post Facebook Release Engineering with Chuck Rossi appeared first on Software Engineering Daily....

Facebook Scaling with Pedram Keyani
Facebook is a large multiuser application. Scaling Facebook was different than scaling a single-user application such as an ecommerce store or a search engine. A social network is faced with unique infrastructure scalability challenges, as well as subjective questions around user communications, privacy, and content. Pedram Keyani worked at Google before joining Facebook in 2007. The post Facebook Scaling with Pedram Keyani appeared first on Software Engineering Daily....


Facebook Scaling with Pedram Keyani
Facebook is a large multiuser application. Scaling Facebook was different than scaling a single-user application such as an ecommerce store or a search engine. A social network is faced with unique infrastructure scalability challenges, as well as subjective questions around user communications, privacy, and content. Pedram Keyani worked at Google before joining Facebook in 2007. The post Facebook Scaling with Pedram Keyani appeared first on Software Engineering Daily....

Crypto and OSS with Haseeb Qureshi, Joseph Jacks, and Alok Vasudev
Cryptocurrencies are decentralized monetary systems built on open source software. The open source software movement has evolved from the world of Linux, MySQL, and Apache to a thriving ecosystem of commercial enterprises built around open source software. This ecosystem includes projects such as Kubernetes, MongoDB, and ReactJS. It includes large organizations such as Amazon Web The post Crypto and OSS with Haseeb Qureshi, Joseph Jacks, and Alok Vasudev appeared first on Software Engineering Daily....

Technical Onboarding with Kristen Gallagher
When a new employee joins a software company, it is often unclear where that employee should begin. Do they have a mentor? What are they working on? What are the expectations for how fast that employee should be contributing? The early period of employment is often referred to as “onboarding.” During the onboarding period, an The post Technical Onboarding with Kristen Gallagher appeared first on Software Engineering Daily....


Time Series Databases with Rob Skillington
A time series database is optimized for the storage of high volumes of sequential data across time. Time series databases are often organized as columnar data stores that can write large volumes of data quickly. These systems can sometimes tolerate data loss, because the data they are gathering is used for monitoring and other applications The post Time Series Databases with Rob Skillington appeared first on Software Engineering Daily....

Insurance Software with Gordon Wintrob
Insurance is an old business. Individuals and businesses have been buying insurance policies for decades. These insurance policies can cost hundreds, thousands, or tens of thousands of dollars per year.   Software is remaking the insurance industry. One way new software can improve the insurance industry is through better brokerage technology. Insurance involves carriers and brokers, The post Insurance Software with Gordon Wintrob appeared first on Software Engineering Daily....

Open Source Business Models with Karthik Ranganathan, Heather Meeker, and Matt Asay
Open source software has evolved into a thriving, multifaceted ecosystem. Open source encompasses operating systems and databases. Open source embodies both altruism and self-interest. And open source enables thriving businesses from WordPress blogs to hundred billion dollar cloud providers. There is a large set of business models that can be built around a successful open The post Open Source Business Models with Karthik Ranganathan, Heather Meeker, and Matt Asay appeared first on Software Engineering Dail...


Bitcoin Ecosystem with Andreas M. Antonopoulos
Andreas M. Antonopoulos is the author of several books about cryptocurrency engineering, including Mastering Bitcoin and Mastering Ethereum. In these books, Andreas lays out the systems of economics and computer science that underpin the two most mature decentralized monetary systems. When Andreas originally discovered the Bitcoin whitepaper, he had witnessed the repeated mismanagement of government-backed fiat The post Bitcoin Ecosystem with Andreas M. Antonopoulos appeared first on Software Engineering Da...

Moonlight: Software Contracting Platform with Emma Lawler and Philip Thomas
Software engineers often work as a contractor for some duration of their career. A contractor earns a fixed hourly salary for a defined period of weeks, months, or years. Contract work can be more flexible than full-time work, and often pays more than full-time software engineering, because contract jobs can end at any time, and The post Moonlight: Software Contracting Platform with Emma Lawler and Philip Thomas appeared first on Software Engineering Daily....

Service Mesh Deployment with Varun Talwar
The service mesh abstraction allows for a consistent model for managing and monitoring the different components of a microservices architecture.  In the service mesh pattern, each service is deployed with a sidecar container that contains a service proxy. These sidecars are collectively referred to as the “data plane.” Each sidecar provides the service that it The post Service Mesh Deployment with Varun Talwar appeared first on Software Engineering Daily....


PlayStation Engineering with Tony Godar
The PlayStation is a line of game consoles created by Sony. PlayStation devices include the PS2, PS3, PS4, and the PSP mobile system. Tony Godar worked as an engineer in the PlayStation ecosystem for 15 years, and he joins the show to give a retrospective on his time in the console industry. Developing hardware and The post PlayStation Engineering with Tony Godar appeared first on Software Engineering Daily....

Big Business with Tyler Cowen
Large software companies have become a target for criticism. Google, Facebook, Amazon and other prominent technology giants find themselves under a kind of scrutiny that is reminiscent of banks in 2008 and oil companies in the early 1900s. Across the planet, there is a growing sentiment that “big tech” has too much power, and that The post Big Business with Tyler Cowen appeared first on Software Engineering Daily....

An Elegant Puzzle Virtual Book Club
In this episode Will Larson, author of An Elegant Puzzle: Systems of Engineering Management, speaks with Uma Chingunde of Stripe and Jeff Meyerson of Software Engineering Daily about engineering management. Will was also featured on SE Daily recently. An Elegant Puzzle is an excellent resource on management techniques and strategies for scaling software organizations. Will’s writing draws from The post An Elegant Puzzle Virtual Book Club appeared first on Software Engineering Daily....


a16z Podcasting with Sonal Chokshi
The a16z Podcast is a show that is produced by Andreessen Horowitz, an investment fund based in Silicon Valley. The a16z Podcast covers topics including software engineering, biology, media, cryptocurrencies and entrepreneurship. A16z is one of the most popular podcasts about technology. Sonal Chokshi is the editor in chief at Andreessen Horowitz and the showrunner The post a16z Podcasting with Sonal Chokshi appeared first on Software Engineering Daily....

Data-As-A-Service with Auren Hoffman
Data-as-a-service businesses offer paid access to data sets. These data sets can be useful for building products or training machine learning models.  There has been steady growth in the tools and practices around processing and storing data. But access to data sets remains a bottleneck for widespread development of machine learning applications in a large The post Data-As-A-Service with Auren Hoffman appeared first on Software Engineering Daily....

People.ai: Machine Learning for Sales with Andrey Akselrod
A large sales organization has hundreds of sales people. Each of those sales people manages a set of accounts who they are trying to close sales deals on. Sales people are overseen by managers who ensure that the sales people are performing well. Directors and VPs ensure the scalability and health of the overall sales The post People.ai: Machine Learning for Sales with Andrey Akselrod appeared first on Software Engineering Daily....


Jaeger: Distributed Tracing at Uber with Yuri Shkuro
During 2015, Uber was going through rapid scalability. The internal engineering systems were constantly tested by the growing user base. Over the next two years, the number of internal services at Uber would grow from 500 to 2000, and standardizing the monitoring of all these different services became a priority. After working with a variety The post Jaeger: Distributed Tracing at Uber with Yuri Shkuro appeared first on Software Engineering Daily....

Golden: Intelligent Knowledge Map with Jude Gomila
A knowledge base assembles information from a wide variety of sources into a central platform. The most popular knowledge base is Wikipedia, which covers a wide variety of concepts through a system that attempts to remain authoritative and impartial. Other open knowledge platforms include Stack Overflow, which focuses on programming concepts, and Quora, which adds The post Golden: Intelligent Knowledge Map with Jude Gomila appeared first on Software Engineering Daily....

Career Karma: Coding Bootcamp Platform with Ruben Harris and Artur Meyster
Coding bootcamps allow anyone to become a programmer at a faster pace than the traditional computer science education system. In the last five years, coding bootcamps have grown rapidly in popularity, with thousands of people gaining the necessary skills to work as a software engineer. Career Karma is a platform that allows individuals to find The post Career Karma: Coding Bootcamp Platform with Ruben Harris and Artur Meyster appeared first on Software Engineering Daily....


Hackathons with Jonathan Gottfried
A hackathon is an organized event where participants work together to build a product or tool. Hackathons are about creativity, learning, and exploration. A developer that is participating in a hackathon is often working on something that is outside of their normal day-to-day focus.  Hackathons can provide significant value to the participants. Hackathons have led The post Hackathons with Jonathan Gottfried appeared first on Software Engineering Daily....

TechPrimers: Software Engineering YouTube with Ajay Kumar
Videos play a key role in the continuing education of a software engineer. Video can capture many different types of content that is useful for engineers: conference talks, tutorial videos, and podcast-style interviews are all popular formats of online video. YouTube has become the predominant source for video content about software engineering. The open nature The post TechPrimers: Software Engineering YouTube with Ajay Kumar appeared first on Software Engineering Daily....

WebAssembly on IoT with Jonathan Beri
“Internet of Things” is a term used to describe the increasing connectivity and intelligence of physical objects within our lives.  IoT has manifested within enterprises under the term “Industrial IoT,” as wireless connectivity and machine learning have started to improve devices such as centrifuges, conveyor belts, and factory robotics. In the consumer space, IoT has The post WebAssembly on IoT with Jonathan Beri appeared first on Software Engineering Daily....


Data Mesh with Zhamak Deghani
Data engineering involves numerous tools–a data lake, databases, data warehouses, numerous APIs, streaming systems, and microservices. There is no shortage of ways to interact with data and manage data, but many companies are struggling to figure out design patterns and best practices for how to manage data and build data infrastructure. Zhamak Dehgani is a The post Data Mesh with Zhamak Deghani appeared first on Software Engineering Daily....

Software IPOs with Tomasz Tunguz
Software companies such as Slack, Zoom, and Uber have recently gone public. When a company goes public, they issue a document called an S-1. Within the S-1, there is a wealth of information about the company, providing a detailed story about the company’s business model, economics, and future prospects. The S-1 describes the operating model The post Software IPOs with Tomasz Tunguz appeared first on Software Engineering Daily....

Envoy Mobile with Matt Klein
Envoy is an open source edge and service proxy that was originally developed at Lyft.  Envoy is often deployed as a sidecar application that runs alongside a service and helps that service by providing features such as routing, rate limiting, telemetry, and security policy. Envoy has gained significant traction in the open source community, and The post Envoy Mobile with Matt Klein appeared first on Software Engineering Daily....


TechLitAfrica: Computer Literacy in Africa with Tyler Cinnamon
In the developed world, it is easy to take for granted that we grew up with computers. Technology is so pervasive in the United States that we have debates about how early in child development a human should be given a smartphone. Across much of Africa, there is a shortage of access to computers. Children The post TechLitAfrica: Computer Literacy in Africa with Tyler Cinnamon appeared first on Software Engineering Daily....

Data Engineering with Tobias Macey
The Hadoop ecosystem provided every company with the tools to store and query large amounts of data at a low cost. Since 2005, that ecosystem has expanded with more and more open source applications for data infrastructure.  Data infrastructure includes databases, data lakes, distributed queues, data warehouses, query engines, web applications, on-prem software, closed source, The post Data Engineering with Tobias Macey appeared first on Software Engineering Daily....

Emerging Markets: Vietnam with Charles Lee
From Africa to India to Asia to South America–computer science and programming are rising in popularity in every emerging market. Each of these markets has regional needs for technology. Just like every culture develops its own food and television, every culture needs different types of applications to run their lives. In Vietnam, the day-to-day life The post Emerging Markets: Vietnam with Charles Lee appeared first on Software Engineering Daily....


Facebook GraphQL with Lee Byron
In 2011, Facebook had begun to focus its efforts on mobile development. Mobile phones did not have access to reliable, high bandwidth connections, and the Facebook engineering team needed to find a solution to improve the request latency between mobile clients and the backend Facebook infrastructure. One source of latency was recursive data fetching. If The post Facebook GraphQL with Lee Byron appeared first on Software Engineering Daily....

Facebook Open Source Management with Tom Occhino
Facebook has released open source software projects that have changed the industry. The most impactful projects to date are the React frontend user interface tools: ReactJS and React Native. Before React became popular, there were multiple competing solutions for the dominant frontend JavaScript framework. React became the most prominent because of its invention of JSX, The post Facebook Open Source Management with Tom Occhino appeared first on Software Engineering Daily....

Facebook Data Infrastructure with Dhruba Borthakur
Facebook generates high volumes of data at a rapid pace. Dhruba Borthakur joined Facebook in 2008 to work on data infrastructure. His early projects at Facebook were around Hadoop, the distributed file system and MapReduce computation platform that laid the foundation for the “big data” movement.  At the time, Facebook was generating as much data The post Facebook Data Infrastructure with Dhruba Borthakur appeared first on Software Engineering Daily....


Facebook Engineering Culture with Raylene Yung
Facebook moves fast because of vision, collaboration, and trust. The fast pace of development is enabled by constantly improving infrastructure and a sense of unity throughout the company.  In Facebook’s early days, there was an emphasis on rapidly deploying new code to drive constant improvement and experimentation.  Product quality was maintained by engineers closely checking The post Facebook Engineering Culture with Raylene Yung appeared first on Software Engineering Daily....

Facebook PHP with Keith Adams
Facebook was built using PHP, a programming language that was used widely in the late 90s and early 2000s. PHP allows developers to get web applications built quickly and easily, although PHP has a reputation for being difficult to scale.  In the early days of Facebook, the company was scaling rapidly on every dimension.  New The post Facebook PHP with Keith Adams appeared first on Software Engineering Daily....

Meltano: Data Engineering Lifecycle with Danielle Morrill
Data engineering allows a company to take advantage of the large quantities of data that the company has generated. In many companies, new data has been produced rapidly for many years, but the company has not been able to take full advantage of it.  Creating large data sets does not provide immediate value for a The post Meltano: Data Engineering Lifecycle with Danielle Morrill appeared first on Software Engineering Daily....


Software Media with Charles Max Wood
Software engineers have a wide variety of media to choose from, including podcasts, blogs, YouTube videos, conferences. The amount of software engineering media that is available is growing and accelerating. Eight years ago, there were not as many options for information about software. Charles Max Wood founded Devchat.tv to create a network of podcasts and The post Software Media with Charles Max Wood appeared first on Software Engineering Daily....

gVisor Container Isolation with Michael Pratt and Yoshi Tamura
Software applications running within a host operating system need to be isolated. Isolation prevents security vulnerabilities, such as one application accessing the memory of another. In modern cloud environments, a single physical host might be running multiple virtual machines on top of a hypervisor. Those virtual machines might be divided up into containers. The different The post gVisor Container Isolation with Michael Pratt and Yoshi Tamura appeared first on Software Engineering Daily....

Software Free Radicals with Lior Kanfi
Creating a software company has never been easier. Software engineers are increasingly seeing entrepreneurship as a viable career path. But the path to being an independent software developer is not always clear.  Most engineers spend some of their career working at a software company. Even an engineer who intends to build a company someday can The post Software Free Radicals with Lior Kanfi appeared first on Software Engineering Daily....


Edge Storage with Steve Klabnik
Edge computing allows for faster data access and computation. When your client application makes a request, that request might be routed to the edge. Edge servers are more numerous and more widely distributed than normal data centers, but an edge server might not have all of the data or the complete application logic for the The post Edge Storage with Steve Klabnik appeared first on Software Engineering Daily....

You Are Not A Commodity (Keynote at Tikal Full Stack Tech Radar Day)
Today’s episode is a keynote I gave at Full Stack Tech Radar Day in Tel Aviv. The talk is called “You Are Not a Commodity”. This talk is also available as a YouTube video. The slides can be accessed here. The world of commodity engineering is coming to an end. Developers are becoming more productive, The post You Are Not A Commodity (Keynote at Tikal Full Stack Tech Radar Day) appeared first on Software Engineering Daily....

ListenNotes: Podcast Search Engine with Wenbin Fang
ListenNotes allows users to find podcasts by categories, popularity, and search queries. ListenNotes is not a podcast client that you download onto your phone, but it allows users to build playlists. These playlists are automatically published to an RSS feed, so that users can curate a playlist on desktop and subscribe to that playlist from The post ListenNotes: Podcast Search Engine with Wenbin Fang appeared first on Software Engineering Daily....


Permissionless Innovation with Joseph Jacks
Open source software allows developers to take code from the Internet and modify it for their own use. Open source has allowed innovation to occur on a massive scale. Today, open source software powers our consumer client applications and our backend cloud server infrastructure.  Linux powers single node operating systems and Kubernetes is the foundation The post Permissionless Innovation with Joseph Jacks appeared first on Software Engineering Daily....

Google Earth WebAssembly with Jordon Mears
Google Earth allows users to explore the imagery of the real world. Imagery for Google Earth is taken from satellites, cars equipped with cameras, and other sources. Google Earth renders a data intensive 3-D model of the world on a client application such as a desktop browser or virtual reality system.  WebAssembly is a runtime The post Google Earth WebAssembly with Jordon Mears appeared first on Software Engineering Daily....

FoundationDB with Ryan Worl
FoundationDB is a multi-model distributed key-value store. It is fully ACID compliant and horizontally scalable. FoundationDB is not usually used directly by an application developer–FoundationDB is a foundational building block for higher level distributed systems such as the metadata store for data warehousing tool Snowflake. Ryan Worl is a software engineer who specializes in FoundationDB. The post FoundationDB with Ryan Worl appeared first on Software Engineering Daily....


FindCollabs Hackathon Winners: Kitspace and Rivaly
FindCollabs is a platform for finding collaborators and building projects. Three months ago we had our first hackathon, with lots of projects being created and collaborated on. In an earlier episode, we showcased the first place winner ARhythm.  Today’s show features two more interviews with winners from the first FindCollabs hackathon. Kitspace is an open The post FindCollabs Hackathon Winners: Kitspace and Rivaly appeared first on Software Engineering Daily....

Citus Data: Founding to Acquisition with Umur Cubukcu
A new database company needs to solve numerous problems in order to succeed. There are already lots of existing database companies, so a new company needs to find a way to strongly differentiate itself. Databases are core infrastructure, so a new database company must earn trust with its customers. A database is a complicated distributed The post Citus Data: Founding to Acquisition with Umur Cubukcu appeared first on Software Engineering Daily....

Lambda School Education with Andrew Madsen
Programmers are in high demand, and software engineering is a career path that is fun, creative, and lucrative. There are many people who want to transition into a career in software and are looking for the right path toward writing code. The traditional college computer science curriculum teaches some software engineering skills, but the time The post Lambda School Education with Andrew Madsen appeared first on Software Engineering Daily....


Afresh: Grocery Store Software with Volodymyr Kuleshov
A grocery store contains fruit, vegetables, meat, bread, and other items that can expire. In order to keep these items in stock, the store must be aware of how much food has been sold and what has gone bad. When a food item is low in stock, the store needs to order more of that The post Afresh: Grocery Store Software with Volodymyr Kuleshov appeared first on Software Engineering Daily....

Airflow in Practice with Chaim Turkel
Apache Airflow is a system for scheduling and monitoring workflows for data engineering. Airflow can be used to schedule ETL jobs, machine learning work, and script execution. Airflow also gives a developer a high level view into the graph of dependencies for their data pipelines. Chaim Turkel is a backend data architect at Tikal. He The post Airflow in Practice with Chaim Turkel appeared first on Software Engineering Daily....

Project Management with Kurt Schrader
Software projects are organized and planned using project management software. Examples of project management software include JIRA, Trello, and Asana. There are hundreds of tools for managing a software project because there are infinite ways that a project could be managed. Google Docs changed project management by allowing documents to be easier to share and The post Project Management with Kurt Schrader appeared first on Software Engineering Daily....


Niantic Real World with Paul Franceus
Niantic is the company behind Pokemon Go, an augmented reality game where users walk around in the real world and catch Pokemon which appear on their screen. The idea for augmented reality has existed for a long time. But the technology to bring augmented reality to the mass market has appeared only recently. Improved mobile The post Niantic Real World with Paul Franceus appeared first on Software Engineering Daily....

WebAssembly Compilation with Till Schneidereit
WebAssembly allows for web-based execution of languages other than JavaScript. Programs written in Rust or C++ can be compiled down to WebAssembly and shipped over the browser for on-the-fly execution in a safe, memory controlled environment. WebAssembly has been in development for more than two years, and is still an immature ecosystem because building the The post WebAssembly Compilation with Till Schneidereit appeared first on Software Engineering Daily....

Infrastructure Wars with Sheng Liang
Sheng Liang was the lead developer on the original Java Virtual Machine. Today he works as the CEO of Rancher Labs, a company building a platform on top of Kubernetes. Sheng joins the show to discuss his experiences in the technology industry. The container orchestration wars had many victims. The competing standards for how an The post Infrastructure Wars with Sheng Liang appeared first on Software Engineering Daily....


Kubernetes Operators with Rob Szumski
Kubernetes has made distributed systems easier to deploy and manage. As Kubernetes has become reliable, engineers have started to look for higher level abstractions we can define on top of Kubernetes. An operator is a method of packaging, deploying, and managing a Kubernetes application. Operators are useful for spinning up distributed systems such as Kafka, The post Kubernetes Operators with Rob Szumski appeared first on Software Engineering Daily....

Render: High Level Cloud with Anurag Goel
Cloud computing was popularized in 2006 with the launch of Amazon Web Services. AWS allowed developers to use remote server infrastructure with a simple set of APIs. But even with AWS, it was still not simple to deploy and manage a web application. In 2007, Heroku launched a platform built on top of AWS. Heroku The post Render: High Level Cloud with Anurag Goel appeared first on Software Engineering Daily....

Elegant Puzzle with Will Larson
Software engineering is an art and a science. To manage engineers is to manage artists and scientists. Software companies build practical tools like payment systems, messaging products, and search engines. Software tools are the underpinnings of our modern lives. You might expect this core infrastructure which modern humans rely on to have been constructed with The post Elegant Puzzle with Will Larson appeared first on Software Engineering Daily....


Stripe Machine Learning Infrastructure with Rob Story and Kelley Rivoire
Machine learning allows software to improve as that software consumes more data. Machine learning is a tool that every software engineer wants to be able to use. Because machine learning is so broadly applicable, software companies want to make the tools more accessible to the developers across the organization. There are many steps that an The post Stripe Machine Learning Infrastructure with Rob Story and Kelley Rivoire appeared first on Software Engineering Daily....

Software Businesses with Hiten Shah
The software market changes every year. As individuals and enterprises become more willing to buy software, there are new markets for entrepreneurs to sell software to. Good software has high margins and high retention, so even a niche software business can prove profitable. As software spreads across the world, developing countries are showing a willingness The post Software Businesses with Hiten Shah appeared first on Software Engineering Daily....

Kubernetes Vision with Joe Beda
Google Cloud was started with a vision of providing Google infrastructure to the masses. In 2008, it was not obvious that Google should become a cloud provider. Amazon Web Services was finding success among startups who needed on-demand infrastructure, but the traditional enterprise market was not yet ready to buy cloud resources. Googlers liked the The post Kubernetes Vision with Joe Beda appeared first on Software Engineering Daily....


Kubernetes Storage with Saad Ali
Containers are made to fail gracefully. When your container shuts down due to a hardware or software failure, your distributed application should be able to tolerate that failure. One simple way to be able to tolerate such a failure is to make all of your application logic “stateless.” If your application does not maintain state, The post Kubernetes Storage with Saad Ali appeared first on Software Engineering Daily....

Kubernetes Market with Adam Glick
Amazon Web Services is the leading cloud provider by a large margin. Amazon established its lead by being first to market in 2006, with Google and Microsoft taking several years to catch up to the huge business opportunity of the cloud. Since 2008, Google Cloud has been working on cloud products for developers. It started The post Kubernetes Market with Adam Glick appeared first on Software Engineering Daily....

Service Mesh Interface with Lachlan Evenson
Containers offer a lightweight abstraction for running a server. Cloud providers are able to manage billions of containers from different users, allowing for economies of scale so that each user can pay less. Today, there is a variety of ways that users can deploy containers on a cloud provider. These containers can run in managed The post Service Mesh Interface with Lachlan Evenson appeared first on Software Engineering Daily....


Multicloud Future with Bassam Tabbara
Each cloud provider offers a different set of services which are not always compatible with each other. What are the challenges of building an application that interoperates with multiple different clouds? The first issue is API compatibility. Most cloud providers have a managed SQL offering, a bucket storage system, and server abstractions like virtual machines The post Multicloud Future with Bassam Tabbara appeared first on Software Engineering Daily....

Kubernetes Development with Tim Hockin
Kubernetes has evolved from a nascent project within Google to a thriving ecosystem of cloud providers, open source projects, and engineers. Tim Hockin is a principal software engineer who has been with Google for 15 years. Tim joins the show to talk about the early days of the Kubernetes projects, and the engineering efforts that The post Kubernetes Development with Tim Hockin appeared first on Software Engineering Daily....

Google Anthos with Aparna Sinha
Google’s cloud business was long regarded as a place where startups could build a business, but not established enterprises. For serious workloads, enterprises chose Amazon almost unanimously. This phenomenon of Amazon as the default was described by a phrase that harkened back to the days of IBM’s dominance: “nobody ever got fired for choosing AWS.” The post Google Anthos with Aparna Sinha appeared first on Software Engineering Daily....


Service Mesh Wars with William Morgan
A service mesh is an abstraction that provides traffic routing, policy management, and telemetry for a distributed application. A service mesh consists of a data plane and a control plane. In the data plane, a proxy runs alongside each service, with every request from a service being routed through the proxy. In the control plane, The post Service Mesh Wars with William Morgan appeared first on Software Engineering Daily....

Digital Transformation: Capital One with Hillary McTigue
Cloud computing, open source, and mobile computing are trends that affect every organization. When a large organization adapts to these trends, it is commonly referred to as a “digital transformation”. Digital transformation causes many companies to reframe their business as a software company. A candy manufacturer now must think of itself as a software company The post Digital Transformation: Capital One with Hillary McTigue appeared first on Software Engineering Daily....

Netflix Early Days with Greg Burrell
Netflix started with a DVD-by-mail product. The software infrastructure and operations practices needed for the DVD business were very different from those needed by a streaming video company. Since the early days of Netflix, CEO Reed Hastings knew that the company would evolve to becoming a streaming video platform. But he did not know when The post Netflix Early Days with Greg Burrell appeared first on Software Engineering Daily....


Augmented Reality Gaming with Tony Godar
Augmented reality applications can be used on smartphones and dedicated AR headsets. On smartphones, ARCore (Google) and ARKit (Apple) allow developers to build for the camera on a user’s smartphone. AR headsets such as Microsoft HoloLens and Magic Leap allow for a futuristic augmented reality headset experience. The most prominent use of augmented reality today The post Augmented Reality Gaming with Tony Godar appeared first on Software Engineering Daily....

CamelCamelCamel: Amazon Price Tracker with Daniel Green
CamelCamelCamel is a tool for tracking prices on items on Amazon.com. The company was launched eleven years ago and is built off of the Amazon Product Advertising API. Daniel Green is one of the founders of CamelCamelCamel, and he joins the show to describe his experience building the product. Amazon and CamelCamelCamel (C3) have a The post CamelCamelCamel: Amazon Price Tracker with Daniel Green appeared first on Software Engineering Daily....

Gaming with Eli Brown
Gaming is becoming mainstream. Popular multiplayer games such as Fortnite and Minecraft present players with a massive virtual world to explore, build, and compete within. Turn-based games such as Hearthstone and Magic are breeding a new generation of board game and card game aficionados. Social media networks like Twitch and YouTube have turned gaming into The post Gaming with Eli Brown appeared first on Software Engineering Daily....


Monolithic Repositories with Ciera Jaspan
Google’s codebase is managed in a single monolithic repository. An engineer at Google can explore almost any area of the codebase within the entire company. In order to enable this, Google has built tooling to support the monolithic repo, including a virtual file system and a set of build tools. A monolithic repository is not The post Monolithic Repositories with Ciera Jaspan appeared first on Software Engineering Daily....

Scaling Intuit with Alex Balazs
Alex Balazs is the Intuit Chief Architect and has been working at the company for almost twenty years. Intuit’s products include QuickBooks, TurboTax, and Mint. These applications are used to file taxes, manage business invoices, conduct personal accounting, and other critical aspects of a user’s financial life. Because the applications are managing money for users, The post Scaling Intuit with Alex Balazs appeared first on Software Engineering Daily....

Emerging Markets: Kenya with Nelly Cheboi
Africa is rapidly adopting the same software and hardware technologies that have transformed the western world over the last few decades. But access to computers and technology education is still uneven. Where there is access to computers, smartphone adoption often comes before access to laptops or desktop computers. Nelly Cheboi is the founder of TechLit The post Emerging Markets: Kenya with Nelly Cheboi appeared first on Software Engineering Daily....


Facebook Strategy with Mike Vernal
Facebook’s strategy is shaped by long term goals, short term requirements, and the available resources of the company. Long term goals are necessary for thinking through big decisions such as acquisitions, hardware product investments, and open source software ecosystems. To implement long term goals, Facebook needs to communicate the vision of the company and foster The post Facebook Strategy with Mike Vernal appeared first on Software Engineering Daily....

Facebook React with Dan Abramov
React is a set of open source tools for building user interfaces. React was open sourced by Facebook, and includes libraries for creating interfaces on the web (ReactJS) and on mobile devices (React Native). React was released during a time when there was not a dominant frontend JavaScript library. Backbone, Angular, and other JavaScript frameworks The post Facebook React with Dan Abramov appeared first on Software Engineering Daily....

Facebook Management with Jocelyn Goldfein
Facebook engineering is designed to self-assemble. When an engineer joins Facebook, the engineer goes through boot camp, where they are exposed to multiple projects to find a good fit in terms of technical skills and personal preferences. Since there are so many different initiatives within the company at any given moment, a new hire can The post Facebook Management with Jocelyn Goldfein appeared first on Software Engineering Daily....


Facebook Developers with Nick Schrock
When Facebook was scaling in its early years, the company developed engineering practices that were unlike any other organization before it. Early Facebook engineering developed unusual practices because the problem set was unusual. Facebook was a highly detailed, highly interactive, multi-user web application. Facebook was pushing the limits of PHP and JavaScript in a time The post Facebook Developers with Nick Schrock appeared first on Software Engineering Daily....

Facebook Engineering with Pete Hunt
Facebook engineering is commonly described by two words: move fast. Building products quickly has been a differentiating characteristic of the company since its inception. From the longtime engineers to the summer interns, Facebook instills a sense of immediacy and opportunity in all of its employees. The goal of Facebook is to make the world more The post Facebook Engineering with Pete Hunt appeared first on Software Engineering Daily....

Airtable with Howie Liu
Software engineering is harder than it should be. There are many people who have an app idea that they are not sure how to build. Some of these people are highly technical professionals like real estate agents, scientists, and accountants. These professionals learn to use spreadsheets in their day-to-day work. Spreadsheets are also used widely The post Airtable with Howie Liu appeared first on Software Engineering Daily....


Virtual Data with Sunil Kamath
Relational data systems have evolved from single node instances to complex distributed systems. Almost any database can be accessed through a SQL statement, but the guarantees of these databases can vary in terms of consistency, availability, latency, durability, and financial cost. Relational database systems that explore these different sets of tradeoffs are sometimes categorized as The post Virtual Data with Sunil Kamath appeared first on Software Engineering Daily....

Web Assembly Runtime with Tyler McMullen
WebAssembly is a binary instruction format for applications to run in a memory-constrained, stack-based virtual machine. The WebAssembly ecosystem consists of tools and projects that allow programs in a variety of languages to compile into WebAssembly and run in a safe, fast, sandboxed runtime environment. WebAssembly is a transformative technology for the Internet. Most users The post Web Assembly Runtime with Tyler McMullen appeared first on Software Engineering Daily....

Kubernetes Virtualization with Paul Czarkowski
Modern server infrastructure usually runs in a virtualized environment. Virtual servers can exist inside of a container or inside of a virtual machine. Containers can also run on virtual machines. Kubernetes has allowed developers to manage their multiple containers, whether those containers are running in VMs or on bare metal (servers without VMs). As organizations The post Kubernetes Virtualization with Paul Czarkowski appeared first on Software Engineering Daily....


Cloud Database Workloads with Jon Daniel
Relational databases such as Postgres are often used for critical workloads, such as user account data. To run a relational database service in the cloud requires a cloud provider to set up a highly durable, highly available system. Jon Daniel is an infrastructure engineer at Heroku. Jon joins the show to describe the engineering and The post Cloud Database Workloads with Jon Daniel appeared first on Software Engineering Daily....

Satellite Data Platform with Tim Kelton
Satellite images contain vast quantities of data. By analyzing the contents of satellite images over time, we can identify trends in weather, soil, and agriculture. If we combine that data with ground-level sensors, we can gather a clearer understanding of how chemicals in the air or in the dirt map to how things look from The post Satellite Data Platform with Tim Kelton appeared first on Software Engineering Daily....

Security Monitoring with Jeff Williams
The modern software supply chain contains many different points of distribution: JavaScript frameworks, npm modules, Docker containers, open source repositories, cloud providers, on-prem firmware, IoT, networking proxies, and so much more. With so much attack surface, securing a large enterprise is an uphill battle. Jeff Williams is the CTO at Contrast Security, a company that The post Security Monitoring with Jeff Williams appeared first on Software Engineering Daily....


Software Growth with Greg Kogan
Growing a software business requires an understanding of engineering, sales, and marketing. As we learn software engineering, we also pick up some knowledge about how a business should operate. We know that there are customers, and that our product needs to be scalable to serve more customers. We know that some features are more important The post Software Growth with Greg Kogan appeared first on Software Engineering Daily....

Container Platform Security with Maya Kaczorowski
A Kubernetes instance occupies a wide footprint of multiple servers, creating an appealing target to an attacker, due to its access to a large pool of compute resources. A common attack against an exposed Kubernetes cluster is to take it over for the purposes of mining cryptocurrency. Thus it is important to keep a cluster The post Container Platform Security with Maya Kaczorowski appeared first on Software Engineering Daily....

Lyft’s Data Platform with Li Gao
FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the most helpful The post Lyft’s Data Platform with Li Gao appeared first on Software Engineering Daily....


Cloud with Eric Brewer
RECENT UPDATES: FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the The post Cloud with Eric Brewer appeared first on Software Engineering Daily....

Intricately: Mapping the Internet with Fima Leshinsky
RECENT UPDATES: FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the The post Intricately: Mapping the Internet with Fima Leshinsky appeared first on Software Engineering Daily....

gVisor: Secure Container Sandbox with Yoshi Tamura
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a The post gVisor: Secure Container Sandbox with Yoshi Tamura appeared first on Software Engineering Daily....


Observability Engineering with James Burns
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a The post Observability Engineering with James Burns appeared first on Software Engineering Daily....

Serverless Runtimes with Steren Giannini
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a The post Serverless Runtimes with Steren Giannini appeared first on Software Engineering Daily....

Products with Ryan Hoover
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Products with Ryan Hoover appeared first on Software Engineering Daily....


Facebook OSS License Policy with Joel Marcey, Michael Cheng, and Kathy Kam
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Facebook OSS License Policy with Joel Marcey, Michael Cheng, and Kathy Kam appeared first on Software Engineering Daily....

Drishti: Deep Learning for Manufacturing with Krish Chaudhury
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Drishti: Deep Learning for Manufacturing with Krish Chaudhury appeared first on Software Engineering Daily....

Lyft Data Discovery with Tao Feng and Mark Grover
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Lyft Data Discovery with Tao Feng and Mark Grover appeared first on Software Engineering Daily....


Protein Structure Deep Learning with Mohammed Al Quraishi
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Protein Structure Deep Learning with Mohammed Al Quraishi appeared first on Software Engineering Daily....

Podsheets: Open Source Podcasting
Podsheets is a set of open source tools for podcast hosting, publishing, ad management, community engagement, and more. Podsheets is influenced by our experience managing Software Engineering Daily, a full-time podcast business. Software Engineering Daily is a podcast that airs 5 times per week. With 4 ads per show and 50 business weeks per year, we The post Podsheets: Open Source Podcasting appeared first on Software Engineering Daily....

Bubbles with Haseeb Qureshi
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Haseeb Qureshi is an entrepreneur and investor. As a teenager, Haseeb played poker professionally through the online poker bubble. His The post Bubbles with Haseeb Qureshi appeared first on Software Engineering Daily....


Consul Service Mesh with Paul Banks
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Consul is a tool from HashiCorp that allows users to store and retrieve information from a highly available key/value data The post Consul Service Mesh with Paul Banks appeared first on Software Engineering Daily....

Machine Learning Joins with Arun Kumar
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Data sets can be modeled in a row-wise, relational format. When two data sets share a common field, those data The post Machine Learning Joins with Arun Kumar appeared first on Software Engineering Daily....

Streaming with Holden Karau
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Distributed stream processing allows developers to build applications on top of large sets of data that are being rapidly created. The post Streaming with Holden Karau appeared first on Software Engineering Daily....


AWS Storage with Kevin Miller
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more   A software application requires compute and storage. Both compute and storage have been abstracted into cloud tools that can The post AWS Storage with Kevin Miller appeared first on Software Engineering Daily....

AWS Compute with Deepak Singh
Upcoming event: FindCollabs Hackathon at App Academy on April 6, 2019 On Amazon Web Services, there are many ways to run an application on a single node. The first compute option on AWS was the EC2 virtual server instance. But EC2 is a large abstraction compared to what many people need for their nodes–which is The post AWS Compute with Deepak Singh appeared first on Software Engineering Daily....

Data with Ben Lorica
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Ben Lorica is the chief data scientist at O’Reilly Media and the program director of the Strata Data Conference. In his work, Ben spends time with people across the software industry, giving him The post Data with Ben Lorica appeared first on Software Engineering Daily....


Stablecoins with Rune Christensen
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 A currency can fulfill numerous financial use cases. One use case is store of value: currency holders can reliably expect their currency to maintain some value, though that value may fluctuate over time. The post Stablecoins with Rune Christensen appeared first on Software Engineering Daily....

Operational Analytics with Jad Naous
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Jad Naous is an investing partner with Andreessen Horowitz, where he focuses on infrastructure and analytics. Eight years ago, Andreessen Horowitz (a16z) laid out their thesis that every company was becoming a software The post Operational Analytics with Jad Naous appeared first on Software Engineering Daily....

Blitzscaling with Chris Yeh
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Chris Yeh is an entrepreneur, investor, and author. He co-wrote Blitzscaling with LinkedIn founder Reid Hoffman.   Blitzscaling is a strategy for growing a company that has found product market fit. Blitzscaling prioritizes speed The post Blitzscaling with Chris Yeh appeared first on Software Engineering Daily....


Uber Infrastructure with Prashant Varanasi and Akshay Shah
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Uber’s infrastructure supports millions of riders and billions of dollars in transactions. Uber has high throughput and high availability requirements, because users depend on the service for their day-to-day transportation. When Uber was The post Uber Infrastructure with Prashant Varanasi and Akshay Shah appeared first on Software Engineering Daily....

Workload Scheduling with Brian Grant
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Google has been building large-scale scheduling systems for more than fifteen years. Google Borg was started around 2003, giving engineers at Google a unified platform to issue long-lived service workloads as well as The post Workload Scheduling with Brian Grant appeared first on Software Engineering Daily....

Peloton: Uber’s Cluster Scheduler with Min Cai and Mayank Bansal
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Google’s Borg system is a cluster manager that powers the applications running across Google’s massive infrastructure. Borg provided inspiration for open source tools like Apache Mesos and Kubernetes. Over the last decade, some The post Peloton: Uber’s Cluster Scheduler with Min Cai and Mayank Bansal appeared first on Software Engineering Daily....


Scaling Log Management with Renaud Boutet
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Log management requires the processing and indexing of high volumes of semi-structured data. A log management service takes log data and puts it in a cloud-hosted application so that application operators can access The post Scaling Log Management with Renaud Boutet appeared first on Software Engineering Daily....

Security Businesses with Steve Herrod
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Steve Herrod was the CTO at VMware and now works as a managing director at General Catalyst, where he focuses on investments relating to security. Large enterprises are difficult to secure. An enterprise The post Security Businesses with Steve Herrod appeared first on Software Engineering Daily....

CodeSandbox: Online Code Editor with Bas Buursma and Ives van Hoorne
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Coding in the browser has been attempted several times in the last decade. Building a development environment in the browser has numerous technical challenges. How does the code execute safely? How do you The post CodeSandbox: Online Code Editor with Bas Buursma and Ives van Hoorne appeared first on Software Engineering Daily....


Apache Superset with Maxime Beauchemin
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Data engineering touches every area of an organization. Engineers need a data platform to build search indexes and microservices. Data scientists need data pipelines to build machine learning models. Business analysts need flexible The post Apache Superset with Maxime Beauchemin appeared first on Software Engineering Daily....

FaunaDB with Evan Weaver
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Twitter’s early engineers faced scalability problems that caused infrastructure failures on a regular basis. The infamous “fail whale” could happen as a result of problems in the application servers, the network, or the The post FaunaDB with Evan Weaver appeared first on Software Engineering Daily....

ElasticSearch at Scale with Volkan Yazici
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Bol.com is the biggest e-commerce company in the Netherlands and Belgium. For 20 years, Bol has been developing its software architecture, which includes a variety of services and databases, and a mix of The post ElasticSearch at Scale with Volkan Yazici appeared first on Software Engineering Daily....


Serverless GraphQL with Tanmai Gopal
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Modern web development tools have given frontend developers more power. On the frontend, JavaScript frameworks like React and Vue have become easier to work with. For deployment, tools like Netlify and Zeit give The post Serverless GraphQL with Tanmai Gopal appeared first on Software Engineering Daily....

OSS Businesses with Mike Volpi
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Red Hat was the first commercial open source software company. For years, investors and entrepreneurs assumed there would never be another Red Hat. Red Hat’s business was built around enterprise operating system distribution The post OSS Businesses with Mike Volpi appeared first on Software Engineering Daily....

Crypto Bubble with Haseeb Qureshi
This is a post written and narrated by Haseeb Qureshi, a cryptocurrency investor and entrepreneur. Haseeb is speaking at an upcoming Software Engineering Daily Meetup. We can safely say the ICO bubble is over now. When the bubble finally popped last year, the “market cap” of all crypto fell over $700B, an 85% drop from The post Crypto Bubble with Haseeb Qureshi appeared first on Software Engineering Daily....


GitLab with Sid Sijbrandij
GitLab is an open source platform for software development. GitLab started with the ability to manage git repositories and now has functionality for collaboration, issue tracking, continuous integration, logging, and tracing. GitLab’s core business is selling to enterprises who want a self-hosted git installation, such as banks or other companies who prefer not to use The post GitLab with Sid Sijbrandij appeared first on Software Engineering Daily....

Linux Kernel Development with Shuah Khan
An operating system kernel manages the system resources that are needed to run applications. The Linux kernel runs most of the smart devices that we interact with, and is the largest open source project in history. Shuah Khan has worked on operating systems for two decades, including 13 years at HP and 5 years at The post Linux Kernel Development with Shuah Khan appeared first on Software Engineering Daily....

Cryptojacking: Bitcoin Malware with Estaban Vargas
Malware is malicious software that makes money for the creator of that software. Malware can appear onto a user’s computer if that user visits a malicious website or installs malicious software by accident. There are many types of malware. Spyware sits on your machine and logs your data in order to sell it. Ransomware can The post Cryptojacking: Bitcoin Malware with Estaban Vargas appeared first on Software Engineering Daily....


Ad Fraud Engineering with Praneet Sharma and Shailin Dhar
Advertising fraud occurs when a brand pays for an advertisement online and that advertisement is shown to an automated bot account that has been created to view ads. Advertising fraud is rampant on the Internet. It’s not possible to know how much money is lost to ad fraud, but the costs are in the billions The post Ad Fraud Engineering with Praneet Sharma and Shailin Dhar appeared first on Software Engineering Daily....

Energy Market Machine Learning with Minh Dang and Corey Noone
The demand for electricity is based on the consumption of the electrical grid at a given time. The supply of electricity is based on how much energy is being produced or stored on the grid at a given time. Because these sources of supply and demand fluctuate rapidly but predictably, energy markets present profit opportunities The post Energy Market Machine Learning with Minh Dang and Corey Noone appeared first on Software Engineering Daily....

Netlify with Mathias Biilmann Christensen
Cloud computing started to become popular in 2006 with the release of Amazon EC2, a system for deploying applications to virtual machines sitting on remote data center infrastructure . With cloud computing, application developers no longer needed to purchase expensive server hardware. Creating an application for the Internet became easier, cheaper, and simpler. As the The post Netlify with Mathias Biilmann Christensen appeared first on Software Engineering Daily....


LinkedIn Monitoring Infrastructure with Alexander Pucher
Monitoring tools are used by every area of an organization. Business development teams use monitoring to understand the metrics for product performance. Finance teams need to understand how the costs of cloud computing resources are changing. Site reliability engineers use monitoring dashboards that applications are up and running without problematic latency. Product managers evaluate the The post LinkedIn Monitoring Infrastructure with Alexander Pucher appeared first on Software Engineering Daily....

WebAssembly Execution with Syrus Akbary
WebAssembly is a runtime that lets languages beyond JavaScript to execute in frontend web applications. WebAssembly is novel because most modern frontend applications are written entirely in JavaScript. WebAssembly lets us use languages like Rust and C++ after they have been compiled down to a web assembly binary module. Language interoperability is only one part The post WebAssembly Execution with Syrus Akbary appeared first on Software Engineering Daily....

Ethereum Usability with Sean Li
Cryptocurrencies enable a large number of applications. Trustless reputation systems, decentralized identity tools, micropayments, non-fungible Internet items, borderless currencies, just to name a few. But cryptocurrencies have not yet impacted daily life, for most of us. Why is that? One reason is that it is still very hard for developers to build within the cryptocurrency The post Ethereum Usability with Sean Li appeared first on Software Engineering Daily....


StarkWare: Transparent Computational Integrity with Eli Ben Sasson
Computational integrity is a property that is required for financial transactions on the Internet. Computational integrity means that the output of a certain computation is correct. If I deposit money into my bank, my bank sends me a number that represents the new balance in my account. I assume that the number they have sent The post StarkWare: Transparent Computational Integrity with Eli Ben Sasson appeared first on Software Engineering Daily....

FindCollabs
Collaboration on the Internet creates innovation. New inventions, new art, and new products–built by people working together on the Internet. FindCollabs is a product we have been working on to enable people to find and collaborate with each other. If you want to try it out, you can go to FindCollabs.com. FindCollabs is for finding The post FindCollabs appeared first on Software Engineering Daily....

Internet History (and Future) with Brian McCullough
The Internet has transformed humanity. The Internet is the result of a long series of innovations from military, academia, business, and the open source community. In his book, How The Internet Happened: From Netscape to the iPhone, Brian McCullough tells the story of the last 25 years of Internet development through the lens of companies The post Internet History (and Future) with Brian McCullough appeared first on Software Engineering Daily....


Ad Fraud Economics with Craig Silverman
Advertising fraud steals billions of dollars every year. BuzzFeed reporter Craig Silverman reports on advertising fraud and its impact on the Internet. In one investigation, Craig uncovered a mobile advertising fraud scheme in which four people stole millions of dollars (perhaps as much as $75 million or even $750 million) by serving advertisements to automated The post Ad Fraud Economics with Craig Silverman appeared first on Software Engineering Daily....

Fake Podcast Charts with Jack Rhysider
Podcast listeners usually find out about a new podcast in one of two ways: either a friend recommends that podcast or the Apple podcast charts rank that new podcast highly. The Apple podcast charts are created using an algorithm that is not public. Many people believe that the chart ranking of a podcast is based The post Fake Podcast Charts with Jack Rhysider appeared first on Software Engineering Daily....

AWS Internet of Things with Dirk Didascalou
Many devices in our world are not “smart.” Air conditioners, electric guitars, power outlets, and factory conveyor belts, just to name a few. There are exciting software applications that we could build around these devices, but we need to be able to interface with them programmatically. We need to be able to know the state The post AWS Internet of Things with Dirk Didascalou appeared first on Software Engineering Daily....


Edge Computing Open Source with Arpit Joshipura
Edge computing refers to computation involving drones, connected cars, smart factories, or IoT sensors. Any software deployment that is not a large centralized server installation could qualify as an edge device–even a smartphone. Today, much of our heavy computation takes place in the cloud–a set of remote data centers some distance away from our client The post Edge Computing Open Source with Arpit Joshipura appeared first on Software Engineering Daily....

React Native Rearchitecture with G2i Team
React Native allows developers to build native applications for iOS and Android using components written in the React JavaScript framework. These ReactJS components render to native application code by going over a JavaScript bridge, a message bus that communicates between JavaScript code and native iOS or Android runtimes. For most mobile application use cases, React The post React Native Rearchitecture with G2i Team appeared first on Software Engineering Daily....

PlanetScale: Sharded Database Management with Jiten Vaidya and Dan Kozlowski
In the early days of YouTube, there were scalability problems with the MySQL database that hosted the data model for all of YouTube’s videos. The state of the art solution to scaling MySQL at the time was known as “application-level sharding.” To scale a database using application-level sharding, you break up the database into shards–disjoint The post PlanetScale: Sharded Database Management with Jiten Vaidya and Dan Kozlowski appeared first on Software Engineering Daily....


Zoox Self-Driving with Ethan Dreyfuss
Zoox is a full-stack self-driving car company. Zoox engineers work on everything a self-driving car company needs, from the physical car itself to the algorithms running on the car to the ride hailing system which the company plans to use to drive around riders. Since starting in 2014, Zoox has grown to over 500 employees. The post Zoox Self-Driving with Ethan Dreyfuss appeared first on Software Engineering Daily....

Store2Vec: DoorDash Recommendations with Mitchell Koch
DoorDash is a food delivery company where users find restaurants to order from. When a user opens the DoorDash app, the user can search for types of food or specific restaurants from the search bar or they can scroll through the feed section and look at recommendations that the app gives them within their local The post Store2Vec: DoorDash Recommendations with Mitchell Koch appeared first on Software Engineering Daily....

Policy Enforcement with Shimon Tolts
The nature of software projects is changing. Projects are using a wider variety of cloud providers and SaaS tools. Projects are being broken up into more git repositories, and the code in those repositories are being deployed into small microservices. With the increased number of tools, repositories, and deployment targets, it can become difficult to The post Policy Enforcement with Shimon Tolts appeared first on Software Engineering Daily....


Ethsimple: Ethereum Tools with Brian Soule
Ethereum allows developers to run decentralized applications. But the tooling for building and managing those decentralized applications is immature. Experienced software engineers have difficulty getting started with writing Ethereum applications because the stack of tools is so unfamiliar and different than traditional software tools. Whether or not Ethereum itself succeeds, developers in the future will The post Ethsimple: Ethereum Tools with Brian Soule appeared first on Software Engineering Daily....

Kubernetes Security with Liz Rice
A Kubernetes cluster presents multiple potential attack surfaces: the cluster itself, a node running on the cluster, a pod running in the node, a container running in a pod. If you are managing your own Kubernetes cluster, you need to be aware of the security settings on your etcd, your API server, and your container The post Kubernetes Security with Liz Rice appeared first on Software Engineering Daily....

Replicated: On-Prem Deployments with Grant Miller
Cloud computing has been popular for less than twenty years. Large software companies have existed for much longer. If your company was started before the cloud became popular, you probably have a large, data center on your companies premises. The shorthand term for this software environment is “on-prem”. Deploying software to your own on-prem servers The post Replicated: On-Prem Deployments with Grant Miller appeared first on Software Engineering Daily....


Uber’s Monitoring Platform with Rob Skillington
Uber manages the car rides for millions of people. The Uber system must remain operational 24/7, and the app involves financial transactions and the safety of passengers. Uber infrastructure runs across thousands of server instances and produce terabytes of monitoring data. The monitoring data is used to understand the health of the software systems as The post Uber’s Monitoring Platform with Rob Skillington appeared first on Software Engineering Daily....

Pachyderm: Data Pipelines with Joe Doliner
Data infrastructure is advancing beyond the days of Hadoop MapReduce, single-node databases, and nightly reporting. Companies are adopting modern data warehouses, streaming data systems, and cloud-specific data tools like BigQuery. Every company with a large amount of data wants to aggregate that data into a data lake and make the data available to developers. All The post Pachyderm: Data Pipelines with Joe Doliner appeared first on Software Engineering Daily....

Knative: Serverless Workloads with Ville Aikas
Infrastructure software is having a renaissance. Cloud providers offer a wide range of deployment tools, including virtual machines, managed Kubernetes clusters, standalone container instances, and serverless functions. Kubernetes has standardized the container orchestration layer and created a thriving community. The Kubernetes community gives the cloud providers a neutral ground to collaborate on projects that benefit The post Knative: Serverless Workloads with Ville Aikas appeared first on Software Engin...


VMware Kubernetes Strategy with Brad Meiseles
Virtualization software allows companies to get better utilization from their physical servers. A single physical host can manage multiple virtual machines using a hypervisor. VMware brought virtualization software to market, creating popular tools for allowing enterprises to deploy virtual machines throughout their organization. Containers provide another improvement to server utilization. A virtual machine can be The post VMware Kubernetes Strategy with Brad Meiseles appeared first on Software Engineering...

Cadre: Automated Investing with Leonid Movsesyan
Real estate is an asset that is not straightforward to invest in. Real estate can generate excellent returns for investors, but can require much more time and expertise than stocks. Cadre is a company that allows users to invest in real estate more easily and intelligently. Cadre provides users with lots of data about potential The post Cadre: Automated Investing with Leonid Movsesyan appeared first on Software Engineering Daily....

RocksDB with Dhruba Borthakur and Igor Canadi
RocksDB is a storage engine based on the log-structured merge tree data structure. RocksDB was developed at Facebook to provide a tool for embedded databases. The code for RocksDB is a fork of LevelDB, an embedded database built by Google for the Chrome browser. Every database has a storage engine. The storage engine is the The post RocksDB with Dhruba Borthakur and Igor Canadi appeared first on Software Engineering Daily....


Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto
HashiCorp was founded seven years ago with the goal of building infrastructure tools for automating cloud workflows such as provisioning, secret management, and service discovery. Hashicorp’s thesis was that operating cloud infrastructure was too hard: there was a need for new tools to serve application developers. Hashicorp founders Mitchell Hashimoto and Armon Dadgar began releasing The post Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto appeared first on Software Engineering Daily....

Engineering Philosophy with Tyler Cowen
Tyler Cowen’s book Stubborn Attachments outlines a framework that individuals can use to make decisions grounded in economic philosophy. In his previous books, Tyler examined recent economic history. Stubborn Attachments gives his perspective for navigating the future. Tyler is a professor of economics at George Mason University. He is also the host of Conversations with The post Engineering Philosophy with Tyler Cowen appeared first on Software Engineering Daily....

Architects of Intelligence with Martin Ford
Artificial intelligence is reshaping every aspect of our lives, from transportation to agriculture to dating. Someday, we may even create a superintelligence–a computer system that is demonstrably smarter than humans. But there is widespread disagreement on how soon we could build a superintelligence. There is not even a broad consensus on how we can define The post Architects of Intelligence with Martin Ford appeared first on Software Engineering Daily....


Anatomy of Next: New World with Mike Solana
Mars is a cold, inhospitable planet far from earth. It presents one of the most complex challenges faced by engineers: how can we create a new world? To create a new world, first we have to get there. We can build new rockets with improved propulsion systems. We can build ships that allow us to The post Anatomy of Next: New World with Mike Solana appeared first on Software Engineering Daily....

Likewar: The Weaponization of Social Media with P.W. Singer
Social media has transformed our lives. It has also transformed how wars are fought. P.W. Singer’s new book “Likewar: The Weaponization of Social Media” describes the far-reaching impact of social media on the tactics and strategies used by military, business, and everyday citizens. We have all read about stories such as Russian bots and Cambridge The post Likewar: The Weaponization of Social Media with P.W. Singer appeared first on Software Engineering Daily....

Software Chasms with Martin Casado
Infrastructure software can be a great business. An infrastructure software company sells core technology to a large enterprise such as a bank or insurance company. This software has near zero marginal cost and generates a large annuity for the infrastructure software company. Once a bank has purchased your infrastructure software, the bank is likely to The post Software Chasms with Martin Casado appeared first on Software Engineering Daily....


Kubeflow: TensorFlow on Kubernetes with David Aronchick
When TensorFlow came out of Google, the machine learning community converged around it. TensorFlow is a framework for building machine learning models, but the lifecycle of a machine learning model has a scope that is bigger than just creating a model. Machine learning developers also need to have a testing and deployment process for continuous The post Kubeflow: TensorFlow on Kubernetes with David Aronchick appeared first on Software Engineering Daily....

TiDB: Distributed NewSQL with Kevin Xu
When a user interacts with an application to order a ride with a ridesharing app, the data for that user interaction is written to a “transactional” database. A transactional database is a database where specific rows need to be written to and read from quickly and consistently. Speed and consistency are important for applications like The post TiDB: Distributed NewSQL with Kevin Xu appeared first on Software Engineering Daily....

Storybook: UI Engineering with Zoltan Olah
React, Vue, and Angular are the most popular frontend JavaScript frameworks. Each of these frameworks lets frontend developers build components. A component is a high level visual abstraction that is used to compose a user interface. Frontend development has moved towards component-driven-development. At a typical technology company, a designer will put together a design file The post Storybook: UI Engineering with Zoltan Olah appeared first on Software Engineering Daily....


RSocket: Reactive Streaming Service Networking with Ryland Degnan
Netflix has thousands of service instances communicating with each other. When a Netflix client on a smartphone makes a request for a movie, that request hits Netflix’s backend, where the request is fulfilled by a chain of requests through different services. Services and clients communicate using several different interaction patterns. A service might send a The post RSocket: Reactive Streaming Service Networking with Ryland Degnan appeared first on Software Engineering Daily....

Prometheus Scalability with Bryan Boreham
Prometheus is an open source monitoring system and time series database. Prometheus includes a multi-dimensional data model, a query language called PromQL, and a pull model for gathering metrics from your different services. Prometheus is widely used by large distributed systems deployments such as Kubernetes and Cloud Foundry. Prometheus gathers metrics from your services by The post Prometheus Scalability with Bryan Boreham appeared first on Software Engineering Daily....

Spot Instances with Amiram Shachar
When a developer provisions a cloud server, that server is called an “instance”. These instances can be used for running whatever workload a developer has, whether it is a web application, a database, or a set of containers. The cloud is cheap to get started on. New applications with few users can often be hosted The post Spot Instances with Amiram Shachar appeared first on Software Engineering Daily....


Looker: Business Intelligence Platform with Daniel Mintz
If a business has been operating successfully for a few years, that business has accumulated a high volume of data. That data exists in spreadsheets, CSV files, log files, and balance sheets. Data might be spread across local files on a user’s laptop, databases in the cloud, or storage systems in an on-premise data center. The post Looker: Business Intelligence Platform with Daniel Mintz appeared first on Software Engineering Daily....

Human Sized Robots with Zach Allen
Robots are making their way into every area of our lives. Security robots roll around industrial parks at night, monitoring the area for intruders. Amazon robots tirelessly move packages around in warehouses, reducing the time and cost of logistics. Self-driving cars have become a ubiquitous presence in cities like San Francisco. For a hacker in The post Human Sized Robots with Zach Allen appeared first on Software Engineering Daily....

Notebooks at Netflix with Matthew Seal
Netflix has petabytes of data and thousands of workloads running across that data every day. These workloads generate movie recommendations for users, create dashboards for data analysts to study, and reshape data in ETL jobs, to make it more accessible across the organization. Over the last ten years, data engineering has become a key component The post Notebooks at Netflix with Matthew Seal appeared first on Software Engineering Daily....


Kubernetes in China with Dan Kohn
Chinese Internet companies operate at a massive scale. WeChat has over a billion users and is widely used as the primary means of payment by urban Chinese consumers. Alibaba ships 12 million packages per day, which is four times the amount of Amazon. JD.com, a Chinese ecommerce company, has perhaps the largest production Kubernetes installation The post Kubernetes in China with Dan Kohn appeared first on Software Engineering Daily....

AWS Analysis with Corey Quinn
Amazon Web Services changed how software engineers work. Before AWS, it was common for startups to purchase their own physical servers. AWS made server resources as accessible as an API request, and has gone on to create higher-level abstractions for building applications. For the first few years of AWS, the abstractions were familiar. S3 provided The post AWS Analysis with Corey Quinn appeared first on Software Engineering Daily....

Zeit: Serverless Cloud with Guillermo Rauch
Serverless computing is a technique for deploying applications without an addressable server. A serverless application is running on servers, but the developer does not have access to the server in the traditional sense. The developer is not dealing with IP addresses and configuring instances of their different services to be able to scale. Just as The post Zeit: Serverless Cloud with Guillermo Rauch appeared first on Software Engineering Daily....


Cloud Events with Doug Davis
Functions-as-a-service allow developers to run their code in a “serverless” environment. A developer can provide a function to a cloud provider and the code for that function will be scheduled onto a container and executed whenever an event triggers that function. An “event” can mean many different things. It is a signal that something has The post Cloud Events with Doug Davis appeared first on Software Engineering Daily....

Multicloud with Ben Hindman
Most applications today are either deployed to on-premise environments or deployed to a single cloud provider. Developers who are deploying on-prem struggle to set up complicated open source tools like Kafka and Hadoop. Developers who are deploying to a cloud provider tend to stay within that specific cloud provider, because moving between different clouds and The post Multicloud with Ben Hindman appeared first on Software Engineering Daily....

Stateful Kubernetes with Saad Ali
In a cloud infrastructure environment, failures happen regularly. The servers can fail, the network can fail, and software bugs can crash your software unexpectedly. The amount of failures that can occur in cloud infrastructure is one reason why storage is often separated from application logic. A developer can launch multiple instances of their application, with The post Stateful Kubernetes with Saad Ali appeared first on Software Engineering Daily....


Kong API Platform with Marco Palladino
When a user makes a request to product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, and logging. API gateways have grown in popularity as applications have become more distributed, The post Kong API Platform with Marco Palladino appeared first on Software Engineering Daily....

Ubiquity6: Augmented Reality Platform with Ankit Kumar
Augmented reality glasses will let us walk through a world where the digital blends together with the physical. 3-D objects will be rendered and superimposed onto our field of vision, creating an environment for people to build applications we can hardly dream of today. These augmented reality glasses are probably three to five years away The post Ubiquity6: Augmented Reality Platform with Ankit Kumar appeared first on Software Engineering Daily....

Crossplane: Multicloud Control Plane with Bassam Tabbara
Cloud providers created the ability for developers to easily deploy their applications to servers on data centers. In the early days of the cloud, most of the code that a developer wrote for their application could run on any cloud provider, whether it was Amazon, Google, or Microsoft. These cloud providers were giving developers the The post Crossplane: Multicloud Control Plane with Bassam Tabbara appeared first on Software Engineering Daily....


Word2Vec with Adrian Colyer Holiday Repeat
Originally posted on 13 September 2017. Machines understand the world through mathematical representations. In order to train a machine learning model, we need to describe everything in terms of numbers.  Images, words, and sounds are too abstract for a computer. But a series of numbers is a representation that we can all agree on, whether The post Word2Vec with Adrian Colyer Holiday Repeat appeared first on Software Engineering Daily....

Self-Driving Deep Learning with Lex Fridman Holiday Repeat
Originally posted on 28 July 2017. Self-driving cars are here. Fully autonomous systems like Waymo are being piloted in less complex circumstances. Human-in-the-loop systems like Tesla Autopilot navigate drivers when it is safe to do so, and lets the human take control in ambiguous circumstances. Computers are great at memorization, but not yet great at The post Self-Driving Deep Learning with Lex Fridman Holiday Repeat appeared first on Software Engineering Daily....

Technology Utopia with Michael Solana Holiday Repeat
Originally posted on 1 May 2018. Technology is pushing us rapidly toward a future that is impossible to forecast. We try to imagine what that future might look like, and we can’t help having our predictions shaped by the media we have consumed. 1984, Terminator, Gattaca, Ex Machina, Black Mirror–all of these stories present a The post Technology Utopia with Michael Solana Holiday Repeat appeared first on Software Engineering Daily....


Google Early Days with John Looney Holiday Repeat
Originally posted on 16 June 2017. John Looney spent more than 10 years at Google. He started with infrastructure, and was part of the team that migrated Google File System to Colossus, the successor to GFS. Imagine migrating every piece of data on Google from one distributed file system to another. In this episode, John The post Google Early Days with John Looney Holiday Repeat appeared first on Software Engineering Daily....

Service Proxying with Matt Klein Holiday Repeat
Originally posted on 14 February 2017. Most tech companies are moving toward a highly distributed microservices architecture. In this architecture, services are decoupled from each other and communicate with a common service language, often JSON over HTTP. This provides some standardization, but these companies are finding that more standardization would come in handy. At the The post Service Proxying with Matt Klein Holiday Repeat appeared first on Software Engineering Daily....

Rockset Data Platform with Venkat Venkataramani
At Facebook, Venkat Venkataramani saw how large volumes of data were changing software infrastructure. Applications such as logging servers and advertising were creating fast moving, semi-structured data. The user base was growing, the traffic was growing, and the volume of data was growing. And the popular methods for managing this data were insufficient for the The post Rockset Data Platform with Venkat Venkataramani appeared first on Software Engineering Daily....


Modern Front End: React, GraphQL, VR, WebAssembly with Adam Conrad
Ten years ago, there was a distinction between “backend” and “frontend” developers. A backend developer would be managing the business logic and database transactions using Ruby on Rails or Java. A frontend developer would be responsible for implementing designs and arranging buttons using raw HTML and JavaScript. Today, developers can build entire applications in JavaScript. The post Modern Front End: React, GraphQL, VR, WebAssembly with Adam Conrad appeared first on Software Engineering Daily....

Linkerd Service Mesh with William Morgan
Software products are distributed across more and more servers as they grow. With the proliferation of cloud providers like AWS, these large infrastructure deployments have become much easier to create. With the maturity of Kubernetes, these distributed applications are more reliable. Developers and operators can use a service mesh to manage the interactions between services The post Linkerd Service Mesh with William Morgan appeared first on Software Engineering Daily....

Market Strategy with Herb Cunitz
Market strategy defines how a company is positioning itself to be successful. This strategy encompasses engineering, sales, marketing, recruiting, and everything else within a company. Herb Cunitz has led teams at Hortonworks, VMware, SpringSource, and several other companies over his 30 year career in software. After working as president of Hortonworks, Herb started AccelG2M. AccelG2M The post Market Strategy with Herb Cunitz appeared first on Software Engineering Daily....


Mattermost: Self-Hosted Slack Alternative with Corey Hulen
Software companies today rely on group chat applications. The world of startups and small businesses is dominated by Slack. But for some large enterprises, regulatory constraints prevent them from using Slack. Slack is a web application that is hosted in the cloud, and regulated industries such as banking often need to run their applications on The post Mattermost: Self-Hosted Slack Alternative with Corey Hulen appeared first on Software Engineering Daily....

Full Stack JavaScript with Wes Bos
Wes Bos has created popular courses on React, GraphQL, and JavaScript. With hundreds of thousands of students, Wes has earned a cult following for his fun, practical lessons on web development. The courses produced by Wes teach developers how to build useful applications such as a complete e-commerce store. Wes has built a career around The post Full Stack JavaScript with Wes Bos appeared first on Software Engineering Daily....

Plaid: Banking API Platform with Jean-Denis Greze
A bank account is a platform for apps to be built on top of. If that sounds like a weird idea, think about the features of a bank account. Most users only have a single bank account, making it a tool for identity and authentication. The series of transactions in a bank account provides a The post Plaid: Banking API Platform with Jean-Denis Greze appeared first on Software Engineering Daily....


High Growth Handbook with Elad Gil
When a startup finds product market fit, the adoption of that product can grow rapidly, turning a startup into a high growth company. All of a sudden, a startup that was struggling to find its first customer is bombarded with new challenges. The startup has to hire tens of new employees. This requires raising capital, The post High Growth Handbook with Elad Gil appeared first on Software Engineering Daily....

Feature Flags with Edith Harbaugh
Releasing software has inherent risk. If your users don’t like your new feature, they might stop using your product immediately. If a software bug makes it into production, it can crash your entire application. Releasing software gradually has many benefits. A slow rollout to an increasing population of users allows you to test your software The post Feature Flags with Edith Harbaugh appeared first on Software Engineering Daily....

Serverless Research with Ion Stoica
The Berkeley AMPLab was a research lab where Apache Spark and Apache Mesos were both created. In the last five years, the Mesos and Spark projects have changed the way infrastructure is managed and improved the tools for data science. Because of its proximity to Silicon Valley, Berkeley has become a university where fundamental research The post Serverless Research with Ion Stoica appeared first on Software Engineering Daily....


Technical Investing with Sunil Dhaliwal
Robotics, genomics, and backend infrastructure: as an investor, it can be difficult to assess the viability of a startup that is on the cutting edge in any of these areas. A robotics startup requires a team with an integrated understanding of hardware and software. A genomics company will not only have to develop a successful The post Technical Investing with Sunil Dhaliwal appeared first on Software Engineering Daily....

RapidAPI: API Marketplace with Iddo Gino
Building software was simplified by cloud providers. With the cloud, it became much easier to deploy a server, spin up a database, and scale an application. Cloud providers like AWS gave developers access to these infrastructure primitives like storage and compute. On top of those primitives, numerous API companies have been built. An API company The post RapidAPI: API Marketplace with Iddo Gino appeared first on Software Engineering Daily....

Bitcoin Payment Channels with Alex Bosworth
The Bitcoin main chain is a large distributed ledger of transactions. Bitcoin is useful for maintaining a trusted record of payments, but is not practical for small day-to-day payments. Bitcoin payment channels allow users to issue small payments to each other without paying the high transaction cost and latency of going through the main chain. The post Bitcoin Payment Channels with Alex Bosworth appeared first on Software Engineering Daily....


Streaming Platform Architecture with Luca Mezzalira and Yan Cui
Demand for live streaming video over the internet is increasing. After the emergence of early live streaming platforms, like Twitch and Facebook Live, more forms of video have become accessible over live streams, such as sports. Live streaming is a harder engineering problem than delivering a static video file because the information distributed on a The post Streaming Platform Architecture with Luca Mezzalira and Yan Cui appeared first on Software Engineering Daily....

On-Prem Cloud with Bob Fraser
Not every company wants to move to the public cloud. Some companies have already built data centers, and can continue to operate their business with their own servers. Some companies have compliance issues with the public cloud, and want to operate their own servers to avoid legal risk. Operating a data center is not easy. The post On-Prem Cloud with Bob Fraser appeared first on Software Engineering Daily....

Anchor: Podcast Platform with Nir Zicherman
Podcasts have surged in popularity, but the podcast ecosystem remains difficult to work with. Podcast listeners have difficulty finding episodes. Podcast creators have difficulty finding out how to get started. The advertising marketplaces for podcasts are immature, and it can be difficult to build a business as a podcaster. Podcasting is unlike almost any other The post Anchor: Podcast Platform with Nir Zicherman appeared first on Software Engineering Daily....


Cloud Costs with Ran Rothschild
Cloud computing changed the economics of running a software company. Before the cloud, a software company had to purchase physical machines which often required thousands of dollars paid up front. The cloud allowed developers to deploy their applications for free, to operate a business for cheap, and to scale without hiring a dedicated team to The post Cloud Costs with Ran Rothschild appeared first on Software Engineering Daily....

Slack Messaging Architecture with Keith Adams
Slack is a real-time messaging system for work communication. On Slack, chat rooms as big as 100,000 people have productive conversations. This might sound like the same problem solved by social networks like Facebook, where billions of users communicate over a newsfeed. But the engineering constraints of a messaging system are different than that of The post Slack Messaging Architecture with Keith Adams appeared first on Software Engineering Daily....

Facet Wealth Engineering with Gorkem Sevinc
Many people have saved some money which they want to invest for the future. Some people are happy investing their money in a roboadviser, which programmatically puts money into long-term investments. Other people want a more personal approach involving a certified financial planner (CFP®). A CFP® is a human who allocates capital for an individual The post Facet Wealth Engineering with Gorkem Sevinc appeared first on Software Engineering Daily....


Parity: Blockchain Infrastructure with Gavin Wood
Parity is a company that builds blockchain infrastructure. Parity has built several open source projects and works with enterprises to put blockchain technology in production. Gavin Wood is the founder of Parity, and he joins the show to talk about the state of blockchain technology and what his company is currently focused on. Four years The post Parity: Blockchain Infrastructure with Gavin Wood appeared first on Software Engineering Daily....

Death and Distributed Systems with Pieter Hintjens Holiday Repeat
Originally posted on June 23, 2016. Pieter Hintjens grew up writing software by himself. The act of writing code brought him great pleasure, but the isolated creative process disconnected him from the rest of the world. As his life progressed he became involved in open source communities, and he discovered a passion for human interaction. The post Death and Distributed Systems with Pieter Hintjens Holiday Repeat appeared first on Software Engineering Daily....

Algorithms to Live By with Brian Christian Holiday Repeat
Originally posted on May 12, 2016. When you are deciding who to marry, you are using an algorithm. The same is true when you are looking for a parking space, playing a game of poker, or deciding whether or not to organize your closet. Algorithms To Live By is a book about the computer science The post Algorithms to Live By with Brian Christian Holiday Repeat appeared first on Software Engineering Daily....


Poker Artificial Intelligence with Noam Brown Holiday Repeat
Originally posted on May 12, 2015. Humans have now been defeated by computers at heads up no-limit holdem poker. Some people thought this wouldn’t be possible. Sure, we can teach a computer to beat a human at Go or Chess. Those games have a smaller decision space. There is no hidden information. There is no The post Poker Artificial Intelligence with Noam Brown Holiday Repeat appeared first on Software Engineering Daily....

Salary Negotiation with Haseeb Qureshi Holiday Repeat
Featured Image Photo Credits Originally posted on July 11, 2016. Negotiation is an important skill for software engineers. The salary you negotiate at the beginning of your job could be a difference of tens of thousands of dollars over the course of an engineer’s career, but intimidating recruiters and exploding offers scare many engineers from The post Salary Negotiation with Haseeb Qureshi Holiday Repeat appeared first on Software Engineering Daily....

Schedulers with Adrian Cockcroft Holiday Repeat
Originally published on July 6, 2016. Scheduling is the method by which work is assigned to resources to complete that work. At the operating system level, this can mean scheduling of threads and processes. At the data center level, this can mean scheduling Hadoop jobs or other workflows that require the orchestration of a network The post Schedulers with Adrian Cockcroft Holiday Repeat appeared first on Software Engineering Daily....


Reflow: Distributed Incremental Processing with Marius Eriksen
The volume of data in the world is always increasing. The costs of storing that data is always decreasing. And the means for processing that data is always evolving. Sensors, cameras, and other small computers gather large quantities of data from the physical world around us. User analytics tools gather information about how we are The post Reflow: Distributed Incremental Processing with Marius Eriksen appeared first on Software Engineering Daily....

Liquid Software with Baruch Sadogursky
The software release process is a barrier between written code and a live production environment that affects users. A software release process can involve a variety of different practices. Code might be tested for bugs using automation and manual testing. Static analysis tools can look at the code for potential memory leaks. A software release The post Liquid Software with Baruch Sadogursky appeared first on Software Engineering Daily....

SPIFFE: Zero Trust Workload Identification with Evan Gilman
Modern software consists of sprawling international networks of servers. Users contact these servers to access applications. Microservices talk to each other to fulfill complicated requests. Databases and machine learning frameworks crunch terabytes of information to provide complicated answers. Across this infrastructure, there is a lot of different activities–and a lot of vulnerabilities. Without a reliable The post SPIFFE: Zero Trust Workload Identification with Evan Gilman appeared first on Software Eng...


Fission: Serverless on Kubernetes with Soam Vasani
Serverless computing abstracts away the idea of a server node. Serverless lets programmers treat compute resources as high-level, reliable APIs, rather than unreliable, low-level compute nodes that might fail. Serverless dramatically improves the efficiency of programmers. Instead of thinking of a database as a set of servers that need to be sharded and replicated, the The post Fission: Serverless on Kubernetes with Soam Vasani appeared first on Software Engineering Daily....

Open Policy Agent with Torin Sandall
Policies define which users and applications can access and modify resources in a computer system. In a file system, a user might have permission to read or write to a file. In a cloud infrastructure deployment, a user might have the rights to deploy a new server. One microservice may or may not have the The post Open Policy Agent with Torin Sandall appeared first on Software Engineering Daily....

TLA+ with Leslie Lamport
TLA+ is a formal specification language. TLA+ is used to design, model, and verify concurrent systems. TLA+ allows a user to describe a system formally with simple, precise mathematics. TLA+ was designed by Leslie Lamport, a computer scientist and Turing Award winner. Leslie joins the show to talk about the purpose of TLA+. Since its The post TLA+ with Leslie Lamport appeared first on Software Engineering Daily....


Computer Vision with Peter Kontschieder
Mapillary is a company that processes high volumes of images to develop a labeled 3-D model of the physical world. Mapillary’s APIs allow developers to build applications that are aware of stop signs, buildings, streets, trees, and other physical objects in real-world space. The potential use cases for Mapillary are numerous, ranging from self-driving cars The post Computer Vision with Peter Kontschieder appeared first on Software Engineering Daily....

Computer Architecture with Dave Patterson
An instruction set defines a low level programming language for moving information throughout a computer. In the early 1970’s, the prevalent instruction set language used a large vocabulary of different instructions. One justification for a large instruction set was that it would give a programmer more freedom to express the logic of their programs. Many The post Computer Architecture with Dave Patterson appeared first on Software Engineering Daily....

OSS Capital with Joseph Jacks
Open source projects benefit from the network effects of a large audience of developers. A popular open source project will be contributed to and used by thousands of developers, who are continuously testing, deploying, and improving the software. The open source movement has created massive communities and a thriving, collaborative economy. Infrastructure software companies are The post OSS Capital with Joseph Jacks appeared first on Software Engineering Daily....


Commons Clause with Kevin Wang
Open source software powers everything we do on the Internet. Google runs on Linux servers. Content sites are served by WordPress. Our data is queued in Kafka clusters and stored in MongoDB instances. The success of an open source project often leads to the creator of that open source software becoming wealthy. An open source The post Commons Clause with Kevin Wang appeared first on Software Engineering Daily....

Scaling Lyft with Matt Klein
Matt Klein has worked for three rapidly growing Internet companies. At AWS, he worked on EC2, the compute-as-a-service product that powers a large percentage of the Internet. At Twitter, he helped scale the infrastructure in the chaotic days before Twitter’s IPO. Today he works at Lyft, building systems to allow for ride sharing infrastructure to The post Scaling Lyft with Matt Klein appeared first on Software Engineering Daily....

Wonolo: Staffing Marketplace with Jeremy Burton
Online labor marketplaces are widely used for one-to-one transactions. On Uber, a rider hires a driver for transportation. On TaskRabbit, a homeowner hires a cleaner to come clean their kitchen. These types of marketplaces are not as widely used for one-to-many transactions, but they can be just as useful. A warehouse owner would want to The post Wonolo: Staffing Marketplace with Jeremy Burton appeared first on Software Engineering Daily....


Diffbot: Knowledge Graph API with Mike Tung
Google Search allows humans to find and access information across the web. A human enters an unstructured query into the search box, the search engine provides several links as a result, and the human clicks on one of those links. That link brings up a web page, which is a set of unstructured data. Humans The post Diffbot: Knowledge Graph API with Mike Tung appeared first on Software Engineering Daily....

Drift: Sales Bot Engineering with David Cancel
David Cancel has started five companies, most recently Drift. Drift is a conversational marketing and sales platform. David has a depth of engineering skills and a breadth of business experience that make him an amazing source of knowledge. In today’s episode, David discusses topics ranging from the technical details of making a machine learning-driven sales The post Drift: Sales Bot Engineering with David Cancel appeared first on Software Engineering Daily....

Building a Hiring Process with Ammon Bartram
Engineers who start companies often find themselves building something they have no experience with: a hiring process. Hiring engineers today is not as systematic as building software. We don’t have lots of data that tells us what makes for an effective programming interview question. The smartest tech companies in the world are still making hiring The post Building a Hiring Process with Ammon Bartram appeared first on Software Engineering Daily....


Gig Economy
I like to write music, and a year ago I started working on an album called “Gig Economy”. The plan for the album was to hire musicians from gig economy platforms like Fiverr and Upwork to perform on songs that I produced. The album is finished and I’m happy with the result, so I’m sharing The post Gig Economy appeared first on Software Engineering Daily....

Blockchain Distribution Network with Aleksandar Kuzmanovic
Cryptocurrencies are not very usable today. The main use cases for cryptocurrencies today are store of value (somewhat like gold) and speculation. One reason that the use cases are so narrow is the problem of scalability. Cryptocurrencies have several scalability bottlenecks. Think about the Internet in 1994. The consumer sitting at home with a dial-up The post Blockchain Distribution Network with Aleksandar Kuzmanovic appeared first on Software Engineering Daily....

Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis
A smart security camera takes in a high volume of video images and processes those images using a set of machine learning models. Those models can be used to identify interesting snippets of movement throughout the day, and decide which of those snippets to keep. Some of the video snippets might contain movement of birds–but The post Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis appeared first on Software Engineering Daily....


JAM Stack with Phil Hawksworth
Engineers can build applications faster by using tools that abstract away infrastructure. Major cloud providers offer this tooling in the form of functions-as-a-service, as well as managed services such as Google BigQuery or Azure Container Instances. The term “serverless” refers to these functions-as-a-service and the managed services–because when you use these tools, you are not The post JAM Stack with Phil Hawksworth appeared first on Software Engineering Daily....

DevSecOps with Edward Thomson
DevSecOps emphasizes moving security out of a siloed audit process and distributing security practices throughout the software supply chain. In the past, software development usually followed a waterfall development process. Each step in building software was serialized, one after another. First, software was planned. Then it was built. Then it was tested. Finally, the software The post DevSecOps with Edward Thomson appeared first on Software Engineering Daily....

Google JavaScript with Malte Ubl
Google Search is a highly interactive JavaScript application. As you enter a query, results are being automatically suggested to you before you even finish typing. When you press enter, some of your search results may be widgets that represent the weather, the price of a stock, a recipe for green bean soup, or a language The post Google JavaScript with Malte Ubl appeared first on Software Engineering Daily....


AWS Containers with Deepak Singh
Deepak Singh is the director of compute services at AWS, where he works on cloud products relating to containers, Linux, and High Performance Computing. In today’s show, Deepak describes how the market for containers and serverless has evolved, and how Amazon thinks about product strategy. Back in 2014, Docker containers were becoming a popular way The post AWS Containers with Deepak Singh appeared first on Software Engineering Daily....

Open Source Product Strategy with Shaun Connolly
Linux has created much more value for Google than it has for Linus Torvalds. Ruby on Rails has created more value for Airbnb than it has for David Heinemeier Hansson. Successful open source projects create more value than their creators’ capture–and that’s one reason why collections of people on the Internet are often inspired to The post Open Source Product Strategy with Shaun Connolly appeared first on Software Engineering Daily....

Cloud Search with Liam Cavanagh
Search is part of almost every application. Users search for movies to watch. Engineers search through terabytes of log messages to find exceptions. Drivers search through maps to find a destination. Search remains an unsolved problem, with lots of room for optimization. Many search applications have been built Elasticsearch, an open source distributed search engine. The post Cloud Search with Liam Cavanagh appeared first on Software Engineering Daily....


Open vSwitch: Virtual Networking with Ben Pfaff
Virtual machines are operating system instances that run alongside each other on the same physical host. The virtual machines running on a physical host are managed by a hypervisor running on the physical host. A cluster of two physical servers could have four virtual machines running across those two physical instances. Those four virtual machines The post Open vSwitch: Virtual Networking with Ben Pfaff appeared first on Software Engineering Daily....

Data Warehouse with Christian Kleinerman
A data warehouse provides fast access to large data sets for analytics, data science, and dashboards. A data warehouse differs from a transactional database, because you often do not need to update specific records. Because of the read-only nature of the access patterns, and the high volumes of data being queried, the design of a The post Data Warehouse with Christian Kleinerman appeared first on Software Engineering Daily....

DevOps at Microsoft with Martin Woodward
The Windows operating system is one of the most widely used pieces of software in history. Windows was started before there was any alternative to a monolithic codebase, because Microsoft was building software before the Internet was widely used by consumers. Networked computers gave rise to web applications, and software engineers began to rethink how The post DevOps at Microsoft with Martin Woodward appeared first on Software Engineering Daily....


Generative Models with Doug Eck
Google Brain is an engineering team focused on deep learning research and applications. One growing area of interest within Google Brain is that of generative models. A generative model uses neural networks and a large data set to create new data similar to the ones that the network has seen before. One approach to making The post Generative Models with Doug Eck appeared first on Software Engineering Daily....

Mapillary: Computer Vision Crowdsourcing with Peter Neubauer
Mapillary is a platform for gathering photos taken by smartphones and using that data to build a 3D model of the world. Mapillary’s model of the world includes labeled objects such as traffic signs, trees, humans, and buildings. This 3D model can be explored much like you can explore Google Street view. The data set The post Mapillary: Computer Vision Crowdsourcing with Peter Neubauer appeared first on Software Engineering Daily....

Digital Privacy with Aran Khanna
When Aran Khanna was a college student, he accepted an internship to work at Facebook. Even before his internship started, he started playing around with Facebook’s APIs and applications. Aran built a Chrome extension called Marauder’s Map, which used Facebook Messenger’s web APIs to track where people lived, what their schedule was, and other highly The post Digital Privacy with Aran Khanna appeared first on Software Engineering Daily....


Airbnb Engineering with Surabhi Gupta
Airbnb began in 2008 as a monolithic Rails application serving the simple purpose of listing homes for rental. Over time, the number of listings increased dramatically, as did the number of people who were renting. With that scale, the Rails app had to be broken into different services, and entire teams were built out to The post Airbnb Engineering with Surabhi Gupta appeared first on Software Engineering Daily....

Monolith Migration with Jan Schiffman and Sherman Wood
We previously released this episode with the wrong audio file and are re-releasing it on a weekend. TIBCO was started in the 90’s with a popular message bus product that was widely used by finance companies, logistics providers, and other systems with high throughput. As TIBCO grew in popularity, the company expanded into other areas The post Monolith Migration with Jan Schiffman and Sherman Wood appeared first on Software Engineering Daily....

Scalyr: Column-Oriented Log Management with Steve Newman
Log messages are fast, high volume, unstructured data. Logs are often the source of metrics, alerts, and dashboards, so these critical systems are downstream from a log management system. A log management system needs to be highly available, so that a failure in one part of your system will not be correlated with failure of The post Scalyr: Column-Oriented Log Management with Steve Newman appeared first on Software Engineering Daily....


Database Performance and Optimization with Andrew Davidson
When a database gets large, it can start to perform poorly. This can manifest in slow query speed. You can speed up a query by defining an index, which is a data structure that allows for faster access to the data that is being indexed. As a consequence, whenever you update the database, you will The post Database Performance and Optimization with Andrew Davidson appeared first on Software Engineering Daily....

Cursor: Data Collaboration with Adam Weinstein
Linkedin is an organization with thousands of employees. An enterprise of that size starts to develop problems with data collaboration. Data collaboration is the process of sharing and analyzing data with multiple users, such as data scientists, business analysts, and engineers. How do data scientists know what questions to ask? How do business analysts know The post Cursor: Data Collaboration with Adam Weinstein appeared first on Software Engineering Daily....

Kotlin Design with Andrey Breslav
Kotlin is a statically typed programming language that started as a JVM language. It gained popularity because it reduces the amount of boilerplate code required for a typical Java project. Many of the early adopters of Kotlin were building Android apps or Java applications, but it has grown to a variety of use cases including The post Kotlin Design with Andrey Breslav appeared first on Software Engineering Daily....


Continuous Integration in Open Source with Oren Novotny
Open source software is key to our software infrastructure. Closed source enterprises rely on open source software, but the development processes for closed source and open source software are often different in their approach to continuous integration and delivery. Oren Novotny is a chief architect of DevOps and modern software at BlueMetal Architects where he The post Continuous Integration in Open Source with Oren Novotny appeared first on Software Engineering Daily....

Prisma: GraphQL Infrastructure with Soren Bramer Schmidt
GraphQL allows developers to communicate with all of their different data backends through a consistent query interface. A GraphQL query can be translated into queries to MySQL, MongoDB, ElasticSearch, or whatever kind of API or backend is needed to fulfill the GraphQL query. GraphQL users need to set up a GraphQL server to fulfill this The post Prisma: GraphQL Infrastructure with Soren Bramer Schmidt appeared first on Software Engineering Daily....

Android Things with Wayne Piekarski
Internet of Things is a concept that describes lots of devices that you interact with regularly being connected to the Internet and networked together. Technologists have been dreaming of the world of IoT for many years, where our connected refrigerator can detect that we are out of food, and automatically order more food. Or our The post Android Things with Wayne Piekarski appeared first on Software Engineering Daily....


JavaScript Engines with Mathias Bynens
JavaScript performance has improved over time due to advances in JavaScript engines such as Google’s V8. A JavaScript engine performs compiler optimization, garbage collection, hot code management, caching, and other runtime aspects that keep a JavaScript program running efficiently.  JavaScript runs in browsers and servers. The resources that are available to a JavaScript engine vary The post JavaScript Engines with Mathias Bynens appeared first on Software Engineering Daily....

Unity and WebAssembly with Brett Bibby
Unity is a game engine for building 2-D and 3-D experiences, augmented reality, movies, and other applications. Unity is cross-platform, so that applications can be written once and deployed to iOS, Android, web, and other surfaces. Unity has been around for 13 years, and has grown in popularity with the rise in gaming and game The post Unity and WebAssembly with Brett Bibby appeared first on Software Engineering Daily....

Front Engineering with Laurent Perrin
Front is a shared inbox application that has seen rapid adoption within companies. Front allows multiple members of a company to collaborate together on a conversation–whether that conversation is in email, Twitter, or Facebook Messenger. This is useful when a customer email needs to be shared between the sales and engineering teams, or when a The post Front Engineering with Laurent Perrin appeared first on Software Engineering Daily....


Checkr: Background Check Platform with Tomas Barreto
Background checks are a routine part of the hiring process. After a potential employee has made it through job interviews, a background check is administered to look through the applicant’s work history, criminal record, and other available data. Conducting a conventional background check can require manual work–including phone calls for reference checks and going to The post Checkr: Background Check Platform with Tomas Barreto appeared first on Software Engineering Daily....

Android on Chrome with Shahid Hussain and Stefan Kuhne
Google has two consumer operating systems: Android and Chrome. The Android operating system has been widely deployed on mobile devices. Chrome is an operating system for laptops and tablets, originally based around the Chrome browser. For several years, these two ecosystems were mostly separate–you could not run Android apps on a Chrome operating system. Shahid The post Android on Chrome with Shahid Hussain and Stefan Kuhne appeared first on Software Engineering Daily....

Kubernetes Distributions with Brian Gracely and Michael Hausenblas
Kubernetes is an open source container management system. Kubernetes is sometimes described as “the Linux of distributed systems” and this description makes sense: the large numbers of users and contributors in the Kubernetes community is comparable to the volume of Linux adopters in its early days. There are many different distributions of Linux: Ubuntu, Red The post Kubernetes Distributions with Brian Gracely and Michael Hausenblas appeared first on Software Engineering Daily....


Continuous Delivery Pipelines with Abel Wang
Continuous integration and delivery allows teams to move faster by allowing developers to ship code independently of each other. A multi-stage CD pipeline might consist of development, staging, testing, and production. At each of these stages, a new piece of code undergoes additional tests, so that when the code finally makes it to production, the The post Continuous Delivery Pipelines with Abel Wang appeared first on Software Engineering Daily....

DEV Community with Ben Halpern
The DEV Community is a platform where developers share ideas, programming advice, and tools. Ben Halpern started it after running an extremely successful Twitter account creating humorous tweets for developers. One way to describe DEV Community is as a cross between Medium, Stack Overflow, and Reddit–but it has its own personality, so I recommend checking The post DEV Community with Ben Halpern appeared first on Software Engineering Daily....

Druid Analytical Database with Fangjin Yang
Modern applications produce large numbers of events. These events can be users clicking, IoT sensors accumulating data, or log messages. The cost of cloud storage and compute continues to drop, so engineers can afford to build applications around these high volumes of events, and a variety of tools have been developed to process them. Apache The post Druid Analytical Database with Fangjin Yang appeared first on Software Engineering Daily....


Orchestrating Kubernetes with Chris Gaun
A company runs a variety of distributed systems applications such as Hadoop for batch processing jobs, Spark for data science, and Kubernetes for container management. These distributed systems tools can run on-prem, in a cloud provider, or in a hybrid system that uses on-prem and cloud infrastructure. Some enterprises use VMs, some use bare metal, The post Orchestrating Kubernetes with Chris Gaun appeared first on Software Engineering Daily....

Netflix Observability with Kevin Lew
Netflix users stream terabytes of data from the cloud to their devices every day. During a high bandwidth, long-lived connection, a lot can go wrong. Networks can drop packets, machines can run out of memory, and the Netflix app on a user’s device can have a bug. All of these events can result in a The post Netflix Observability with Kevin Lew appeared first on Software Engineering Daily....

Real Estate Machine Learning with Or Hiltch
Stock traders have access to high volumes of information to help them make decisions on whether to buy an asset. A trader who is considering buying a share of Google stock can find charts, reports, and statistical tools to help with their decision. There are a variety of machine learning products to help a technical The post Real Estate Machine Learning with Or Hiltch appeared first on Software Engineering Daily....


Kubernetes Continuous Deployment with Sheroy Marker
Engineering organizations can operate more efficiently by working with a continuous integration and continuous deployment workflow. Continuous integration is the process of automatically building and deploying code that gets pushed to a remote repository. Continuous deployment is the process of moving that code through a pipeline of environments, from dev to test to production. At The post Kubernetes Continuous Deployment with Sheroy Marker appeared first on Software Engineering Daily....

Go To Market with Mitch Ferguson
Engineers need to have an awareness of the business model that allows their company to succeed. When a software company is going to market, the engineers need to work closely with the sales and marketing team to formulate a strategy for building and selling that product. This is especially true in highly technical products, such The post Go To Market with Mitch Ferguson appeared first on Software Engineering Daily....

Music Engineering with Dom Kane
For most of history, a typical musician would learn to play one specific instrument. As synthesizers became available to the public, it became commonplace for a musician to create their own instruments using hardware and software. By the early 2000s, digital audio workstation software allowed a musician with a laptop to have access to the The post Music Engineering with Dom Kane appeared first on Software Engineering Daily....


Faust: Streaming at Robinhood with Ask Solem
Robinhood is a platform for buying and selling stocks, cryptocurrencies, and other assets. Since its founding in 2013, Robinhood has grown to have more than 5 million user accounts, which is even more than the popular online broker E-Trade. With the surge in user growth and transaction volume, the demands on the software infrastructure have The post Faust: Streaming at Robinhood with Ask Solem appeared first on Software Engineering Daily....

Monolith Migration with Jan Schiffman and Sherman Wood
TIBCO was started in the 90’s with a popular message bus product that was widely used by finance companies, logistics providers, and other systems with high throughput. As TIBCO grew in popularity, the company expanded into other areas through products it developed in-house as well as through acquisitions. One acquisition was Jaspersoft, a business intelligence The post Monolith Migration with Jan Schiffman and Sherman Wood appeared first on Software Engineering Daily....

RideOS: Fleet Management with Rohan Paranjpe
Self-driving transportation will be widely deployed at some point in the future. How far off is that future? There are widely varying estimations: maybe you will summon a self-driving Uber in a New York within 5 years, or maybe it will take 20 years to work out all of the challenges in legal and engineering. The post RideOS: Fleet Management with Rohan Paranjpe appeared first on Software Engineering Daily....


Kubernetes Impact with Clayton Coleman
Kubernetes is in production clusters around the world with hundreds of thousands of containers. Kubernetes provides a distributed systems management environment for small startups and giant enterprises with applications ranging from microservices to machine learning pipelines. Because the use cases are already so wide-ranging, and the project has had so much adoption, the focus of The post Kubernetes Impact with Clayton Coleman appeared first on Software Engineering Daily....

DataOps with Christopher Bergh
Every company with a large set of customers has a large set of data–whether that company is 5 years old or 50 years old. That data is valuable whether you are an insurance company, a soft drink manufacturer, or a ridesharing company. All of these large companies know that their data is valuable, but some The post DataOps with Christopher Bergh appeared first on Software Engineering Daily....

Android Slices with Jason Monk
The main user interfaces today are the smartphone, the laptop, and the desktop computer. Some people today interact with voice interfaces, augmented reality, virtual reality, and automotive computer screens like the Tesla. In the future, these other interfaces will become more common. Developers will want to be able to expose their applications to these new The post Android Slices with Jason Monk appeared first on Software Engineering Daily....


Helm with Michelle Noorali
Back in 2014, platform-as-a-service was becoming an increasingly popular idea. The idea of PaaS was to sit on top of infrastructure-as-a-service providers like Azure, AWS, or Google Cloud, and simplify some of the complexity of these infrastructure providers. Heroku had built a successful businesses from the idea of platform-as-a-service, and there was a widely held The post Helm with Michelle Noorali appeared first on Software Engineering Daily....

Build Faster with Nader Dabit
Building software today is much faster than it was just a few years ago. The tools are higher level, and abstract away tasks that would have required months of development. Much of a developer’s time used to be spent optimizing databases, load balancers, and queueing systems in order to be able to handle the load The post Build Faster with Nader Dabit appeared first on Software Engineering Daily....

Stitch Fix Engineering with Cathy Polinsky
Stitch Fix is a company that recommends packages of clothing based on a set of preferences that the user defines and updates over time. Stitch Fix’s software platform includes the website, data engineering infrastructure, and warehouse software. Stitch Fix has over 5000 employees, including a large team of engineers. Cathy Polinsky is the CTO of The post Stitch Fix Engineering with Cathy Polinsky appeared first on Software Engineering Daily....


OLIO: Food Sharing with Lloyd Watkin
Food gets thrown away from restaurants, homes, catering companies, and any other place with a kitchen. Most of this food gets thrown away when it is still edible, and could provide nutrition to someone who is hungry. Just like Airbnb makes use of excess living capacity, OLIO was started to connect excess food with people The post OLIO: Food Sharing with Lloyd Watkin appeared first on Software Engineering Daily....

WebAssembly Engineering with Ben Smith and Thomas Nattestad
WebAssembly allows developers to run any language in a sandboxed, memory controlled module that can be called via well-defined semantics. As we have discussed in recent episodes with Lin Clark and Steve Klabnik from Mozilla, WebAssembly is changing application architectures both in and outside the browser. WebAssembly is being adopted by all of the major The post WebAssembly Engineering with Ben Smith and Thomas Nattestad appeared first on Software Engineering Daily....

WebAssembly Future with Steve Klabnik
WebAssembly is a low-level compilation target for any programming language that can be interpreted into WebAssembly. Alternatively, WebAssembly is a way to run languages other than JavaScript in the browser. Or, yet another way of describing WebAssembly is a virtual machine for executing code in a low level, well-defined sandbox. WebAssembly is reshaping what is The post WebAssembly Future with Steve Klabnik appeared first on Software Engineering Daily....


DoorDash Engineering with Raghav Ramesh
DoorDash is a last mile logistics company that connects customers with their favorite national and local businesses. When a customer orders from a restaurant, DoorDash needs to identify the ideal driver for picking up the order from the restaurant and dropping it off with the customer. This process of matching an order to a driver The post DoorDash Engineering with Raghav Ramesh appeared first on Software Engineering Daily....

Casa: Crypto Wallet Security with Jameson Lopp
Cryptocurrency security is a concern to anyone who has a significant amount of money in the form of Bitcoin, Ethereum, or other crypto assets. Most Bitcoin is held in either a Bitcoin wallet or a Bitcoin bank. Your Bitcoin holdings are recorded on a public ledger. You access these holdings by authenticating with your private The post Casa: Crypto Wallet Security with Jameson Lopp appeared first on Software Engineering Daily....

Infrastructure Monitoring with Mark Carter
At Google, the job of a site reliability engineer involves building tools to automate infrastructure operations. If a server crashes, there is automation in place to create a new server. If a service starts to receive a high load of traffic, there is automation in place to scale up the instances of that service. In The post Infrastructure Monitoring with Mark Carter appeared first on Software Engineering Daily....


GitOps: Kubernetes Continuous Delivery with Alexis Richardson
Continuous delivery is a way of releasing software without requiring software engineers to synchronize during a release.  Over the last decade, continuous delivery workflows have evolved as the tools have changed. Jenkins was one of the first continuous delivery tools and is still in heavy use today. Netflix’s open sourced Spinnaker has also been widely The post GitOps: Kubernetes Continuous Delivery with Alexis Richardson appeared first on Software Engineering Daily....

Klarna Engineering with Marcus Granström
Klarna is a payments company headquartered in Sweden. Since being established in 2005 it has grown to handling $21 billion in online sales in 2017. Roughly 40% of all e-commerce sales in Sweden go through Klarna. Klarna’s original differentiator was that it allowed users to checkout of e-commerce stores without entering in credit card information. The post Klarna Engineering with Marcus Granström appeared first on Software Engineering Daily....

Stripe Engineering with Raylene Yung
Stripe is a payments API that allows merchants to transact online. Since the creation of the payments API, Stripe has expanded into adjacent services such as fraud detection, business management, and billing. These other verticals leverage the existing customer base and infrastructure that Stripe has developed from the success of their payments business. Raylene Yung The post Stripe Engineering with Raylene Yung appeared first on Software Engineering Daily....


Self-Driving Engineering with George Hotz
In the smartphone market there are two dominant operating systems: one closed source (iPhone) and one open source (Android). The market for self-driving cars could play out the same way, with a company like Tesla becoming the closed source iPhone of cars, and a company like Comma.ai developing the open source Android of self-driving cars. The post Self-Driving Engineering with George Hotz appeared first on Software Engineering Daily....

Future Architecture with Chad Fowler
Chad Fowler was the CTO of Wunderlist prior to its acquisition by Microsoft. Since the acquisition, Chad has become the general manager of developer advocacy at Microsoft. He also works as a venture capitalist at BlueYard Capital, an early stage investment firm. I’ve had a lot of fun talking to Chad, because he can move The post Future Architecture with Chad Fowler appeared first on Software Engineering Daily....

Splice: Music Collaboration with Matt Aimonetti
Music collaboration has historically been accomplished by musicians gathering in bands. A band is usually an in-person, physical manifestation: a drummer, a guitarist, a piano player. Or, on a large scale, a symphony of classical instruments led by a conductor. Today, the most flexible instrument that anyone can play is arguably the computer, because a The post Splice: Music Collaboration with Matt Aimonetti appeared first on Software Engineering Daily....


GraalVM with Thomas Wuerthinger
Java programs compile into Java bytecode. Java bytecode executes in the Java Virtual Machine, a runtime environment that compiles that bytecode further into machine code, and optimizes the runtime by identifying “hot” code paths and keeping those hot code paths executing quickly. The Java Virtual Machine is a popular platform for building languages on top The post GraalVM with Thomas Wuerthinger appeared first on Software Engineering Daily....

Token Types with Felipe Pereira
A token is a unit of virtual currency. Most tokens are built on a blockchain-based cryptocurrency platform, such as Ethereum. Building on top of a platform like Ethereum allows these tokens to form their own financial ecosystem while leveraging the scale of an existing currency. Tokens became highly popular in early 2018, with the boom The post Token Types with Felipe Pereira appeared first on Software Engineering Daily....

Castor EDC with Derk Arts
Medical breakthroughs require medical research. Medical research requires patient testing and data collection. The most common form of capturing patient data is through surveys–and most of those surveys today are done on paper. Surveying patients to understand the side effects or benefits of trial drugs or treatments, and getting accurate results out of these are The post Castor EDC with Derk Arts appeared first on Software Engineering Daily....


Jailbreaking Apple Watch with Max Bazaliy
Apple operating systems are closed source. This closed source nature gives Apple an extremely successful business model–and a very different software developer ecosystem than Linux-based systems. Since Linux is open source, the information on how to manipulate the system at a low level is very public. The lack of information about low-level programming in Apple The post Jailbreaking Apple Watch with Max Bazaliy appeared first on Software Engineering Daily....

Edge Kubernetes with Venkat Yalla
“Edge computing” is a term used to define computation that takes place in an environment outside of a data center. Edge computing is a broad term. Your smartphone is an edge device. A self-driving car is an edge device. A security camera with a computer chip is an edge device. These “edge devices” have existed The post Edge Kubernetes with Venkat Yalla appeared first on Software Engineering Daily....

React Native at Airbnb with Gabriel Peal
React Native allows developers to reuse frontend code between mobile platforms. A user interface component written in React Native can be used in both iOS and Android codebases. Since React Native allows for code reuse, this can save time for developers, in contrast to a model where completely separate teams have to create frontend logic The post React Native at Airbnb with Gabriel Peal appeared first on Software Engineering Daily....


Ghost: Open Source Publishing Platform with John O’Nolan
Blogging is more than 20 years old. Over that period of time, numerous publishing platforms have been created. Squarespace, Blogger, Medium, and Twitter are popular closed source platforms. WordPress has been the most popular open source blogging platform–and much of the Internet (including Software Engineering Daily) runs on WordPress. WordPress is a powerful platform. News The post Ghost: Open Source Publishing Platform with John O’Nolan appeared first on Software Engineering Daily....

Video Games and Funding Techniques with Howard Marks
Howard Marks ran two video game companies in the 90’s: Activision and Acclaim. While running these companies, he developed a love for entrepreneurship that he maintains today. Howard is the CEO of StartEngine, a company that functions as an accelerator, a crowdfunding platform, and ICO launcher. Howard joins the show to talk about his background The post Video Games and Funding Techniques with Howard Marks appeared first on Software Engineering Daily....

Video Machine Learning with Ben Dodson
Video streaming platforms like Netflix offer a convenient way to watch video content. We are now able to watch our favorite TV shows, movies, or content creators on a range of devices. However, buffering while watching videos can be a painful experience on mobile phones and tablets that use 4G or LTE. As streaming becomes The post Video Machine Learning with Ben Dodson appeared first on Software Engineering Daily....


Kubernetes in the Enterprise with Aparna Sinha
Enterprises want to update their technology faster. One way an enterprise can accelerate the adoption of new tools is to move more aggressively towards the cloud. By giving internal developers access to the cloud, it becomes easier to provision new servers–allowing for rapid experimentation, test environments, and scalability. In previous shows we have explored how The post Kubernetes in the Enterprise with Aparna Sinha appeared first on Software Engineering Daily....

WebAssembly with Lin Clark
JavaScript has been the exclusive language of the web browser for the last 20 years. Whether you use Chrome, Firefox, Internet Explorer, or Safari, your browser interprets and executes code in a virtual machine–and that virtual machine only runs JavaScript. Unfortunately, JavaScript is not ideal for every task we want to perform in the browser. The post WebAssembly with Lin Clark appeared first on Software Engineering Daily....

Botchain with Rob May
“Bots” are becoming increasingly relevant to our everyday interactions with technology. A bot sometimes mediates the interactions of two people. Examples of bots include automated reply systems, intelligent chat bots, classification systems, and prediction machines. These systems are often powered by machine learning systems that are black boxes to the user. Today’s guest Rob May The post Botchain with Rob May appeared first on Software Engineering Daily....


Build a Bank: N26 with Pat Kua
Banking has been a part of the economy for 600 years. Banking has always been evolving. The most recent evolution: the financial industry has been going digital. Newer “fintech” companies have created innovative ways of doing everything related to money–from friendly payments to budgeting; from business transactions to insurance. However, the traditional banks themselves have The post Build a Bank: N26 with Pat Kua appeared first on Software Engineering Daily....

Git Vulnerability with Edward Thomson
Git is a distributed file system for version control. Git is extremely reliable, fast, and secure, owing to the fact that it is one of the oldest pieces of open source software. But even battle-tested software can have vulnerabilities. In this episode, we explore a subtle git vulnerability that could have potentially led to git The post Git Vulnerability with Edward Thomson appeared first on Software Engineering Daily....

Counting People with Andrew Farah
If you operate a restaurant, you want to know how many people are inside your restaurant at any given time. You also want to be able to know your occupancy if you operate a movie theater, coffee shop, or apparel store. Knowing how many people are in your building can answer several business-related questions. Do The post Counting People with Andrew Farah appeared first on Software Engineering Daily....


Machine Learning Deployments with Diego Oppenheimer
Machine learning models allow our applications to perform highly accurate inferences. A model can be used to classify a picture as a cat, or to predict what movie I might want to watch. But before a machine learning model can be used to make these inferences, the model must be trained and deployed. In the The post Machine Learning Deployments with Diego Oppenheimer appeared first on Software Engineering Daily....