Software Engineering Daily

Software Engineering Daily Podcast

Technical interviews about software topics.

Snorkel: Training Dataset Management with Braden Hancock
Machine learning models require the use of training data, and that data needs to be labeled. Today, we have high quality data infrastructure tools such as TensorFlow, but we don’t have large high quality data sets. For many applications, the state of the art is to manually label training examples and feed them into the The post Snorkel: Training Dataset Management with Braden Hancock appeared first on Software Engineering Daily....

Cadence: Uber’s Workflow Engine with Maxim Fateev
A workflow is an application that involves more than just a simple request/response communication. For example, consider a session of a user taking a ride in an Uber. The user initiates the ride, and the ride might last for an hour. At the end of the ride, the user is charged for the ride and The post Cadence: Uber’s Workflow Engine with Maxim Fateev appeared first on Software Engineering Daily....

kSQLDB: Kafka Streaming Interface with Michael Drogalis
Kafka is a distributed stream processing system that is commonly used for storing large volumes of append-only event data. Kafka has been open source for almost a decade, and as the project has matured, it has been used for new kinds of applications.  Kafka’s pubsub interface for writing and reading topics is not ideal for The post kSQLDB: Kafka Streaming Interface with Michael Drogalis appeared first on Software Engineering Daily....


Godot Game Engine with Juan Linietsky
Building a game is not easy. The development team needs to figure out a unique design and gameplay mechanics that will attract players. There is a great deal of creative work that goes into making a game successful, and these games are often built with low budgets by people who are driven by the art The post Godot Game Engine with Juan Linietsky appeared first on Software Engineering Daily....

V8 Lite with Ross McIlroy
V8 is the JavaScript engine that runs Chrome. Every popular website makes heavy use of JavaScript, and V8 manages the execution environment of that code. The code that processes in your browser can run faster or slower depending on how “hot” the codepath is. If a certain line of code is executed frequently, that code The post V8 Lite with Ross McIlroy appeared first on Software Engineering Daily....

Serverless Development with Jeremy Daly
Serverless tools have come a long way since the release of AWS Lambda in 2014. Serverless apps were originally architected around Lambda, with the functions-as-a-service being used to glue together larger pieces of functionality and API services. Today, many of the common AWS services such as API Gateway and DynamoDB have functionality built in to The post Serverless Development with Jeremy Daly appeared first on Software Engineering Daily....


Audio Data Engineering with Allison King
Cortico is a non-profit that builds audio tools to improve public dialogue. Allison King is an engineer at Cortico, and she joins the show to talk about the process of building audio applications.  One of these applications was a system for ingesting radio streams, transcribing the radio, and looking for duplicate information across the different The post Audio Data Engineering with Allison King appeared first on Software Engineering Daily....

Facebook Messenger Engineering with Mohsen Agsen
Facebook Messenger is a chat application that millions of people use every day to talk to each other. Over time, Messenger has grown to include group chats, video chats, animations, facial filters, stories, and many more features. Messenger is a tool for utility as well as for entertainment. Messenger is used both on mobile and The post Facebook Messenger Engineering with Mohsen Agsen appeared first on Software Engineering Daily....

Pika Dependency Management with Fred Schott
Modern web development involves a complicated toolchain for managing dependencies. One part of this toolchain is the bundler, a tool that puts all your code and dependencies together into static asset files. The most popular bundler is webpack, which was originally released in 2012, before browsers widely supported ES Modules. Today, every major browser supports The post Pika Dependency Management with Fred Schott appeared first on Software Engineering Daily....


Cloud Kitchen Platform with Ashley Colpaart
Food delivery apps have changed how the restaurant world operates. After seven years of mobile food delivery, the volume of food ordered through these apps has become so large that entire restaurants can be sustained solely through the order flow that comes in from the apps. This raises the question as to why you even The post Cloud Kitchen Platform with Ashley Colpaart appeared first on Software Engineering Daily....

Cloud Kitchen Platform with Ashley Colpaart
Food delivery apps have changed how the restaurant world operates. After seven years of mobile food delivery, the volume of food ordered through these apps has become so large that entire restaurants can be sustained solely through the order flow that comes in from the apps. This raises the question as to why you even The post Cloud Kitchen Platform with Ashley Colpaart appeared first on Software Engineering Daily....

Remote Team Management with Ryan Chartrand
Remote engineering work makes some elements of software development harder, and some elements easier. With Slack and email, communication becomes more clear cut. Project management tools lay out the responsibilities and deliverables of each person. GitHub centralizes and defines the roles of developers. On the other hand, remote work subtracts the role of nuanced conversation. The post Remote Team Management with Ryan Chartrand appeared first on Software Engineering Daily....


Sorbet: Typed Ruby with Dmitry Petrashko
Programming languages are dynamically typed or statically typed. In a dynamically typed language, the programmer does not need to declare if a variable is an integer, string, or other type. In a statically typed language, the developer must declare the type of the variable upfront, so that the compiler can take advantage of that information. The post Sorbet: Typed Ruby with Dmitry Petrashko appeared first on Software Engineering Daily....

Datomic Architecture with Marshall Thompson
Datomic is a database system based on an append-only record keeping system. Datomic users can query the complete history of the database, and Datomic has ACID transactional support. The data within Datomic is stored in an underlying database system such as Cassandra or Postgres. The database is written in Clojure, and was co-authored by the The post Datomic Architecture with Marshall Thompson appeared first on Software Engineering Daily....

Datomic Architecture with Marshall Thompson
Datomic is a database system based on an append-only record keeping system. Datomic users can query the complete history of the database, and Datomic has ACID transactional support. The data within Datomic is stored in an underlying database system such as Cassandra or Postgres. The database is written in Clojure, and was co-authored by the The post Datomic Architecture with Marshall Thompson appeared first on Software Engineering Daily....


Google Cloud Networking with Lakshmi Sharma
A large cloud provider has high volumes of network traffic moving through data centers throughout the world. These providers manage the infrastructure for thousands of companies, across racks and racks of multitenant servers, and cables that stretch underseas, connecting network packets with their destination. Google Cloud Platform has grown steadily into a wide range of The post Google Cloud Networking with Lakshmi Sharma appeared first on Software Engineering Daily....

ClickUp Engineering with Zeb Evans and Alex Yurkowski
Over the last fifteen years, there has been a massive increase in the number of new software tools. This is true at the infrastructure layer: there are more databases, more cloud providers, and more open-source projects. And it’s also true at a higher level: there are more APIs, project management systems, and productivity tools. ClickUp The post ClickUp Engineering with Zeb Evans and Alex Yurkowski appeared first on Software Engineering Daily....

Pulumi: Infrastructure as Code with Joe Duffy
Infrastructure-as-code allows developers to use programming languages to define the architecture of their software deployments, including servers, load balancers, and databases.  There have been several generations of infrastructure-as-code tools. Systems such as Chef, Puppet, Salt, and Ansible provided a domain-specific imperative scripting language that became popular along with the early growth of Amazon Web Services. The post Pulumi: Infrastructure as Code with Joe Duffy appeared first on Software Engin...


Infrastructure Investing with Vivek Saraswat
Software investing requires a deep understanding of the market, and an ability to predict what changes might occur in the near future. At the level of core infrastructure, software investing is particularly difficult. Databases, virtualization, and large scale data processing tools are all complicated, highly competitive areas. As the software world has matured, it has The post Infrastructure Investing with Vivek Saraswat appeared first on Software Engineering Daily....

Sisu Data with Peter Bailis
A high volume of data can contain a high volume of useful information. That fact is well understood by the software world. Unfortunately, it is not a simple process to surface useful information from this high volume of data. A human analyst needs to understand the business, formulate a question, and determine what metrics could The post Sisu Data with Peter Bailis appeared first on Software Engineering Daily....

Location Data with Ryan Fox Squire
Physical places have a large amount of latent data. Pick any location on a map, and think about all of the questions you could ask about that location. What businesses are at that location? How many cars pass through it? What is the soil composition? How much is the land on that location worth? The The post Location Data with Ryan Fox Squire appeared first on Software Engineering Daily....


Location Data with Ryan Fox Squire
Physical places have a large amount of latent data. Pick any location on a map, and think about all of the questions you could ask about that location. What businesses are at that location? How many cars pass through it? What is the soil composition? How much is the land on that location worth? The The post Location Data with Ryan Fox Squire appeared first on Software Engineering Daily....

Descript with Andrew Mason
Descript is a software product for editing podcasts and video. Descript is a deceptively powerful tool, and its software architecture includes novel usage of transcription APIs, text-to-speech, speech-to-text, and other domain-specific machine learning applications. Some of the most popular podcasts and YouTube channels use Descript as their editing tool because it provides a set of The post Descript with Andrew Mason appeared first on Software Engineering Daily....

Descript with Andrew Mason
Descript is a software product for editing podcasts and video. Descript is a deceptively powerful tool, and its software architecture includes novel usage of transcription APIs, text-to-speech, speech-to-text, and other domain-specific machine learning applications. Some of the most popular podcasts and YouTube channels use Descript as their editing tool because it provides a set of The post Descript with Andrew Mason appeared first on Software Engineering Daily....


Flyte: Lyft Data Processing Platform with Allyson Gale and Ketan Umare
Lyft is a ridesharing company that generates a high volume of data every day.  This data includes ride history, pricing information, mapping, routing, and financial transactions. The data is stored across a variety of different databases, data lakes, and queueing systems, and is processed at scale in order to generate machine learning models, reports, and The post Flyte: Lyft Data Processing Platform with Allyson Gale and Ketan Umare appeared first on Software Engineering Daily....

Cloud Investing with Danel Dayan
Cloud computing caused a fundamental economic shift in how software is built. Before the cloud, businesses needed to buy physical servers in order to operate. There was an up-front cost that often amounted to tens of thousands of dollars required to pay for these servers.  Cloud computing changed the up-front capital expense to an ongoing The post Cloud Investing with Danel Dayan appeared first on Software Engineering Daily....

Cloud Investing with Danel Dayan
Cloud computing caused a fundamental economic shift in how software is built. Before the cloud, businesses needed to buy physical servers in order to operate. There was an up-front cost that often amounted to tens of thousands of dollars required to pay for these servers.  Cloud computing changed the up-front capital expense to an ongoing The post Cloud Investing with Danel Dayan appeared first on Software Engineering Daily....


OneGraph: GraphQL Tooling with Sean Grove
GraphQL is a system that allows frontend engineers to make requests across multiple data sources using a simple query format. In GraphQL, a frontend developer does not have to worry about the request logic for individual backend services. The frontend developer only needs to know how to issue GraphQL requests from the client, and these The post OneGraph: GraphQL Tooling with Sean Grove appeared first on Software Engineering Daily....

DBT: Data Build Tool with Tristan Handy
A data warehouse serves the purpose of providing low latency queries for high volumes of data. A data warehouse is often part of a data pipeline, which moves data through different areas of infrastructure in order to build applications such as machine learning models, dashboards, and reports. Modern data pipelines are often associated with the The post DBT: Data Build Tool with Tristan Handy appeared first on Software Engineering Daily....

React Best Practices with Kent Dodds
ReactJS developers have lots of options for building their applications, and those options are not easy to work through. State management, concurrency, networking, and testing all have elements of complexity and a wide range of available tools. Take a look at any specific area of JavaScript application development, and you can find highly varied opinions. The post React Best Practices with Kent Dodds appeared first on Software Engineering Daily....


React Stack with Tejas Kumar
JavaScript fatigue. This phrase has been used to describe the confusion and exhaustion around the volume of different tools required to be productive as a JavaScript developer. Frameworks, package managers, typing systems, state management, GraphQL, and deployment systems–there are so many decisions to make. In addition to the present-day tooling choices, a JavaScript developer needs The post React Stack with Tejas Kumar appeared first on Software Engineering Daily....

JavaScript Deployments with Brian LeRoux
Full-stack JavaScript applications have been possible since the creation of NodeJS in 2009. Since then, the best practices for building and deploying these applications have steadily evolved with the technology.  ReactJS created consolidation around the view layer. The emergence of AWS Lambda created a new paradigm for backend execution. Serverless tools such as DynamoDB offer The post JavaScript Deployments with Brian LeRoux appeared first on Software Engineering Daily....

React Fundamentals with Ryan Florence
ReactJS began to standardize frontend web development around 2015. The core ideas around one-way data binding, JSX, and components caused many developers to embrace React with open arms. There has been a large number of educators that have emerged to help train developers wanting to learn React. A new developer learning React has numerous questions The post React Fundamentals with Ryan Florence appeared first on Software Engineering Daily....


NextJS with Guillermo Rauch
When ReactJS became popular, frontend web development became easier. But React is just a view layer. Developers who came to React expecting a full web development framework like Ruby on Rails or Django were required to put together a set of tools to satisfy that purpose. A full-stack JavaScript framework has numerous requirements. How does The post NextJS with Guillermo Rauch appeared first on Software Engineering Daily....

NextJS with Guillermo Rauch
When ReactJS became popular, frontend web development became easier. But React is just a view layer. Developers who came to React expecting a full web development framework like Ruby on Rails or Django were required to put together a set of tools to satisfy that purpose. A full-stack JavaScript framework has numerous requirements. How does The post NextJS with Guillermo Rauch appeared first on Software Engineering Daily....

Makerpad: Low Code Tools with Ben Tossell
Low code tools can be used to build an increasing number of applications. Knowledge workers within a large corporation can use low code tools to augment their usage of spreadsheets. Entrepreneurs can use low code tools to start businesses even without knowing how to code. Modern low code tools have benefited from steady improvements in The post Makerpad: Low Code Tools with Ben Tossell appeared first on Software Engineering Daily....


Slack Frontend Architecture with Anuj Nair
Slack is a messaging application with millions of users. The desktop application is an Electron app, which is effectively a web browser dedicated to running Slack. This frontend is built with ReactJS and other JavaScript code, and the application is incredibly smooth and reliable, despite its complexity. When a user boots up Slack, the application The post Slack Frontend Architecture with Anuj Nair appeared first on Software Engineering Daily....

Slack Frontend Architecture with Anuj Nair
Slack is a messaging application with millions of users. The desktop application is an Electron app, which is effectively a web browser dedicated to running Slack. This frontend is built with ReactJS and other JavaScript code, and the application is incredibly smooth and reliable, despite its complexity. When a user boots up Slack, the application The post Slack Frontend Architecture with Anuj Nair appeared first on Software Engineering Daily....

Makerpad: Low Code Tools with Ben Tossell
Low code tools can be used to build an increasing number of applications. Knowledge workers within a large corporation can use low code tools to augment their usage of spreadsheets. Entrepreneurs can use low code tools to start businesses even without knowing how to code. Modern low code tools have benefited from steady improvements in The post Makerpad: Low Code Tools with Ben Tossell appeared first on Software Engineering Daily....


Parabola: No-Code Data Workflows with Alex Yaseen
Every company has a large number of routine data workflows. These data workflows involve spreadsheets, CSV files, and tedious manual work to be done by a knowledge worker.  For example, data might need to be taken from Salesforce, filtered for new customers, and piped into Mailchimp. Or perhaps you need to sort all your customers The post Parabola: No-Code Data Workflows with Alex Yaseen appeared first on Software Engineering Daily....

Decentralized Finance with Tom Schmidt
Cryptocurrencies today serve two purposes: store of value and speculation.  The application infrastructure that has been built around cryptocurrency is mostly to support these use cases. At some point in the future, perhaps cryptocurrencies can be used as a global medium of exchange that is accepted at the grocery store. Perhaps we will use the The post Decentralized Finance with Tom Schmidt appeared first on Software Engineering Daily....

Infrastructure Management with Joey Parsons
At Airbnb, infrastructure management is standardized across the organization. Platform engineering teams build tools that allow the other teams throughout the organization to work more effectively. A platform engineering team handles problems such as continuous integration, observability, and service discovery. Other teams throughout a company use the tools that a platform engineering team builds. For The post Infrastructure Management with Joey Parsons appeared first on Software Engineering Daily....


Courier with Troy Goode
A gig economy application generates lots of notifications.  There is SMS, mobile phone updates, emails, and native application updates. If you order a ride from Uber, you might receive a text message and a push notification at the same time. If an app overloads the user with notifications, the user might end up annoyed and The post Courier with Troy Goode appeared first on Software Engineering Daily....

Courier with Troy Goode
A gig economy application generates lots of notifications.  There is SMS, mobile phone updates, emails, and native application updates. If you order a ride from Uber, you might receive a text message and a push notification at the same time. If an app overloads the user with notifications, the user might end up annoyed and The post Courier with Troy Goode appeared first on Software Engineering Daily....

Data Infrastructure Investing with Eric Anderson
In a modern data platform, distributed streaming systems are used to read data coming off of an application in real-time. There are a wide variety of streaming systems, including Kafka Streams, Apache Samza, Apache Flink, Spark Streaming, and more.  When Eric Anderson joined the show back in 2016, he was working at Google on Google The post Data Infrastructure Investing with Eric Anderson appeared first on Software Engineering Daily....


Data Infrastructure Investing with Eric Anderson
In a modern data platform, distributed streaming systems are used to read data coming off of an application in real-time. There are a wide variety of streaming systems, including Kafka Streams, Apache Samza, Apache Flink, Spark Streaming, and more.  When Eric Anderson joined the show back in 2016, he was working at Google on Google The post Data Infrastructure Investing with Eric Anderson appeared first on Software Engineering Daily....

Materialize: Streaming SQL on Timely Data with Arjun Narayan and Frank McSherry
Distributed stream processing frameworks are used to rapidly ingest and aggregate large volumes of incoming data. These frameworks often require the application developer to write imperative logic describing how that data should be processed.  For example, a high volume of clickstream data that is getting buffered to Kafka needs to have a stream processing system The post Materialize: Streaming SQL on Timely Data with Arjun Narayan and Frank McSherry appeared first on Software Engineering Daily....

Go Networking with Sneha Inguva
A cloud provider gives developers access to virtualized server infrastructure. When a developer rents this infrastructure via an API call, a virtual server is instantiated on physical machines. That virtual server needs to be made addressable through the allocation of an IP address to make it reachable from the open Internet. When the virtual server The post Go Networking with Sneha Inguva appeared first on Software Engineering Daily....


Great Expectations: Data Pipeline Testing with Abe Gong
A data pipeline is a series of steps that takes large data sets and creates usable results from them. At the beginning of a data pipeline, a data set might be pulled from a database, a distributed file system, or a Kafka topic. Throughout a data pipeline, different data sets are joined, filtered, and statistically The post Great Expectations: Data Pipeline Testing with Abe Gong appeared first on Software Engineering Daily....

Data Warehouse ETL with Matthew Scullion
A data warehouse provides low latency access to large volumes of data.  A data warehouse is a crucial piece of infrastructure for a large company, because it can be used to answer complex questions involving a large number of data points. But a data warehouse usually cannot hold all of a company’s data at any The post Data Warehouse ETL with Matthew Scullion appeared first on Software Engineering Daily....

Anyscale with Ion Stoica
Machine learning applications are widely deployed across the software industry.  Most of these applications used supervised learning, a process in which labeled data sets are used to find correlations between the labels and the trends in that underlying data. But supervised learning is only one application of machine learning. Another broad set of machine learning The post Anyscale with Ion Stoica appeared first on Software Engineering Daily....


Flink and BEAM Stream Processing with Maximilian Michels
Distributed stream processing systems are used to read large volumes of data and perform operations across those data streams.  These stream processing systems often build off of the MapReduce algorithm for collecting and aggregating large volumes of data, but instead of processing a calculation over a single large batch of data, they process data on The post Flink and BEAM Stream Processing with Maximilian Michels appeared first on Software Engineering Daily....

Druid Analytics with Jad Naous
Large companies generate large volumes of data. This data gets dumped into a data lake for long-term storage, then pulled into memory for processing and analysis. Once it is in memory, it is often read into a dashboard, which presents a human with a visualization of the data.  The end-user who is consuming this data The post Druid Analytics with Jad Naous appeared first on Software Engineering Daily....

The Data Exchange with Ben Lorica
Data infrastructure has been transformed over the last fifteen years.  The open source Hadoop project led to the creation of multiple companies based around commercializing the MapReduce algorithm and Hadoop distributed file system. Cheap cloud storage popularized the usage of data lakes. Cheap cloud servers led to wide experimentation for data tools. Apache Spark emerged The post The Data Exchange with Ben Lorica appeared first on Software Engineering Daily....


Presto with Justin Borgman
A data platform contains all of the data that a company has accumulated over the years. Across a data platform, there is a multitude of data sources: databases, a data lake, data warehouses, a distributed queue like Kafka, and external data sources like Salesforce and Zendesk. A user of the data platform often has a The post Presto with Justin Borgman appeared first on Software Engineering Daily....

Nubank Data Engineering with Sujith Nair
Nubank is a popular bank that is based in Brazil. Nubank has more than 20 million customers, and has accumulated a high volume of data over the six years since it was started. Mobile computing and cloud computing have given rise to “challenger banks” that operate more like software companies. When a software company reaches The post Nubank Data Engineering with Sujith Nair appeared first on Software Engineering Daily....

Changelog Podcasting with Adam Stacoviak and Jerod Santo
The Changelog is a podcast about the world of open source. As open source has become closely tied with the entire software development lifecycle, The Changelog has expanded its coverage to the broader software industry. Since starting the podcast ten years ago, Adam Stacoviak and Jerod Santo have become full-time podcasters, and they have started The post Changelog Podcasting with Adam Stacoviak and Jerod Santo appeared first on Software Engineering Daily....


Rive: Animation Tooling with Guido and Luigi Rosso
Animations can be used to create games, app tutorials, and user interface components. Animations can be seen in messaging apps, where animated reactions can convey rich feelings over a text interface. Loading screens can become less boring through animation, and voice assistant products can feel more alive through animation. But we still don’t see much The post Rive: Animation Tooling with Guido and Luigi Rosso appeared first on Software Engineering Daily....

John Deere: Farm Software with Ryan Bergman
Robotics has changed modern agriculture. Autonomous systems are powering the tractors, cotton pickers, and corn cutters that yield plants at industrial scale. John Deere is a company that has been making farm equipment for 183 years. Over that period, the planting and harvesting process has become increasingly mechanized, and John Deere has been at the The post John Deere: Farm Software with Ryan Bergman appeared first on Software Engineering Daily....

Venture Stories with Erik Torenberg
Venture capital investing requires an understanding of market dynamics, technology, and finance.  There is also an element of human nature. Consumer trends can make or break the viability of a new product. And early stage venture investing is always a bet on a small team or individual founder. Early stage investments are usually into companies The post Venture Stories with Erik Torenberg appeared first on Software Engineering Daily....


Alpaca: Stock Trading API with Yoshi Yokokawa
Stock trading takes place across a variety of software platforms. Etrade and Schwab have allowed individual traders to buy securities for decades. Robinhood built a business around a similar model, but also removed the commission. Wealthfront and Betterment provide “roboadvisor” services that abstract away the underlying securities and focus on managing a risk profile. Each The post Alpaca: Stock Trading API with Yoshi Yokokawa appeared first on Software Engineering Daily....

Cloud Log Analysis with Jack Naglieri
Large software companies have lots of users, and the activity from those users results in high volumes of traffic. These companies also have a large surface area across the enterprise.  There are hundreds of services and databases that are fulfilling user requests. As these requests enter the infrastructure of the enterprise, the requests travel through The post Cloud Log Analysis with Jack Naglieri appeared first on Software Engineering Daily....

Replicated Software Delivery with Grant Miller and Marc Campbell
Distributed systems are required to run most modern enterprise software. Application services need multiple instances for scalability and failover. Large databases are sharded onto multiple nodes. Logging services, streaming frameworks, and continuous integration tools all require the orchestration of more than one server. Deploying a distributed system has historically been difficult because the nodes of The post Replicated Software Delivery with Grant Miller and Marc Campbell appeared first on Software En...


Mattermost with Ian Tien
Chat systems have been a part of software development for decades. Older systems like Pidgin and Yammer were surpassed by newer systems like HipChat. And when Slack was created, it quickly became a part of most software companies. But Slack does not fulfill the needs of every company. Mattermost is an open-source chat system. Mattermost The post Mattermost with Ian Tien appeared first on Software Engineering Daily....

GitLab Strategy with Sid Sibrandij
The word “DevOps” has a different definition depending on who you ask.  For some people, it is about the process of managing and releasing code. It can involve container management and server orchestration. It can involve infrastructure-as-code, and safer configuration management. In addition to a set of technologies, DevOps can be seen as a management The post GitLab Strategy with Sid Sibrandij appeared first on Software Engineering Daily....

Lyft Kubernetes with Vicki Cheung
The ridesharing infrastructure of Lyft has a high volume of traffic that is mostly handled by servers on AWS. When Vicki Cheung joined Lyft in 2018, the company was managing containers with an internally built container scheduler. One of her primary goals at the company was to move Lyft to Kubernetes. In today’s episode, Vicki The post Lyft Kubernetes with Vicki Cheung appeared first on Software Engineering Daily....


DFINITY: The Internet Computer with Dominic Williams
If the Internet was reimagined with the software and hardware infrastructure we have today, what would it look like? That is the question that DFINITY is working on answering. DFINITY’s goal is to build a decentralized, secure Internet computer. DFINITY takes concepts from the cryptocurrency world, but it is focused on computation, not financial products. The post DFINITY: The Internet Computer with Dominic Williams appeared first on Software Engineering Daily....

Webflow Engineering with Bryant Chou
Webflow is a visual programming tool used by designers, developers, and other technical users. Webflow is a leader in the “low code” or “no code” category of software tools that has become prominent in the last few years.  Webflow has been years in the making. In a previous show with Webflow CEO Vlad Magdalin, he The post Webflow Engineering with Bryant Chou appeared first on Software Engineering Daily....

Software Media with Tim O’Reilly
Software has changed the way the world functions. The rapid pace of change has made it difficult to know how to navigate the new world. Knowledge workers who want to keep advancing in their careers develop a strategy of continuous learning in order to adapt to these changes. O’Reilly Media has existed for almost 40 The post Software Media with Tim O’Reilly appeared first on Software Engineering Daily....


Apollo GraphQL with Geoff Schmidt
GraphQL has become a core piece of infrastructure for many software applications. GraphQL is used to make requests that are structured as GraphQL queries and responded to through a GraphQL server. The GraphQL server processes the query and fetches the response from the necessary databases, APIs, and backend services. Around 2016, when GraphQL was becoming The post Apollo GraphQL with Geoff Schmidt appeared first on Software Engineering Daily....

JS Party with Kevin Ball
The JavaScript ecosystem stretches across frontend, backend, and middleware. There are newer tools such as GraphQL, Gatsby, and WebAssembly. There are frameworks like React, Vue, and Angular. There is complex data handling with streams, caches, and TensorFlow.js. JavaScript is unlike any other ecosystem, because a single language can be used to construct every part of The post JS Party with Kevin Ball appeared first on Software Engineering Daily....

Packet: Baremetal Infrastructure with Zachary Smith and Nathan Goulding
Cloud infrastructure is usually consumed in the form of virtual machines or containers. These VMs or containers are running on a physical host machine that is also running other VMs and containers. This is called multitenancy. Servers across cloud providers such as AWS have a high utilization because there are multiple virtual instances running on The post Packet: Baremetal Infrastructure with Zachary Smith and Nathan Goulding appeared first on Software Engineering Daily....


Edge Computing Platform with Jaromir Coufal
Edge computing is the usage of servers that are geographically close to the client device. The first common use case for edge computing was CDNs: content-delivery networks. A content delivery network placed media files such as images and videos on multiple servers throughout the world. These are big files, and they take lots of bandwidth The post Edge Computing Platform with Jaromir Coufal appeared first on Software Engineering Daily....

Data Infrastructure Go-To-Market with Sean Knapp
Every large company generates large amounts of data. Data engineering is the process of storing, transforming, and leveraging that data. Data infrastructure companies provide tools and platforms for performing data engineering. The last fifteen years has seen a rise in modern data management companies built in a time of decreasing storage costs, an increased volume The post Data Infrastructure Go-To-Market with Sean Knapp appeared first on Software Engineering Daily....

Slack Data Platform with Josh Wills
Slack is a messaging platform for organizations. Since its creation in 2013, Slack has quickly become a core piece of technology used by a wide variety of technology companies, groups, and small teams.  The messages that are sent on Slack are generated at a very high volume, and are extremely sensitive. These messages must be The post Slack Data Platform with Josh Wills appeared first on Software Engineering Daily....


NoSQL Optimization with Rick Houlihan
NoSQL databases provide an interface for storing and accessing data that allows the user to work with data in an “unstructured” fashion. SQL databases require the data in the database to be “normalized,” meaning that each object in the entire database has an entry (or a null value) for each field. One advantage of NoSQL The post NoSQL Optimization with Rick Houlihan appeared first on Software Engineering Daily....

Amazon EC2 with Dave Brown
Amazon EC2 (Elastic Compute Cloud) is a virtualized server product that provides the user with scalable compute infrastructure. EC2 was created in 2006 as one of the first three AWS services along with S3 and Simple Queueing Service. Since then, EC2 has provided the core server infrastructure for many of the companies that have been The post Amazon EC2 with Dave Brown appeared first on Software Engineering Daily....

Amazon Kubernetes with Abby Fuller
Amazon’s container offerings include ECS (Elastic Container Service), EKS (Elastic Kubernetes Service), and Fargate. Through these different offerings, Amazon provides a variety of ways that a user can manage Kubernetes clusters and standalone container instances. The choice of which containerization system to choose depends on the needs of the user, and the tradeoffs they want The post Amazon Kubernetes with Abby Fuller appeared first on Software Engineering Daily....


Kubernetes Progress with Kelsey Hightower
When the Kubernetes project was started, Amazon Web Services was the dominant cloud provider. Most of the code that runs AWS is closed source, which prevents an open ecosystem from developing around AWS. Developers who deploy their application onto AWS are opting into a closed, controlled ecosystem, which has both costs and benefits. The software The post Kubernetes Progress with Kelsey Hightower appeared first on Software Engineering Daily....

freeCodeCamp with Quincy Larson
freeCodeCamp was started five years ago with the goal of providing free coding education to anyone on the Internet. freeCodeCamp has become the best place to begin learning how to write software. There are many other places that a software engineer should visit on their educational journey, but freeCodeCamp is the best place to start, The post freeCodeCamp with Quincy Larson appeared first on Software Engineering Daily....

No Code with Shawn Wang
The software category known as “no-code” describes a set of tools that can be used to build software without writing large amounts of code in a programming language. No-code tools use visual interfaces such as spreadsheets and web based drag-and-drop systems. In previous shows, we have covered some of the prominent no-code products such as The post No Code with Shawn Wang appeared first on Software Engineering Daily....


Roblox Engineering with Claus Moberg
Roblox is a gaming platform with a large ecosystem of players, creators, game designers, and entrepreneurs. The world of Roblox is a three-dimensional environment where characters and objects interact through a physics engine. Roblox is multiplayer, and users can interact with each other over the Internet. Roblox is not one single game—it is a system The post Roblox Engineering with Claus Moberg appeared first on Software Engineering Daily....

Kubernetes at Cruise with Karl Isenberg
Cruise is a company that is building a fully automated self-driving car service. The infrastructure of a self-driving car platform presents a large number of new engineering problems. Self-driving cars collect vast quantities of data as they are driving around the city. This data needs to be transferred from the cars onto cloud servers. The The post Kubernetes at Cruise with Karl Isenberg appeared first on Software Engineering Daily....

Snyk: Open Source Security with Guy Podjarny
The software supply chain includes cloud infrastructure, on-prem proprietary solutions, APIs, programming languages, networking products, and open source software.  Each of these software categories has its own security vulnerabilities, and each category has tools that can help protect a company from attackers that are trying to exploit known vulnerabilities. As open source software has grown The post Snyk: Open Source Security with Guy Podjarny appeared first on Software Engineering Daily....


GitLab Engineering with Marin Jankovski
GitLab is a company that builds an open source platform for managing git repositories. GitLab was started in 2012, and has grown to have a large enterprise business with additional products such as continuous integration and security tooling. GitLab is also known for being a large, entirely remote workforce. GitLab does not have any offices, The post GitLab Engineering with Marin Jankovski appeared first on Software Engineering Daily....

Basic Income with Floyd Marinescu
Automation has the potential to eliminate rote jobs such as call center workers and truck drivers. The downstream effects of automation also leads to new jobs, such as data labeling and robot operations. The net effect of modern automation technology is unclear, but it is likely to cause some disruption in the job market. Universal The post Basic Income with Floyd Marinescu appeared first on Software Engineering Daily....

Continuous Intelligence with Kalyan Ramanathan
Logging provides raw data that can be abstracted into higher level information. Logs are generated at every layer of infrastructure: physical host, virtual machine, container, pod, and Kubernetes cluster. Logs are generated by network proxies, edge servers, and API requests. There is far too much logging information to be read by humans.  Log messages need The post Continuous Intelligence with Kalyan Ramanathan appeared first on Software Engineering Daily....


Remote Work with Philip Thomas
Offices have historically been the place where most knowledge work takes place. An office is a central meeting point for everyone in an organization. Offices allow for high bandwidth, in-person communication. Employees have access to shared resources, such as food, tables, and quiet working space. Offices provide a means of encouraging a common culture within The post Remote Work with Philip Thomas appeared first on Software Engineering Daily....

Practical AI with Chris Benson
Machine learning algorithms have existed for decades. But in the last ten years, several advancements in software and hardware have caused dramatic growth in the viability of applications based on machine learning. Smartphones generate large quantities of data about how humans move through the world. Software-as-a-service companies generate data about how these humans interact with The post Practical AI with Chris Benson appeared first on Software Engineering Daily....

Linkerd Market Strategy with William Morgan
The container orchestration wars ended in 2016 with Kubernetes being the most popular open source tool for deploying and managing infrastructure. Since that time, most large enterprises have been implementing a “platform strategy” based around Kubernetes. A platform strategy is a plan for creating a consistent experience for software engineers working throughout an enterprise. At The post Linkerd Market Strategy with William Morgan appeared first on Software Engineering Daily....


Istio Market Strategy with Zack Butcher
Kubernetes has created a widespread system for deploying and managing infrastructure. As Kubernetes has been increasingly adopted, companies are thinking about how to leverage that common layer of infrastructure. With the common infrastructure abstraction of Kubernetes, it becomes easier to adopt other abstractions that are uniform across the entire company.  This has created a market The post Istio Market Strategy with Zack Butcher appeared first on Software Engineering Daily....

Heroku Infrastructure with Mark Turner
A cloud provider gives a developer low-cost compute infrastructure on-demand.  Cloud providers can be divided up into two categories: Layer 1 cloud providers and Layer 2 cloud providers. A Layer 1 cloud provider such as Amazon Web Services owns server hardware and sells compute infrastructure as a commodity. A Layer 2 cloud provider purchases compute The post Heroku Infrastructure with Mark Turner appeared first on Software Engineering Daily....

Java 13 with Georges Saab
Java has been popular since the 90s, when it started to be used as a programming language for enterprises.  Today, Java is still widely deployed, but the infrastructure environment is dramatically different. Java is often deployed to containers in the cloud. If those containers can share resources, then those containers can share the same underlying The post Java 13 with Georges Saab appeared first on Software Engineering Daily....


Distributed SQL with Karthik Ranganathan and Sid Choudhury
Relational databases provide durable transactional systems for storing data. The relational model has existed for decades, but the requirements for a relational database have changed. Modern applications have requirements for high volumes of data that do not fit onto a single machine. When a database gets too big to fit on a single machine, that The post Distributed SQL with Karthik Ranganathan and Sid Choudhury appeared first on Software Engineering Daily....

Distributed SQL with Karthik Ranganathan and Sidharth Choudhury
Relational databases provide durable transactional systems for storing data. The relational model has existed for decades, but the requirements for a relational database have changed. Modern applications have requirements for high volumes of data that do not fit onto a single machine. When a database gets too big to fit on a single machine, that The post Distributed SQL with Karthik Ranganathan and Sidharth Choudhury appeared first on Software Engineering Daily....

Economics of Software with Russ Roberts Holiday Repeat
Originally published July 14, 2016 EconTalk is a weekly economics podcast that has been going for a decade. On EconTalk, Russ Roberts brings on writers, intellectuals, and entrepreneurs for engaging conversations about the world as seen through the lens of economics. Russ Roberts is today’s guest, and it is a treat because I have been The post Economics of Software with Russ Roberts Holiday Repeat appeared first on Software Engineering Daily....


Uber’s Data Platform with Zhenxiao Luo Holiday Repeat
Originally published May 24, 2018 When a user takes a ride on Uber, the app on the user’s phone is communicating with Uber’s backend infrastructure, which is writing to a database that maintains the state of that user’s activity. This database is known as a transactional database or “OLTP” (online transaction processing). Every active user The post Uber’s Data Platform with Zhenxiao Luo Holiday Repeat appeared first on Software Engineering Daily....

Kong API Platform with Marco Palladino Holiday Repeat
Originally published January 4, 2019 When a user makes a request to product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, and logging. API gateways have grown in popularity as The post Kong API Platform with Marco Palladino Holiday Repeat appeared first on Software Engineering Daily....

Kong API Platform with Marco Palladino Holiday Repeat
Originally published January 4, 2019 When a user makes a request to product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, and logging. API gateways have grown in popularity as The post Kong API Platform with Marco Palladino Holiday Repeat appeared first on Software Engineering Daily....


Future of Computing with John Hennessy Holiday Repeat
Originally published June 7, 2018 Moore’s Law states that the number of transistors in a dense integrated circuit doubles about every two years. Moore’s Law is less like a “law” and more like an observation or a prediction. Moore’s Law is ending. We can no longer fit an increasing amount of transistors in the same The post Future of Computing with John Hennessy Holiday Repeat appeared first on Software Engineering Daily....

Future of Computing with John Hennessy Holiday Repeat
Originally published June 7, 2018 Moore’s Law states that the number of transistors in a dense integrated circuit doubles about every two years. Moore’s Law is less like a “law” and more like an observation or a prediction. Moore’s Law is ending. We can no longer fit an increasing amount of transistors in the same The post Future of Computing with John Hennessy Holiday Repeat appeared first on Software Engineering Daily....

Indie Hackers with Courtland Allen Holiday Repeat
Originally published November 4, 2016 Indie Hackers is a website that profiles independent developers who have made profitable software projects, usually without raising any money. These projects make anywhere from a few hundred dollars a month to more than $100,000 as in the case with park.io, one of the services profiled by Indie Hackers. Courtland The post Indie Hackers with Courtland Allen Holiday Repeat appeared first on Software Engineering Daily....


Cloud Dependencies with Mya Pitzeruse
New software abstractions always take advantage of the abstractions that have been built before. Software libraries allow us to import code that sits on the same host as a new program. Open source software let us copy and paste existing code, or clone entire repositories. Cloud providers offer hosted tools and APIs that we can The post Cloud Dependencies with Mya Pitzeruse appeared first on Software Engineering Daily....

Cloud Dependencies with Mya Pitzeruse
New software abstractions always take advantage of the abstractions that have been built before. Software libraries allow us to import code that sits on the same host as a new program. Open source software let us copy and paste existing code, or clone entire repositories. Cloud providers offer hosted tools and APIs that we can The post Cloud Dependencies with Mya Pitzeruse appeared first on Software Engineering Daily....

Web Application Testing with Gabriel-James Safar
Web applications are used on a wide variety of platforms.  On each of these platforms the web app needs to load properly and allow the user to navigate the website and interact with all of the user flows, such as sign-up, login, and the various read and write operations that make up the functionality of The post Web Application Testing with Gabriel-James Safar appeared first on Software Engineering Daily....


Web Application Testing with Gabriel-James Safar
Web applications are used on a wide variety of platforms.  On each of these platforms the web app needs to load properly and allow the user to navigate the website and interact with all of the user flows, such as sign-up, login, and the various read and write operations that make up the functionality of The post Web Application Testing with Gabriel-James Safar appeared first on Software Engineering Daily....

HTTP with Julia Evans
HTTP is a protocol that allows browsers and web applications to communicate across the Internet. Everyone knows that HTTP is doing some important work, because “HTTP” is at the beginning of most URLs that you enter into your browser. You might be familiar with the request/response model, and HTTP request methods such as GET, PUT, The post HTTP with Julia Evans appeared first on Software Engineering Daily....

HTTP with Julia Evans
HTTP is a protocol that allows browsers and web applications to communicate across the Internet. Everyone knows that HTTP is doing some important work, because “HTTP” is at the beginning of most URLs that you enter into your browser. You might be familiar with the request/response model, and HTTP request methods such as GET, PUT, The post HTTP with Julia Evans appeared first on Software Engineering Daily....


Indie Hack or Venture Back with Lynne Tye
Key Values is a platform where companies are profiled with descriptions of their company values. These profiles describe features such as work-life balance, company culture, daily routines, and strategy. Lynne Tye created Key Values with the goal of building a small business that would make money through connecting job seekers to companies with a culture The post Indie Hack or Venture Back with Lynne Tye appeared first on Software Engineering Daily....

Indie Hack or Venture Back with Lynne Tye
Key Values is a platform where companies are profiled with descriptions of their company values. These profiles describe features such as work-life balance, company culture, daily routines, and strategy. Lynne Tye created Key Values with the goal of building a small business that would make money through connecting job seekers to companies with a culture The post Indie Hack or Venture Back with Lynne Tye appeared first on Software Engineering Daily....

Bubble: Code-Free Programming with Emmanuel Straschnov and Joshua Haas
The vision of code-free programming has existed for decades. Software engineers have always dreamed of empowering non-technical users with the same creative tools that programmers have access to.  For many years, the underlying technology of the web was not powerful enough to make this dream a reality. Platforms such as WordPress, Squarespace, and Wix have The post Bubble: Code-Free Programming with Emmanuel Straschnov and Joshua Haas appeared first on Software Engineering Daily....


Cloudflare Serverless with Zack Bloom
“Serverless” is an execution model where applications are scheduled and deployed to servers that are not directly managed by the application developer.  In serverless execution, an application only loads and operates when a user actually needs to get a response from that application. This saves on resources, because many applications do not need to run The post Cloudflare Serverless with Zack Bloom appeared first on Software Engineering Daily....

Cloudflare Serverless with Zack Bloom
“Serverless” is an execution model where applications are scheduled and deployed to servers that are not directly managed by the application developer.  In serverless execution, an application only loads and operates when a user actually needs to get a response from that application. This saves on resources, because many applications do not need to run The post Cloudflare Serverless with Zack Bloom appeared first on Software Engineering Daily....

Dagster with Nick Schrock
Data engineering is difficult.  Companies want to be able to maximize the value they get from their large data sets, but there are so many steps required for deriving that value that most companies feel like they are always far behind the ideal state of where they could be.  The cloud makes it cheap to The post Dagster with Nick Schrock appeared first on Software Engineering Daily....


GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard
Java programs run in a different environment than they did ten years ago. Modern infrastructure runs on containers sitting in a Kubernetes cluster. The optimal configuration for a Java program in that context is different than it was for an environment dominated by virtual machines and bare metal. When you are co-scheduling your services with The post GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard appeared first on Software Engineering Daily....

GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard
Java programs run in a different environment than they did ten years ago. Modern infrastructure runs on containers sitting in a Kubernetes cluster. The optimal configuration for a Java program in that context is different than it was for an environment dominated by virtual machines and bare metal. When you are co-scheduling your services with The post GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard appeared first on Software Engineering Daily....

Bugsnag Business with James Smith
Crash monitoring emerged as a software category over the last decade. Crash monitoring software allows developers to understand when their applications are crashing on client devices. For example, we have an app for Software Engineering Daily that people download on Android or iOS. Users download the app to their smartphone. When the user is playing The post Bugsnag Business with James Smith appeared first on Software Engineering Daily....


Incident Response Machine Learning with Chris Riley
Software bugs cause unexpected problems at every company.  Some problems are small. A website goes down in the middle of the night, and the outage triggers a phone call to an engineer who has to wake up and fix the problem. Other problems can be significantly larger. When a major problem occurs, it can cause The post Incident Response Machine Learning with Chris Riley appeared first on Software Engineering Daily....

Incident Response Machine Learning with Chris Riley
Software bugs cause unexpected problems at every company.  Some problems are small. A website goes down in the middle of the night, and the outage triggers a phone call to an engineer who has to wake up and fix the problem. Other problems can be significantly larger. When a major problem occurs, it can cause The post Incident Response Machine Learning with Chris Riley appeared first on Software Engineering Daily....

Gatsby with Kyle Mathews and Sam Bhagwat
Frontend software development has become as complex as backend development. There was a time when frontend web development was simple. There was a small number of JavaScript frameworks and templating systems. Your CSS was simple configuration for the colors on your webpage. Today, there is a giant ecosystem of frontend tools, APIs, and middleware delivering The post Gatsby with Kyle Mathews and Sam Bhagwat appeared first on Software Engineering Daily....


Gatsby with Kyle Mathews and Sam Bhagwat
Frontend software development has become as complex as backend development. There was a time when frontend web development was simple. There was a small number of JavaScript frameworks and templating systems. Your CSS was simple configuration for the colors on your webpage. Today, there is a giant ecosystem of frontend tools, APIs, and middleware delivering The post Gatsby with Kyle Mathews and Sam Bhagwat appeared first on Software Engineering Daily....

Drones with Chris Anderson
Drones will deliver food to us. Drones will be able to extinguish fires. Drones will be used to relay Internet signals and make the world more connected.  These all sound like great ideas, so why aren’t there more drones in the sky today? There are many answers to that question, some of which relate to The post Drones with Chris Anderson appeared first on Software Engineering Daily....

LinkedIn Data Engineering with Kapil Surlaker
A large social network needs to develop systems for ingesting, storing, and processing large volumes of data. Data engineering at scale requires multiple engineering teams that are responsible for different areas of the infrastructure. Data needs to be structured coherently in order to minimize the data cleaning process. Machine learning models need to be developed, The post LinkedIn Data Engineering with Kapil Surlaker appeared first on Software Engineering Daily....


FOSSA: Open Source Management with Kevin Wang
Every company has a software supply chain. A company builds its products from custom code, paid APIs, paid proprietary binaries, and open source software libraries. As the types of software available have increased, the management of the software supply chain has become complex.  Large software companies have always needed to ensure the security of their The post FOSSA: Open Source Management with Kevin Wang appeared first on Software Engineering Daily....

Scale with Alexandr Wang
Machine learning is widely understood by the software community. But it is still hard to build a company around machine learning, because there is not easy access to large, unique data sets. Scale is a platform for training and validating data that is used for machine learning. Most machine learning models are built with supervised The post Scale with Alexandr Wang appeared first on Software Engineering Daily....

Leadership with Ben Horowitz
Photo credit: Elisabeth Fall Ben Horowitz started Loudcloud with Marc Andreessen in 1999. He ran the company for eight years and chronicled his experience in his first book The Hard Thing About Hard Things. In his time running Loudcloud, the dotcom bubble burst, but Loudcloud needed cash so badly that he took the company public The post Leadership with Ben Horowitz appeared first on Software Engineering Daily....


Facebook Leadership with Arturo Bejar
Facebook leadership has a significant amount of engineers in its ranks, and engineers understand how to create an environment that appeals to other engineers.  Engineers do not like working on projects that they are not interested in, so Facebook optimizes for matching engineers to enjoyable work. Engineers do not like taking orders from managers, so The post Facebook Leadership with Arturo Bejar appeared first on Software Engineering Daily....

Facebook Leadership with Arturo Bejar
Facebook leadership has a significant amount of engineers in its ranks, and engineers understand how to create an environment that appeals to other engineers.  Engineers do not like working on projects that they are not interested in, so Facebook optimizes for matching engineers to enjoyable work. Engineers do not like taking orders from managers, so The post Facebook Leadership with Arturo Bejar appeared first on Software Engineering Daily....

Facebook Fallout with Antonio Garcia Martinez
Chaos Monkeys is a book about Silicon Valley startups and Facebook. It is one of the most accurate books written about the modern technology industry, and captures both the negatives and the positives of software companies. Antonio Garcia Martinez is the author of Chaos Monkeys. He wrote the book after going through a gauntlet of The post Facebook Fallout with Antonio Garcia Martinez appeared first on Software Engineering Daily....


Facebook Fallout with Antonio Garcia Martinez
Chaos Monkeys is a book about Silicon Valley startups and Facebook. It is one of the most accurate books written about the modern technology industry, and captures both the negatives and the positives of software companies. Antonio Garcia Martinez is the author of Chaos Monkeys. He wrote the book after going through a gauntlet of The post Facebook Fallout with Antonio Garcia Martinez appeared first on Software Engineering Daily....

Facebook Reflections with Pete Hunt and Nick Schrock
Facebook engineering is unique. Software is built at Facebook in a way that is distinctly different than any other company. In our series of shows about Facebook engineering, we have mostly covered the positive side of Facebook’s practices. In today’s show, we explore the downsides.  Facebook moves fast. Engineers within the company must move fast, The post Facebook Reflections with Pete Hunt and Nick Schrock appeared first on Software Engineering Daily....

Facebook Reflections with Pete Hunt and Nick Schrock
Facebook engineering is unique. Software is built at Facebook in a way that is distinctly different than any other company. In our series of shows about Facebook engineering, we have mostly covered the positive side of Facebook’s practices. In today’s show, we explore the downsides.  Facebook moves fast. Engineers within the company must move fast, The post Facebook Reflections with Pete Hunt and Nick Schrock appeared first on Software Engineering Daily....


Facebook Products with Peter Deng
Peter Deng has worked on most of Facebook’s major products: Newsfeed, Instagram, Oculus, and Messenger. These different products have different requirements, but are all part of the same ethos of connecting people through social networks.  Facebook is a consumer product company that is powered by a strong engineering workforce. The relationship between product managers and The post Facebook Products with Peter Deng appeared first on Software Engineering Daily....

Facebook Products with Peter Deng
Peter Deng has worked on most of Facebook’s major products: Newsfeed, Instagram, Oculus, and Messenger. These different products have different requirements, but are all part of the same ethos of connecting people through social networks.  Facebook is a consumer product company that is powered by a strong engineering workforce. The relationship between product managers and The post Facebook Products with Peter Deng appeared first on Software Engineering Daily....

Facebook Entrepreneurship with Jeff Rothschild
Jeff Rothschild was one of the earliest engineers to join Facebook. In the 1990s, Jeff had co-founded Veritas Software and helped it to its IPO in 2004. After Veritas, Jeff worked on several other of his own companies. He was working with Accel Partners on investments when he started to learn about Facebook. Accel was The post Facebook Entrepreneurship with Jeff Rothschild appeared first on Software Engineering Daily....


Alluxio: Data Orchestration with Haoyuan Li
In 2013, the Berkeley AMPLab was a center of innovation.  Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has The post Alluxio: Data Orchestration with Haoyuan Li appeared first on Software Engineering Daily....

Alluxio: Data Orchestration with Haoyuan Li
In 2009, the Berkeley AMPLab was a center of innovation.  Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has The post Alluxio: Data Orchestration with Haoyuan Li appeared first on Software Engineering Daily....

Redis with Alvin Richards
Redis is an in-memory database that persists to disk. Redis is commonly used as an object cache for web applications. Applications are composed of caches and databases. A cache typically stores the data in memory, and a database typically stores the data on disk. Memory has significantly faster access times, but is more expensive and The post Redis with Alvin Richards appeared first on Software Engineering Daily....


LinkedIn Data Platform with Carl Steinbach
LinkedIn is a social network with petabytes of data.  In order to store that data, LinkedIn distributes and replicates that data across a large cluster of machines running the Hadoop Distributed File System. In order to run calculations across its large data set, LinkedIn needs to split the computation up using MapReduce-style jobs. LinkedIn has The post LinkedIn Data Platform with Carl Steinbach appeared first on Software Engineering Daily....

LinkedIn Data Platform with Carl Steinbach
LinkedIn is a social network with petabytes of data.  In order to store that data, LinkedIn distributes and replicates that data across a large cluster of machines running the Hadoop Distributed File System. In order to run calculations across its large data set, LinkedIn needs to split the computation up using MapReduce-style jobs. LinkedIn has The post LinkedIn Data Platform with Carl Steinbach appeared first on Software Engineering Daily....

Crypto Businesses with Haseeb Qureshi
Cryptocurrencies are a fundamental computer science invention.  Cryptocurrencies crashed in 2018 but the technology remains as promising as ever. Bitcoin is a decentralized currency, and a plausible end state that is implied by Bitcoin’s current trajectory is a permissionless, decentralized financial system. This idea of decentralized finance or “DeFi” begs numerous questions: who will build The post Crypto Businesses with Haseeb Qureshi appeared first on Software Engineering Daily....


Crypto Businesses with Haseeb Qureshi
Cryptocurrencies are a fundamental computer science invention.  Cryptocurrencies crashed in 2018 but the technology remains as promising as ever. Bitcoin is a decentralized currency, and a plausible end state that is implied by Bitcoin’s current trajectory is a permissionless, decentralized financial system. This idea of decentralized finance or “DeFi” begs numerous questions: who will build The post Crypto Businesses with Haseeb Qureshi appeared first on Software Engineering Daily....

Dark Lang with Ellen Chisa and Paul Biggar
Dark Lang is a programming language that is tightly integrated with the cloud.  Dark takes an opinionated approach that most developers are going to want to run their applications in the cloud, and this perspective influences how Dark looks at deployments, IDEs, exception handling, and other aspects of software development. Paul Biggar is the founder The post Dark Lang with Ellen Chisa and Paul Biggar appeared first on Software Engineering Daily....

LinkedIn Kafka with Nacho Solis
Apache Kafka was created at LinkedIn. Kafka was open sourced in 2011, when the company was eight years old. By that time, LinkedIn had developed a social network with millions of users. LinkedIn’s engineering team was building a range of externally facing products and internal tools, and many of these tools required a high-throughput system The post LinkedIn Kafka with Nacho Solis appeared first on Software Engineering Daily....


Gravity: Distributed Application Delivery with Ev Kontsevoy
Modern applications are distributed systems. These applications require an installation mechanism that can run and update the software across multiple nodes.  When a SaaS company starts to work with large enterprise customers, that company needs to figure out a way to deliver their product to the enterprise. This requires the SaaS company to deploy the The post Gravity: Distributed Application Delivery with Ev Kontsevoy appeared first on Software Engineering Daily....

Gravity: Distributed Application Delivery with Ev Kontsevoy
Modern applications are distributed systems. These applications require an installation mechanism that can run and update the software across multiple nodes.  When a SaaS company starts to work with large enterprise customers, that company needs to figure out a way to deliver their product to the enterprise. This requires the SaaS company to deploy the The post Gravity: Distributed Application Delivery with Ev Kontsevoy appeared first on Software Engineering Daily....

Incident Reproduction with Tammy Butow
Databases go offline. Services fail to scale up. Deployment errors can cause an application backend to get DDoS’d. When an event happens that prevents your company from operating as expected, it is known as an incident. Software teams respond to an incident by issuing a fix. Sometimes that fix returns the software to its ideal The post Incident Reproduction with Tammy Butow appeared first on Software Engineering Daily....


Diffbot Infrastructure with Mike Tung
Diffbot is a knowledge graph that allows developers to interface with the unstructured web as if it was a structured database. In today’s show, Diffbot CEO Mike Tung returns for a second discussion about how he has built Diffbot and how Diffbot is used. The web has many different entities. Web pages, topics, people, stories, The post Diffbot Infrastructure with Mike Tung appeared first on Software Engineering Daily....

How To Build A Cloud Provider with Anurag Goel
Render is a cloud provider built on top of Amazon Web Services and Google Cloud. Render uses the compute abstractions provided by the major cloud providers to build a second layer cloud provider with the goal of providing a better user experience. Anurag Goel is the founder of Render, and he returns to the show The post How To Build A Cloud Provider with Anurag Goel appeared first on Software Engineering Daily....

How To Build A Cloud Provider with Anurag Goel
Render is a cloud provider built on top of Amazon Web Services and Google Cloud. Render uses the compute abstractions provided by the major cloud providers to build a second layer cloud provider with the goal of providing a better user experience. Anurag Goel is the founder of Render, and he returns to the show The post How To Build A Cloud Provider with Anurag Goel appeared first on Software Engineering Daily....


freeCodeCamp’s Quincy Larson interviews Jeff Meyerson
We are republishing a podcast from the freeCodeCamp Podcast as a weekend episode. Jeff Meyerson is the creator and host of the Software Engineering Daily podcast. Jeff grew up in Texas. He spent most of his childhood playing competitive strategy games like Magic: the Gathering. This lead him to making a lot of money – The post freeCodeCamp’s Quincy Larson interviews Jeff Meyerson appeared first on Software Engineering Daily....

Webflow: No-Code with Vlad Magdalin
Webflow is a platform for building applications without programming. Software engineering has barely been around for 30 years. Over that period of time, there have been many attempts to create a platform that allows for the creation of software without writing a line of code. Most of these systems have not been able to fulfill The post Webflow: No-Code with Vlad Magdalin appeared first on Software Engineering Daily....

Webflow: No-Code with Vlad Magdalin
Webflow is a platform for building applications without programming. Software engineering has barely been around for 30 years. Over that period of time, there have been many attempts to create a platform that allows for the creation of software without writing a line of code. Most of these systems have not been able to fulfill The post Webflow: No-Code with Vlad Magdalin appeared first on Software Engineering Daily....


Data Visualization with Sherman Wood and Chad Lumley
Data visualization is the presentation of data in a way that emphasizes certain qualities about that data. Data visualization can be used to prove a specific point, or it can be used as a depiction of a data set to be explored. Data visualization is used in consumer software products as well as backend engineering The post Data Visualization with Sherman Wood and Chad Lumley appeared first on Software Engineering Daily....

Treehouse: Business and Education with Ryan Carson
The ability to create software is a superpower. But software education is not evenly distributed. Ryan Carson started Treehouse to provide a high quality education system for anyone to learn how to build software. On a previous episode, Ryan and I discussed the field of programming education. Ryan returns to the show for a conversation The post Treehouse: Business and Education with Ryan Carson appeared first on Software Engineering Daily....

Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh
Video surveillance impacts human lives every day.  On most days, we do not feel the impact of video surveillance. But the effects of video surveillance have tremendous potential. It can be used to solve crimes and find missing children. It can be used to intimidate journalists and empower dictators. Like any piece of technology, video The post Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh appeared first on Software Engineering Daily....


Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh
Video surveillance impacts human lives every day.  On most days, we do not feel the impact of video surveillance. But the effects of video surveillance have tremendous potential. It can be used to solve crimes and find missing children. It can be used to intimidate journalists and empower dictators. Like any piece of technology, video The post Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh appeared first on Software Engineering Daily....

GDPR in Practice with Joshua Prismon
Data privacy policies have changed how software organizations need to operate. As consumer preferences have shifted in favor of strong privacy, software companies are having to examine their policies around data collection and retention. Many software companies were started in a time with different norms around data.  Building a new application that is compliant with The post GDPR in Practice with Joshua Prismon appeared first on Software Engineering Daily....

Indie Hackers (3 Years Later) with Courtland Allen
Indie Hackers is a platform for independent software businesses to discuss strategy and find inspiration. Courtland Allen founded Indie Hackers with the goal of sharing the stories of these businesses, and the company has become a thriving community of entrepreneurs, engineers, and creators. Business is a creative medium. The definition of a successful business is The post Indie Hackers (3 Years Later) with Courtland Allen appeared first on Software Engineering Daily....


The Messy Middle with Scott Belsky
Scott Belsky founded Behance in 2006. Behance is a social platform where designers and creators share their work. Scott was motivated to start Behance due to his desire to combine his love for creativity with his desire to create a business. After 6 years of work, Behance was acquired by Adobe for more than $150 The post The Messy Middle with Scott Belsky appeared first on Software Engineering Daily....

The Messy Middle with Scott Belsky
Scott Belsky founded Behance in 2006. Behance is a social platform where designers and creators share their work. Scott was motivated to start Behance due to his desire to combine his love for creativity with his desire to create a business. After 6 years of work, Behance was acquired by Adobe for more than $150 The post The Messy Middle with Scott Belsky appeared first on Software Engineering Daily....

Fivetran: Data Connectors with George Fraser
Large companies have multiple databases, multiple data formats, and multiple applications that need to use the data. Every data engineer needs to move data between these different components of a system. Moving data between different parts of a system is often called “ETL”, an acronym for “Extract, Transform, Load.” Data engineers spend much of their The post Fivetran: Data Connectors with George Fraser appeared first on Software Engineering Daily....


Cruise: Self-Driving Engineering with Mo Elshenawy
The development of self-driving cars is one of the biggest technological changes that is under way. Across the world, thousands of engineers are working on developing self-driving cars. Although it still seems far away, self-driving cars are starting to feel like an inevitability. This is especially true if you spend much time in downtown San The post Cruise: Self-Driving Engineering with Mo Elshenawy appeared first on Software Engineering Daily....

Cruise: Self-Driving Engineering with Mo Elshenawy
The development of self-driving cars is one of the biggest technological changes that is under way. Across the world, thousands of engineers are working on developing self-driving cars. Although it still seems far away, self-driving cars are starting to feel like an inevitability. This is especially true if you spend much time in downtown San The post Cruise: Self-Driving Engineering with Mo Elshenawy appeared first on Software Engineering Daily....

Software Moats with Astasia Myers
Investors often use the term “moat” to describe the durable competitive advantage of a company. When an investor puts money into a company, they are making that investment based on a valuation. That valuation is subjective–it is how much the investor thinks the company is worth. A valuation is determined by the present value of The post Software Moats with Astasia Myers appeared first on Software Engineering Daily....


Stripe Infrastructure Management with Uma Chingunde
Software engineering is a new field. There are theories about how we should be building our systems, but these theories might change over time. The same is true for engineering management.  There are many successful examples of companies scaling with the management hierarchies pioneered by Microsoft and Google, but since everyone knows that those techniques The post Stripe Infrastructure Management with Uma Chingunde appeared first on Software Engineering Daily....

Life Insurance Engineering with Vipul Sharma and Lingke Wang
Ethos Life Insurance is a software company that sells life insurance products. Software is reshaping established industries such as banking, insurance, and manufacturing. In these large, established industries, incumbents are adopting new technology as fast as they can, but the new technology needs to be integrated with the old technology. The slow rate of technology The post Life Insurance Engineering with Vipul Sharma and Lingke Wang appeared first on Software Engineering Daily....

Life Insurance Engineering with Vipul Sharma and Lingke Wang
Ethos Life Insurance is a software company that sells life insurance products. Software is reshaping established industries such as banking, insurance, and manufacturing. In these large, established industries, incumbents are adopting new technology as fast as they can, but the new technology needs to be integrated with the old technology. The slow rate of technology The post Life Insurance Engineering with Vipul Sharma and Lingke Wang appeared first on Software Engineering Daily....


WebAssembly Isolation with Tyler McMullen
Isolation is a fundamental concept in computer science. Software workloads are isolated from each other in order to keep resource access cleanly separated.  When programs are properly isolated, it is easier for the programmer to reason about the memory safety of that program. When a program is not properly isolated, it can lead problems such The post WebAssembly Isolation with Tyler McMullen appeared first on Software Engineering Daily....

Cloud Foundry with Abby Kearns
Cloud Foundry is a system for managing distributed applications. Cloud Foundry was released in 2011, and has been widely adopted by enterprises that need a platform for deploying and scaling the applications that run within their company. The ecosystem around Cloud Foundry includes systems for continuous delivery, pubsub messaging, and containerization. Abby Kearns is the The post Cloud Foundry with Abby Kearns appeared first on Software Engineering Daily....

Cloud Foundry with Abby Kearns
Cloud Foundry is a system for managing distributed applications. Cloud Foundry was released in 2011, and has been widely adopted by enterprises that need a platform for deploying and scaling the applications that run within their company. The ecosystem around Cloud Foundry includes systems for continuous delivery, pubsub messaging, and containerization. Abby Kearns is the The post Cloud Foundry with Abby Kearns appeared first on Software Engineering Daily....


Kafka Data Pipelines with Robin Moffatt
A new software product usually starts with a single database. That database manages the tables for user accounts and basic transactions. When a product becomes popular, the database grows in size. There are more transactions and more users. A company grows around that product, and the company starts to accumulate more data in different sources. The post Kafka Data Pipelines with Robin Moffatt appeared first on Software Engineering Daily....

ReadMe with Greg Koberger
A software company needs to get many things right in order to be successful. Having a useful product with solid engineering is only the beginning. ReadMe was started five years ago. The company solved a seemingly simple problem: documentation for software products. If you have worked as a software engineer, you have looked at documentation. The post ReadMe with Greg Koberger appeared first on Software Engineering Daily....

Open Source Ecosystem with Dirk Hohndel
Open source software is very new. Open source has existed for less than 30-40 years, depending on who you ask. The idea of open source was popularized by Linux, and open source software started to get heavily commercialized in the 1990s. By the early 2000s, open source was used by nearly every large software company. The post Open Source Ecosystem with Dirk Hohndel appeared first on Software Engineering Daily....


Open Source Ecosystem with Dirk Hohndel
Open source software is very new. Open source has existed for less than 30-40 years, depending on who you ask. The idea of open source was popularized by Linux, and open source software started to get heavily commercialized in the 1990s. By the early 2000s, open source was used by nearly every large software company. The post Open Source Ecosystem with Dirk Hohndel appeared first on Software Engineering Daily....

Distributed Databases with Aly Cabral
Modern databases consist of multiple servers that host the data in a distributed fashion. Using multiple servers allows a database to be resilient to the failure of any one database node, because copies of the data are shared to other servers. A multi-node setup also lets the database grow beyond the size of data that The post Distributed Databases with Aly Cabral appeared first on Software Engineering Daily....

Kafka Applications with Tim Berglund
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout The post Kafka Applications with Tim Berglund appeared first on Software Engineering Daily....


Kafka Applications with Tim Berglund
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout The post Kafka Applications with Tim Berglund appeared first on Software Engineering Daily....

Okta Engineering with Hector Aguilar
A new employee at a software company needs access to a variety of tools. In order to get started working, the employee might need Slack, email, Google Docs, and Amazon Web Services, and all of these require an account with a username and password. Setting up all of these accounts can be time consuming, because The post Okta Engineering with Hector Aguilar appeared first on Software Engineering Daily....

Okta Engineering with Hector Aguilar
A new employee at a software company needs access to a variety of tools. In order to get started working, the employee might need Slack, email, Google Docs, and Amazon Web Services, and all of these require an account with a username and password. Setting up all of these accounts can be time consuming, because The post Okta Engineering with Hector Aguilar appeared first on Software Engineering Daily....


Cloud-Native Applications with Cornelia Davis
Amazon Web Services first came out in 2006. It took several years before the software industry realized that cloud computing was a transformative piece of technology. Initially, the common perspective around cloud computing was that it was a useful tool for startups, but would not be a smart option for large, established businesses. Cloud computing The post Cloud-Native Applications with Cornelia Davis appeared first on Software Engineering Daily....

Talking Python with Michael Kennedy
Python is one of the most popular programming languages in the software world. After working with Python and developing a love for the language, Michael Kennedy started to wonder why there was not a high quality podcast dedicated to covering the community and new technologies of the Python ecosystem. Michael started Talk Python To Me The post Talking Python with Michael Kennedy appeared first on Software Engineering Daily....

MongoDB Data Platform with Andrew Davidson
A new software application has simple requirements for a database.  The database needs to be written to and read from. The database fulfills simple needs such as storing user information and providing the application frontend with the necessary data to render a simple webpage of financial transactions or blog posts. As an application becomes successful, The post MongoDB Data Platform with Andrew Davidson appeared first on Software Engineering Daily....


MongoDB Data Platform with Andrew Davidson
A new software application has simple requirements for a database.  The database needs to be written to and read from. The database fulfills simple needs such as storing user information and providing the application frontend with the necessary data to render a simple webpage of financial transactions or blog posts. As an application becomes successful, The post MongoDB Data Platform with Andrew Davidson appeared first on Software Engineering Daily....

Google Spanner with Deepti Srivastava
Spanner is a globally distributed, transactionally consistent database.  Spanner initially emerged as a paper that came out of Google in 2012. Around this time, database scalability was difficult to solve, even for Google. The Spanner paper offered some breakthroughs in distributed systems which allowed Google to take some of the learnings from BigTable’s eventual consistency The post Google Spanner with Deepti Srivastava appeared first on Software Engineering Daily....

Open Source Policy with Bruce Perens
Open source plays a key role in today’s world of technology businesses. Today, the impact of open source seems obvious. From Kubernetes to distributed databases to cloud providers, so much of our software is powered by open source. But it was not always this way.   Bruce Perens was one of the earliest figures in the The post Open Source Policy with Bruce Perens appeared first on Software Engineering Daily....


JavaScript Jabber with Jeff Meyerson
Host: Charles Max Wood of JavaScript Jabber Joined by Special Guest: Jeffrey Meyerson Jeffrey Meyerson, founder of FindCollabs and host at Software Engineering Daily joins Charles Max Wood for a discussion about latest trends in the developer world, ways of monetizing podcasts, and finding ads for podcasts. Jeffrey shares how he started to host podcasts and how he became The post JavaScript Jabber with Jeff Meyerson appeared first on Software Engineering Daily....

Repl.it: Browser Coding with Amjad Masad
The browser has become the central application of the consumer operating system. Every piece of client software, from email to document management, has become usable through the browser. Even modern desktop software such as Slack is built using Electron, a tool for building client applications that essentially run inside of a browser without an address The post Repl.it: Browser Coding with Amjad Masad appeared first on Software Engineering Daily....

Monday: Business Management Software with Eran Zinman
Modern software is built with cloud services, APIs, and other high level tools. Technical software development is moving beyond the realm of writing code. Individuals who do not have a background in computer science or programming can create increasingly complex tools. Higher level APIs include Twilio for managing phone communications, and Stripe for managing financial The post Monday: Business Management Software with Eran Zinman appeared first on Software Engineering Daily....


Cassandra Business with Jonathan Ellis
Cassandra was initially released in 2008 as a project out of Facebook. Cassandra offered an open source solution to database scalability issues that were being tackled internally by large companies like Amazon, Google and Facebook. 2008 was a golden age of new infrastructure, with systems such as Hadoop and Kafka gaining traction around the same The post Cassandra Business with Jonathan Ellis appeared first on Software Engineering Daily....

DevOps at Delta Air Lines with Jasmine James
Airlines have always had an emphasis on new technology. Over the years, airlines have needed to develop more and more software. Digital transformation is causing every large company to adopt the tools and practices of software companies, and that includes Delta Airlines. Delta Airlines has existed for more than 90 years. Over that period of The post DevOps at Delta Air Lines with Jasmine James appeared first on Software Engineering Daily....

DevOps at Delta Air Lines with Jasmine James
Airlines have always had an emphasis on new technology. Over the years, airlines have needed to develop more and more software. Digital transformation is causing every large company to adopt the tools and practices of software companies, and that includes Delta Airlines. Delta Airlines has existed for more than 90 years. Over that period of The post DevOps at Delta Air Lines with Jasmine James appeared first on Software Engineering Daily....


Facebook Parse Acquisition (Part 2) with Ilya Sukhar
Ilya Sukhar founded Parse in 2011 to make cloud services for mobile developers. Parse was a newer kind of cloud provider called “backend-as-a-service”, built to simplify the complexities of Amazon Web Services and the complexities of the mobile ecosystem.  During this time, Facebook was in the middle of its shift toward becoming a mobile application The post Facebook Parse Acquisition (Part 2) with Ilya Sukhar appeared first on Software Engineering Daily....

Facebook Parse Acquisition (Part 1) with Charity Majors
Parse was a backend-as-a-service company that started in 2011 with the initial focus of making the cloud easier to use for mobile developers. Parse had several novel engineering challenges. In 2011, it was not easy to build on top of AWS, nor was it easy to build within the young mobile ecosystem. Charity Majors was The post Facebook Parse Acquisition (Part 1) with Charity Majors appeared first on Software Engineering Daily....

Facebook Engineering Process with Kent Beck
Kent Beck is a legendary figure in the world of software engineering.  Kent was an early advocate of Test-Driven Development (TDD), and popularized the idea of writing unit tests before writing code that would satisfy those unit tests. A unit test isolates and tests a small piece of functionality within a large piece of software. The post Facebook Engineering Process with Kent Beck appeared first on Software Engineering Daily....


Facebook Release Engineering with Chuck Rossi
When Chuck Rossi joined Facebook in 2008, he was one of the most experienced release engineers at the company. As he began to explore the engineering practices of the organization, he was surprised, confused, and impressed by the release engineering system that he encountered. Release engineering is the process by which software is released to The post Facebook Release Engineering with Chuck Rossi appeared first on Software Engineering Daily....

Facebook Scaling with Pedram Keyani
Facebook is a large multiuser application. Scaling Facebook was different than scaling a single-user application such as an ecommerce store or a search engine. A social network is faced with unique infrastructure scalability challenges, as well as subjective questions around user communications, privacy, and content. Pedram Keyani worked at Google before joining Facebook in 2007. The post Facebook Scaling with Pedram Keyani appeared first on Software Engineering Daily....

Facebook Scaling with Pedram Keyani
Facebook is a large multiuser application. Scaling Facebook was different than scaling a single-user application such as an ecommerce store or a search engine. A social network is faced with unique infrastructure scalability challenges, as well as subjective questions around user communications, privacy, and content. Pedram Keyani worked at Google before joining Facebook in 2007. The post Facebook Scaling with Pedram Keyani appeared first on Software Engineering Daily....


Crypto and OSS with Haseeb Qureshi, Joseph Jacks, and Alok Vasudev
Cryptocurrencies are decentralized monetary systems built on open source software. The open source software movement has evolved from the world of Linux, MySQL, and Apache to a thriving ecosystem of commercial enterprises built around open source software. This ecosystem includes projects such as Kubernetes, MongoDB, and ReactJS. It includes large organizations such as Amazon Web The post Crypto and OSS with Haseeb Qureshi, Joseph Jacks, and Alok Vasudev appeared first on Software Engineering Daily....

Technical Onboarding with Kristen Gallagher
When a new employee joins a software company, it is often unclear where that employee should begin. Do they have a mentor? What are they working on? What are the expectations for how fast that employee should be contributing? The early period of employment is often referred to as “onboarding.” During the onboarding period, an The post Technical Onboarding with Kristen Gallagher appeared first on Software Engineering Daily....

Time Series Databases with Rob Skillington
A time series database is optimized for the storage of high volumes of sequential data across time. Time series databases are often organized as columnar data stores that can write large volumes of data quickly. These systems can sometimes tolerate data loss, because the data they are gathering is used for monitoring and other applications The post Time Series Databases with Rob Skillington appeared first on Software Engineering Daily....


Insurance Software with Gordon Wintrob
Insurance is an old business. Individuals and businesses have been buying insurance policies for decades. These insurance policies can cost hundreds, thousands, or tens of thousands of dollars per year.   Software is remaking the insurance industry. One way new software can improve the insurance industry is through better brokerage technology. Insurance involves carriers and brokers, The post Insurance Software with Gordon Wintrob appeared first on Software Engineering Daily....

Open Source Business Models with Karthik Ranganathan, Heather Meeker, and Matt Asay
Open source software has evolved into a thriving, multifaceted ecosystem. Open source encompasses operating systems and databases. Open source embodies both altruism and self-interest. And open source enables thriving businesses from WordPress blogs to hundred billion dollar cloud providers. There is a large set of business models that can be built around a successful open The post Open Source Business Models with Karthik Ranganathan, Heather Meeker, and Matt Asay appeared first on Software Engineering Dail...

Bitcoin Ecosystem with Andreas M. Antonopoulos
Andreas M. Antonopoulos is the author of several books about cryptocurrency engineering, including Mastering Bitcoin and Mastering Ethereum. In these books, Andreas lays out the systems of economics and computer science that underpin the two most mature decentralized monetary systems. When Andreas originally discovered the Bitcoin whitepaper, he had witnessed the repeated mismanagement of government-backed fiat The post Bitcoin Ecosystem with Andreas M. Antonopoulos appeared first on Software Engineering Da...


Moonlight: Software Contracting Platform with Emma Lawler and Philip Thomas
Software engineers often work as a contractor for some duration of their career. A contractor earns a fixed hourly salary for a defined period of weeks, months, or years. Contract work can be more flexible than full-time work, and often pays more than full-time software engineering, because contract jobs can end at any time, and The post Moonlight: Software Contracting Platform with Emma Lawler and Philip Thomas appeared first on Software Engineering Daily....

Service Mesh Deployment with Varun Talwar
The service mesh abstraction allows for a consistent model for managing and monitoring the different components of a microservices architecture.  In the service mesh pattern, each service is deployed with a sidecar container that contains a service proxy. These sidecars are collectively referred to as the “data plane.” Each sidecar provides the service that it The post Service Mesh Deployment with Varun Talwar appeared first on Software Engineering Daily....

PlayStation Engineering with Tony Godar
The PlayStation is a line of game consoles created by Sony. PlayStation devices include the PS2, PS3, PS4, and the PSP mobile system. Tony Godar worked as an engineer in the PlayStation ecosystem for 15 years, and he joins the show to give a retrospective on his time in the console industry. Developing hardware and The post PlayStation Engineering with Tony Godar appeared first on Software Engineering Daily....


Big Business with Tyler Cowen
Large software companies have become a target for criticism. Google, Facebook, Amazon and other prominent technology giants find themselves under a kind of scrutiny that is reminiscent of banks in 2008 and oil companies in the early 1900s. Across the planet, there is a growing sentiment that “big tech” has too much power, and that The post Big Business with Tyler Cowen appeared first on Software Engineering Daily....

An Elegant Puzzle Virtual Book Club
In this episode Will Larson, author of An Elegant Puzzle: Systems of Engineering Management, speaks with Uma Chingunde of Stripe and Jeff Meyerson of Software Engineering Daily about engineering management. Will was also featured on SE Daily recently. An Elegant Puzzle is an excellent resource on management techniques and strategies for scaling software organizations. Will’s writing draws from The post An Elegant Puzzle Virtual Book Club appeared first on Software Engineering Daily....

a16z Podcasting with Sonal Chokshi
The a16z Podcast is a show that is produced by Andreessen Horowitz, an investment fund based in Silicon Valley. The a16z Podcast covers topics including software engineering, biology, media, cryptocurrencies and entrepreneurship. A16z is one of the most popular podcasts about technology. Sonal Chokshi is the editor in chief at Andreessen Horowitz and the showrunner The post a16z Podcasting with Sonal Chokshi appeared first on Software Engineering Daily....


Data-As-A-Service with Auren Hoffman
Data-as-a-service businesses offer paid access to data sets. These data sets can be useful for building products or training machine learning models.  There has been steady growth in the tools and practices around processing and storing data. But access to data sets remains a bottleneck for widespread development of machine learning applications in a large The post Data-As-A-Service with Auren Hoffman appeared first on Software Engineering Daily....

People.ai: Machine Learning for Sales with Andrey Akselrod
A large sales organization has hundreds of sales people. Each of those sales people manages a set of accounts who they are trying to close sales deals on. Sales people are overseen by managers who ensure that the sales people are performing well. Directors and VPs ensure the scalability and health of the overall sales The post People.ai: Machine Learning for Sales with Andrey Akselrod appeared first on Software Engineering Daily....

Jaeger: Distributed Tracing at Uber with Yuri Shkuro
During 2015, Uber was going through rapid scalability. The internal engineering systems were constantly tested by the growing user base. Over the next two years, the number of internal services at Uber would grow from 500 to 2000, and standardizing the monitoring of all these different services became a priority. After working with a variety The post Jaeger: Distributed Tracing at Uber with Yuri Shkuro appeared first on Software Engineering Daily....


Golden: Intelligent Knowledge Map with Jude Gomila
A knowledge base assembles information from a wide variety of sources into a central platform. The most popular knowledge base is Wikipedia, which covers a wide variety of concepts through a system that attempts to remain authoritative and impartial. Other open knowledge platforms include Stack Overflow, which focuses on programming concepts, and Quora, which adds The post Golden: Intelligent Knowledge Map with Jude Gomila appeared first on Software Engineering Daily....

Career Karma: Coding Bootcamp Platform with Ruben Harris and Artur Meyster
Coding bootcamps allow anyone to become a programmer at a faster pace than the traditional computer science education system. In the last five years, coding bootcamps have grown rapidly in popularity, with thousands of people gaining the necessary skills to work as a software engineer. Career Karma is a platform that allows individuals to find The post Career Karma: Coding Bootcamp Platform with Ruben Harris and Artur Meyster appeared first on Software Engineering Daily....

Hackathons with Jonathan Gottfried
A hackathon is an organized event where participants work together to build a product or tool. Hackathons are about creativity, learning, and exploration. A developer that is participating in a hackathon is often working on something that is outside of their normal day-to-day focus.  Hackathons can provide significant value to the participants. Hackathons have led The post Hackathons with Jonathan Gottfried appeared first on Software Engineering Daily....


TechPrimers: Software Engineering YouTube with Ajay Kumar
Videos play a key role in the continuing education of a software engineer. Video can capture many different types of content that is useful for engineers: conference talks, tutorial videos, and podcast-style interviews are all popular formats of online video. YouTube has become the predominant source for video content about software engineering. The open nature The post TechPrimers: Software Engineering YouTube with Ajay Kumar appeared first on Software Engineering Daily....

WebAssembly on IoT with Jonathan Beri
“Internet of Things” is a term used to describe the increasing connectivity and intelligence of physical objects within our lives.  IoT has manifested within enterprises under the term “Industrial IoT,” as wireless connectivity and machine learning have started to improve devices such as centrifuges, conveyor belts, and factory robotics. In the consumer space, IoT has The post WebAssembly on IoT with Jonathan Beri appeared first on Software Engineering Daily....

Data Mesh with Zhamak Deghani
Data engineering involves numerous tools–a data lake, databases, data warehouses, numerous APIs, streaming systems, and microservices. There is no shortage of ways to interact with data and manage data, but many companies are struggling to figure out design patterns and best practices for how to manage data and build data infrastructure. Zhamak Dehgani is a The post Data Mesh with Zhamak Deghani appeared first on Software Engineering Daily....


Software IPOs with Tomasz Tunguz
Software companies such as Slack, Zoom, and Uber have recently gone public. When a company goes public, they issue a document called an S-1. Within the S-1, there is a wealth of information about the company, providing a detailed story about the company’s business model, economics, and future prospects. The S-1 describes the operating model The post Software IPOs with Tomasz Tunguz appeared first on Software Engineering Daily....

Envoy Mobile with Matt Klein
Envoy is an open source edge and service proxy that was originally developed at Lyft.  Envoy is often deployed as a sidecar application that runs alongside a service and helps that service by providing features such as routing, rate limiting, telemetry, and security policy. Envoy has gained significant traction in the open source community, and The post Envoy Mobile with Matt Klein appeared first on Software Engineering Daily....

TechLitAfrica: Computer Literacy in Africa with Tyler Cinnamon
In the developed world, it is easy to take for granted that we grew up with computers. Technology is so pervasive in the United States that we have debates about how early in child development a human should be given a smartphone. Across much of Africa, there is a shortage of access to computers. Children The post TechLitAfrica: Computer Literacy in Africa with Tyler Cinnamon appeared first on Software Engineering Daily....


Data Engineering with Tobias Macey
The Hadoop ecosystem provided every company with the tools to store and query large amounts of data at a low cost. Since 2005, that ecosystem has expanded with more and more open source applications for data infrastructure.  Data infrastructure includes databases, data lakes, distributed queues, data warehouses, query engines, web applications, on-prem software, closed source, The post Data Engineering with Tobias Macey appeared first on Software Engineering Daily....

Emerging Markets: Vietnam with Charles Lee
From Africa to India to Asia to South America–computer science and programming are rising in popularity in every emerging market. Each of these markets has regional needs for technology. Just like every culture develops its own food and television, every culture needs different types of applications to run their lives. In Vietnam, the day-to-day life The post Emerging Markets: Vietnam with Charles Lee appeared first on Software Engineering Daily....

Facebook GraphQL with Lee Byron
In 2011, Facebook had begun to focus its efforts on mobile development. Mobile phones did not have access to reliable, high bandwidth connections, and the Facebook engineering team needed to find a solution to improve the request latency between mobile clients and the backend Facebook infrastructure. One source of latency was recursive data fetching. If The post Facebook GraphQL with Lee Byron appeared first on Software Engineering Daily....


Facebook Open Source Management with Tom Occhino
Facebook has released open source software projects that have changed the industry. The most impactful projects to date are the React frontend user interface tools: ReactJS and React Native. Before React became popular, there were multiple competing solutions for the dominant frontend JavaScript framework. React became the most prominent because of its invention of JSX, The post Facebook Open Source Management with Tom Occhino appeared first on Software Engineering Daily....

Facebook Data Infrastructure with Dhruba Borthakur
Facebook generates high volumes of data at a rapid pace. Dhruba Borthakur joined Facebook in 2008 to work on data infrastructure. His early projects at Facebook were around Hadoop, the distributed file system and MapReduce computation platform that laid the foundation for the “big data” movement.  At the time, Facebook was generating as much data The post Facebook Data Infrastructure with Dhruba Borthakur appeared first on Software Engineering Daily....

Facebook Engineering Culture with Raylene Yung
Facebook moves fast because of vision, collaboration, and trust. The fast pace of development is enabled by constantly improving infrastructure and a sense of unity throughout the company.  In Facebook’s early days, there was an emphasis on rapidly deploying new code to drive constant improvement and experimentation.  Product quality was maintained by engineers closely checking The post Facebook Engineering Culture with Raylene Yung appeared first on Software Engineering Daily....


Facebook PHP with Keith Adams
Facebook was built using PHP, a programming language that was used widely in the late 90s and early 2000s. PHP allows developers to get web applications built quickly and easily, although PHP has a reputation for being difficult to scale.  In the early days of Facebook, the company was scaling rapidly on every dimension.  New The post Facebook PHP with Keith Adams appeared first on Software Engineering Daily....

Meltano: Data Engineering Lifecycle with Danielle Morrill
Data engineering allows a company to take advantage of the large quantities of data that the company has generated. In many companies, new data has been produced rapidly for many years, but the company has not been able to take full advantage of it.  Creating large data sets does not provide immediate value for a The post Meltano: Data Engineering Lifecycle with Danielle Morrill appeared first on Software Engineering Daily....

Software Media with Charles Max Wood
Software engineers have a wide variety of media to choose from, including podcasts, blogs, YouTube videos, conferences. The amount of software engineering media that is available is growing and accelerating. Eight years ago, there were not as many options for information about software. Charles Max Wood founded Devchat.tv to create a network of podcasts and The post Software Media with Charles Max Wood appeared first on Software Engineering Daily....


gVisor Container Isolation with Michael Pratt and Yoshi Tamura
Software applications running within a host operating system need to be isolated. Isolation prevents security vulnerabilities, such as one application accessing the memory of another. In modern cloud environments, a single physical host might be running multiple virtual machines on top of a hypervisor. Those virtual machines might be divided up into containers. The different The post gVisor Container Isolation with Michael Pratt and Yoshi Tamura appeared first on Software Engineering Daily....

Software Free Radicals with Lior Kanfi
Creating a software company has never been easier. Software engineers are increasingly seeing entrepreneurship as a viable career path. But the path to being an independent software developer is not always clear.  Most engineers spend some of their career working at a software company. Even an engineer who intends to build a company someday can The post Software Free Radicals with Lior Kanfi appeared first on Software Engineering Daily....

Edge Storage with Steve Klabnik
Edge computing allows for faster data access and computation. When your client application makes a request, that request might be routed to the edge. Edge servers are more numerous and more widely distributed than normal data centers, but an edge server might not have all of the data or the complete application logic for the The post Edge Storage with Steve Klabnik appeared first on Software Engineering Daily....


You Are Not A Commodity (Keynote at Tikal Full Stack Tech Radar Day)
Today’s episode is a keynote I gave at Full Stack Tech Radar Day in Tel Aviv. The talk is called “You Are Not a Commodity”. This talk is also available as a YouTube video. The slides can be accessed here. The world of commodity engineering is coming to an end. Developers are becoming more productive, The post You Are Not A Commodity (Keynote at Tikal Full Stack Tech Radar Day) appeared first on Software Engineering Daily....

ListenNotes: Podcast Search Engine with Wenbin Fang
ListenNotes allows users to find podcasts by categories, popularity, and search queries. ListenNotes is not a podcast client that you download onto your phone, but it allows users to build playlists. These playlists are automatically published to an RSS feed, so that users can curate a playlist on desktop and subscribe to that playlist from The post ListenNotes: Podcast Search Engine with Wenbin Fang appeared first on Software Engineering Daily....

Permissionless Innovation with Joseph Jacks
Open source software allows developers to take code from the Internet and modify it for their own use. Open source has allowed innovation to occur on a massive scale. Today, open source software powers our consumer client applications and our backend cloud server infrastructure.  Linux powers single node operating systems and Kubernetes is the foundation The post Permissionless Innovation with Joseph Jacks appeared first on Software Engineering Daily....


Google Earth WebAssembly with Jordon Mears
Google Earth allows users to explore the imagery of the real world. Imagery for Google Earth is taken from satellites, cars equipped with cameras, and other sources. Google Earth renders a data intensive 3-D model of the world on a client application such as a desktop browser or virtual reality system.  WebAssembly is a runtime The post Google Earth WebAssembly with Jordon Mears appeared first on Software Engineering Daily....

FoundationDB with Ryan Worl
FoundationDB is a multi-model distributed key-value store. It is fully ACID compliant and horizontally scalable. FoundationDB is not usually used directly by an application developer–FoundationDB is a foundational building block for higher level distributed systems such as the metadata store for data warehousing tool Snowflake. Ryan Worl is a software engineer who specializes in FoundationDB. The post FoundationDB with Ryan Worl appeared first on Software Engineering Daily....

FindCollabs Hackathon Winners: Kitspace and Rivaly
FindCollabs is a platform for finding collaborators and building projects. Three months ago we had our first hackathon, with lots of projects being created and collaborated on. In an earlier episode, we showcased the first place winner ARhythm.  Today’s show features two more interviews with winners from the first FindCollabs hackathon. Kitspace is an open The post FindCollabs Hackathon Winners: Kitspace and Rivaly appeared first on Software Engineering Daily....


Citus Data: Founding to Acquisition with Umur Cubukcu
A new database company needs to solve numerous problems in order to succeed. There are already lots of existing database companies, so a new company needs to find a way to strongly differentiate itself. Databases are core infrastructure, so a new database company must earn trust with its customers. A database is a complicated distributed The post Citus Data: Founding to Acquisition with Umur Cubukcu appeared first on Software Engineering Daily....

Lambda School Education with Andrew Madsen
Programmers are in high demand, and software engineering is a career path that is fun, creative, and lucrative. There are many people who want to transition into a career in software and are looking for the right path toward writing code. The traditional college computer science curriculum teaches some software engineering skills, but the time The post Lambda School Education with Andrew Madsen appeared first on Software Engineering Daily....

Afresh: Grocery Store Software with Volodymyr Kuleshov
A grocery store contains fruit, vegetables, meat, bread, and other items that can expire. In order to keep these items in stock, the store must be aware of how much food has been sold and what has gone bad. When a food item is low in stock, the store needs to order more of that The post Afresh: Grocery Store Software with Volodymyr Kuleshov appeared first on Software Engineering Daily....


Airflow in Practice with Chaim Turkel
Apache Airflow is a system for scheduling and monitoring workflows for data engineering. Airflow can be used to schedule ETL jobs, machine learning work, and script execution. Airflow also gives a developer a high level view into the graph of dependencies for their data pipelines. Chaim Turkel is a backend data architect at Tikal. He The post Airflow in Practice with Chaim Turkel appeared first on Software Engineering Daily....

Project Management with Kurt Schrader
Software projects are organized and planned using project management software. Examples of project management software include JIRA, Trello, and Asana. There are hundreds of tools for managing a software project because there are infinite ways that a project could be managed. Google Docs changed project management by allowing documents to be easier to share and The post Project Management with Kurt Schrader appeared first on Software Engineering Daily....

Niantic Real World with Paul Franceus
Niantic is the company behind Pokemon Go, an augmented reality game where users walk around in the real world and catch Pokemon which appear on their screen. The idea for augmented reality has existed for a long time. But the technology to bring augmented reality to the mass market has appeared only recently. Improved mobile The post Niantic Real World with Paul Franceus appeared first on Software Engineering Daily....


WebAssembly Compilation with Till Schneidereit
WebAssembly allows for web-based execution of languages other than JavaScript. Programs written in Rust or C++ can be compiled down to WebAssembly and shipped over the browser for on-the-fly execution in a safe, memory controlled environment. WebAssembly has been in development for more than two years, and is still an immature ecosystem because building the The post WebAssembly Compilation with Till Schneidereit appeared first on Software Engineering Daily....

Infrastructure Wars with Sheng Liang
Sheng Liang was the lead developer on the original Java Virtual Machine. Today he works as the CEO of Rancher Labs, a company building a platform on top of Kubernetes. Sheng joins the show to discuss his experiences in the technology industry. The container orchestration wars had many victims. The competing standards for how an The post Infrastructure Wars with Sheng Liang appeared first on Software Engineering Daily....

Kubernetes Operators with Rob Szumski
Kubernetes has made distributed systems easier to deploy and manage. As Kubernetes has become reliable, engineers have started to look for higher level abstractions we can define on top of Kubernetes. An operator is a method of packaging, deploying, and managing a Kubernetes application. Operators are useful for spinning up distributed systems such as Kafka, The post Kubernetes Operators with Rob Szumski appeared first on Software Engineering Daily....


Render: High Level Cloud with Anurag Goel
Cloud computing was popularized in 2006 with the launch of Amazon Web Services. AWS allowed developers to use remote server infrastructure with a simple set of APIs. But even with AWS, it was still not simple to deploy and manage a web application. In 2007, Heroku launched a platform built on top of AWS. Heroku The post Render: High Level Cloud with Anurag Goel appeared first on Software Engineering Daily....

Elegant Puzzle with Will Larson
Software engineering is an art and a science. To manage engineers is to manage artists and scientists. Software companies build practical tools like payment systems, messaging products, and search engines. Software tools are the underpinnings of our modern lives. You might expect this core infrastructure which modern humans rely on to have been constructed with The post Elegant Puzzle with Will Larson appeared first on Software Engineering Daily....

Stripe Machine Learning Infrastructure with Rob Story and Kelley Rivoire
Machine learning allows software to improve as that software consumes more data. Machine learning is a tool that every software engineer wants to be able to use. Because machine learning is so broadly applicable, software companies want to make the tools more accessible to the developers across the organization. There are many steps that an The post Stripe Machine Learning Infrastructure with Rob Story and Kelley Rivoire appeared first on Software Engineering Daily....


Software Businesses with Hiten Shah
The software market changes every year. As individuals and enterprises become more willing to buy software, there are new markets for entrepreneurs to sell software to. Good software has high margins and high retention, so even a niche software business can prove profitable. As software spreads across the world, developing countries are showing a willingness The post Software Businesses with Hiten Shah appeared first on Software Engineering Daily....

Kubernetes Vision with Joe Beda
Google Cloud was started with a vision of providing Google infrastructure to the masses. In 2008, it was not obvious that Google should become a cloud provider. Amazon Web Services was finding success among startups who needed on-demand infrastructure, but the traditional enterprise market was not yet ready to buy cloud resources. Googlers liked the The post Kubernetes Vision with Joe Beda appeared first on Software Engineering Daily....

Kubernetes Storage with Saad Ali
Containers are made to fail gracefully. When your container shuts down due to a hardware or software failure, your distributed application should be able to tolerate that failure. One simple way to be able to tolerate such a failure is to make all of your application logic “stateless.” If your application does not maintain state, The post Kubernetes Storage with Saad Ali appeared first on Software Engineering Daily....


Kubernetes Market with Adam Glick
Amazon Web Services is the leading cloud provider by a large margin. Amazon established its lead by being first to market in 2006, with Google and Microsoft taking several years to catch up to the huge business opportunity of the cloud. Since 2008, Google Cloud has been working on cloud products for developers. It started The post Kubernetes Market with Adam Glick appeared first on Software Engineering Daily....

Service Mesh Interface with Lachlan Evenson
Containers offer a lightweight abstraction for running a server. Cloud providers are able to manage billions of containers from different users, allowing for economies of scale so that each user can pay less. Today, there is a variety of ways that users can deploy containers on a cloud provider. These containers can run in managed The post Service Mesh Interface with Lachlan Evenson appeared first on Software Engineering Daily....

Multicloud Future with Bassam Tabbara
Each cloud provider offers a different set of services which are not always compatible with each other. What are the challenges of building an application that interoperates with multiple different clouds? The first issue is API compatibility. Most cloud providers have a managed SQL offering, a bucket storage system, and server abstractions like virtual machines The post Multicloud Future with Bassam Tabbara appeared first on Software Engineering Daily....


Kubernetes Development with Tim Hockin
Kubernetes has evolved from a nascent project within Google to a thriving ecosystem of cloud providers, open source projects, and engineers. Tim Hockin is a principal software engineer who has been with Google for 15 years. Tim joins the show to talk about the early days of the Kubernetes projects, and the engineering efforts that The post Kubernetes Development with Tim Hockin appeared first on Software Engineering Daily....

Google Anthos with Aparna Sinha
Google’s cloud business was long regarded as a place where startups could build a business, but not established enterprises. For serious workloads, enterprises chose Amazon almost unanimously. This phenomenon of Amazon as the default was described by a phrase that harkened back to the days of IBM’s dominance: “nobody ever got fired for choosing AWS.” The post Google Anthos with Aparna Sinha appeared first on Software Engineering Daily....

Service Mesh Wars with William Morgan
A service mesh is an abstraction that provides traffic routing, policy management, and telemetry for a distributed application. A service mesh consists of a data plane and a control plane. In the data plane, a proxy runs alongside each service, with every request from a service being routed through the proxy. In the control plane, The post Service Mesh Wars with William Morgan appeared first on Software Engineering Daily....


Digital Transformation: Capital One with Hillary McTigue
Cloud computing, open source, and mobile computing are trends that affect every organization. When a large organization adapts to these trends, it is commonly referred to as a “digital transformation”. Digital transformation causes many companies to reframe their business as a software company. A candy manufacturer now must think of itself as a software company The post Digital Transformation: Capital One with Hillary McTigue appeared first on Software Engineering Daily....

Netflix Early Days with Greg Burrell
Netflix started with a DVD-by-mail product. The software infrastructure and operations practices needed for the DVD business were very different from those needed by a streaming video company. Since the early days of Netflix, CEO Reed Hastings knew that the company would evolve to becoming a streaming video platform. But he did not know when The post Netflix Early Days with Greg Burrell appeared first on Software Engineering Daily....

Augmented Reality Gaming with Tony Godar
Augmented reality applications can be used on smartphones and dedicated AR headsets. On smartphones, ARCore (Google) and ARKit (Apple) allow developers to build for the camera on a user’s smartphone. AR headsets such as Microsoft HoloLens and Magic Leap allow for a futuristic augmented reality headset experience. The most prominent use of augmented reality today The post Augmented Reality Gaming with Tony Godar appeared first on Software Engineering Daily....


CamelCamelCamel: Amazon Price Tracker with Daniel Green
CamelCamelCamel is a tool for tracking prices on items on Amazon.com. The company was launched eleven years ago and is built off of the Amazon Product Advertising API. Daniel Green is one of the founders of CamelCamelCamel, and he joins the show to describe his experience building the product. Amazon and CamelCamelCamel (C3) have a The post CamelCamelCamel: Amazon Price Tracker with Daniel Green appeared first on Software Engineering Daily....

Gaming with Eli Brown
Gaming is becoming mainstream. Popular multiplayer games such as Fortnite and Minecraft present players with a massive virtual world to explore, build, and compete within. Turn-based games such as Hearthstone and Magic are breeding a new generation of board game and card game aficionados. Social media networks like Twitch and YouTube have turned gaming into The post Gaming with Eli Brown appeared first on Software Engineering Daily....

Monolithic Repositories with Ciera Jaspan
Google’s codebase is managed in a single monolithic repository. An engineer at Google can explore almost any area of the codebase within the entire company. In order to enable this, Google has built tooling to support the monolithic repo, including a virtual file system and a set of build tools. A monolithic repository is not The post Monolithic Repositories with Ciera Jaspan appeared first on Software Engineering Daily....


Scaling Intuit with Alex Balazs
Alex Balazs is the Intuit Chief Architect and has been working at the company for almost twenty years. Intuit’s products include QuickBooks, TurboTax, and Mint. These applications are used to file taxes, manage business invoices, conduct personal accounting, and other critical aspects of a user’s financial life. Because the applications are managing money for users, The post Scaling Intuit with Alex Balazs appeared first on Software Engineering Daily....

Emerging Markets: Kenya with Nelly Cheboi
Africa is rapidly adopting the same software and hardware technologies that have transformed the western world over the last few decades. But access to computers and technology education is still uneven. Where there is access to computers, smartphone adoption often comes before access to laptops or desktop computers. Nelly Cheboi is the founder of TechLit The post Emerging Markets: Kenya with Nelly Cheboi appeared first on Software Engineering Daily....

Facebook Strategy with Mike Vernal
Facebook’s strategy is shaped by long term goals, short term requirements, and the available resources of the company. Long term goals are necessary for thinking through big decisions such as acquisitions, hardware product investments, and open source software ecosystems. To implement long term goals, Facebook needs to communicate the vision of the company and foster The post Facebook Strategy with Mike Vernal appeared first on Software Engineering Daily....


Facebook React with Dan Abramov
React is a set of open source tools for building user interfaces. React was open sourced by Facebook, and includes libraries for creating interfaces on the web (ReactJS) and on mobile devices (React Native). React was released during a time when there was not a dominant frontend JavaScript library. Backbone, Angular, and other JavaScript frameworks The post Facebook React with Dan Abramov appeared first on Software Engineering Daily....

Facebook Management with Jocelyn Goldfein
Facebook engineering is designed to self-assemble. When an engineer joins Facebook, the engineer goes through boot camp, where they are exposed to multiple projects to find a good fit in terms of technical skills and personal preferences. Since there are so many different initiatives within the company at any given moment, a new hire can The post Facebook Management with Jocelyn Goldfein appeared first on Software Engineering Daily....

Facebook Developers with Nick Schrock
When Facebook was scaling in its early years, the company developed engineering practices that were unlike any other organization before it. Early Facebook engineering developed unusual practices because the problem set was unusual. Facebook was a highly detailed, highly interactive, multi-user web application. Facebook was pushing the limits of PHP and JavaScript in a time The post Facebook Developers with Nick Schrock appeared first on Software Engineering Daily....


Facebook Engineering with Pete Hunt
Facebook engineering is commonly described by two words: move fast. Building products quickly has been a differentiating characteristic of the company since its inception. From the longtime engineers to the summer interns, Facebook instills a sense of immediacy and opportunity in all of its employees. The goal of Facebook is to make the world more The post Facebook Engineering with Pete Hunt appeared first on Software Engineering Daily....

Airtable with Howie Liu
Software engineering is harder than it should be. There are many people who have an app idea that they are not sure how to build. Some of these people are highly technical professionals like real estate agents, scientists, and accountants. These professionals learn to use spreadsheets in their day-to-day work. Spreadsheets are also used widely The post Airtable with Howie Liu appeared first on Software Engineering Daily....

Virtual Data with Sunil Kamath
Relational data systems have evolved from single node instances to complex distributed systems. Almost any database can be accessed through a SQL statement, but the guarantees of these databases can vary in terms of consistency, availability, latency, durability, and financial cost. Relational database systems that explore these different sets of tradeoffs are sometimes categorized as The post Virtual Data with Sunil Kamath appeared first on Software Engineering Daily....


Web Assembly Runtime with Tyler McMullen
WebAssembly is a binary instruction format for applications to run in a memory-constrained, stack-based virtual machine. The WebAssembly ecosystem consists of tools and projects that allow programs in a variety of languages to compile into WebAssembly and run in a safe, fast, sandboxed runtime environment. WebAssembly is a transformative technology for the Internet. Most users The post Web Assembly Runtime with Tyler McMullen appeared first on Software Engineering Daily....

Kubernetes Virtualization with Paul Czarkowski
Modern server infrastructure usually runs in a virtualized environment. Virtual servers can exist inside of a container or inside of a virtual machine. Containers can also run on virtual machines. Kubernetes has allowed developers to manage their multiple containers, whether those containers are running in VMs or on bare metal (servers without VMs). As organizations The post Kubernetes Virtualization with Paul Czarkowski appeared first on Software Engineering Daily....

Cloud Database Workloads with Jon Daniel
Relational databases such as Postgres are often used for critical workloads, such as user account data. To run a relational database service in the cloud requires a cloud provider to set up a highly durable, highly available system. Jon Daniel is an infrastructure engineer at Heroku. Jon joins the show to describe the engineering and The post Cloud Database Workloads with Jon Daniel appeared first on Software Engineering Daily....


Satellite Data Platform with Tim Kelton
Satellite images contain vast quantities of data. By analyzing the contents of satellite images over time, we can identify trends in weather, soil, and agriculture. If we combine that data with ground-level sensors, we can gather a clearer understanding of how chemicals in the air or in the dirt map to how things look from The post Satellite Data Platform with Tim Kelton appeared first on Software Engineering Daily....

Security Monitoring with Jeff Williams
The modern software supply chain contains many different points of distribution: JavaScript frameworks, npm modules, Docker containers, open source repositories, cloud providers, on-prem firmware, IoT, networking proxies, and so much more. With so much attack surface, securing a large enterprise is an uphill battle. Jeff Williams is the CTO at Contrast Security, a company that The post Security Monitoring with Jeff Williams appeared first on Software Engineering Daily....

Software Growth with Greg Kogan
Growing a software business requires an understanding of engineering, sales, and marketing. As we learn software engineering, we also pick up some knowledge about how a business should operate. We know that there are customers, and that our product needs to be scalable to serve more customers. We know that some features are more important The post Software Growth with Greg Kogan appeared first on Software Engineering Daily....


Container Platform Security with Maya Kaczorowski
A Kubernetes instance occupies a wide footprint of multiple servers, creating an appealing target to an attacker, due to its access to a large pool of compute resources. A common attack against an exposed Kubernetes cluster is to take it over for the purposes of mining cryptocurrency. Thus it is important to keep a cluster The post Container Platform Security with Maya Kaczorowski appeared first on Software Engineering Daily....

Lyft’s Data Platform with Li Gao
FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the most helpful The post Lyft’s Data Platform with Li Gao appeared first on Software Engineering Daily....

Cloud with Eric Brewer
RECENT UPDATES: FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the The post Cloud with Eric Brewer appeared first on Software Engineering Daily....


Intricately: Mapping the Internet with Fima Leshinsky
RECENT UPDATES: FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the The post Intricately: Mapping the Internet with Fima Leshinsky appeared first on Software Engineering Daily....

gVisor: Secure Container Sandbox with Yoshi Tamura
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a The post gVisor: Secure Container Sandbox with Yoshi Tamura appeared first on Software Engineering Daily....

Observability Engineering with James Burns
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a The post Observability Engineering with James Burns appeared first on Software Engineering Daily....


Serverless Runtimes with Steren Giannini
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a The post Serverless Runtimes with Steren Giannini appeared first on Software Engineering Daily....

Products with Ryan Hoover
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Products with Ryan Hoover appeared first on Software Engineering Daily....

Facebook OSS License Policy with Joel Marcey, Michael Cheng, and Kathy Kam
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Facebook OSS License Policy with Joel Marcey, Michael Cheng, and Kathy Kam appeared first on Software Engineering Daily....


Drishti: Deep Learning for Manufacturing with Krish Chaudhury
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Drishti: Deep Learning for Manufacturing with Krish Chaudhury appeared first on Software Engineering Daily....

Lyft Data Discovery with Tao Feng and Mark Grover
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Lyft Data Discovery with Tao Feng and Mark Grover appeared first on Software Engineering Daily....

Protein Structure Deep Learning with Mohammed Al Quraishi
RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; The post Protein Structure Deep Learning with Mohammed Al Quraishi appeared first on Software Engineering Daily....


Podsheets: Open Source Podcasting
Podsheets is a set of open source tools for podcast hosting, publishing, ad management, community engagement, and more. Podsheets is influenced by our experience managing Software Engineering Daily, a full-time podcast business. Software Engineering Daily is a podcast that airs 5 times per week. With 4 ads per show and 50 business weeks per year, we The post Podsheets: Open Source Podcasting appeared first on Software Engineering Daily....

Bubbles with Haseeb Qureshi
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Haseeb Qureshi is an entrepreneur and investor. As a teenager, Haseeb played poker professionally through the online poker bubble. His The post Bubbles with Haseeb Qureshi appeared first on Software Engineering Daily....

Consul Service Mesh with Paul Banks
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Consul is a tool from HashiCorp that allows users to store and retrieve information from a highly available key/value data The post Consul Service Mesh with Paul Banks appeared first on Software Engineering Daily....


Machine Learning Joins with Arun Kumar
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Data sets can be modeled in a row-wise, relational format. When two data sets share a common field, those data The post Machine Learning Joins with Arun Kumar appeared first on Software Engineering Daily....

Streaming with Holden Karau
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more Distributed stream processing allows developers to build applications on top of large sets of data that are being rapidly created. The post Streaming with Holden Karau appeared first on Software Engineering Daily....

AWS Storage with Kevin Miller
RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more   A software application requires compute and storage. Both compute and storage have been abstracted into cloud tools that can The post AWS Storage with Kevin Miller appeared first on Software Engineering Daily....


AWS Compute with Deepak Singh
Upcoming event: FindCollabs Hackathon at App Academy on April 6, 2019 On Amazon Web Services, there are many ways to run an application on a single node. The first compute option on AWS was the EC2 virtual server instance. But EC2 is a large abstraction compared to what many people need for their nodes–which is The post AWS Compute with Deepak Singh appeared first on Software Engineering Daily....

Data with Ben Lorica
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Ben Lorica is the chief data scientist at O’Reilly Media and the program director of the Strata Data Conference. In his work, Ben spends time with people across the software industry, giving him The post Data with Ben Lorica appeared first on Software Engineering Daily....

Stablecoins with Rune Christensen
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 A currency can fulfill numerous financial use cases. One use case is store of value: currency holders can reliably expect their currency to maintain some value, though that value may fluctuate over time. The post Stablecoins with Rune Christensen appeared first on Software Engineering Daily....


Operational Analytics with Jad Naous
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Jad Naous is an investing partner with Andreessen Horowitz, where he focuses on infrastructure and analytics. Eight years ago, Andreessen Horowitz (a16z) laid out their thesis that every company was becoming a software The post Operational Analytics with Jad Naous appeared first on Software Engineering Daily....

Blitzscaling with Chris Yeh
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Chris Yeh is an entrepreneur, investor, and author. He co-wrote Blitzscaling with LinkedIn founder Reid Hoffman.   Blitzscaling is a strategy for growing a company that has found product market fit. Blitzscaling prioritizes speed The post Blitzscaling with Chris Yeh appeared first on Software Engineering Daily....

Uber Infrastructure with Prashant Varanasi and Akshay Shah
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Uber’s infrastructure supports millions of riders and billions of dollars in transactions. Uber has high throughput and high availability requirements, because users depend on the service for their day-to-day transportation. When Uber was The post Uber Infrastructure with Prashant Varanasi and Akshay Shah appeared first on Software Engineering Daily....


Workload Scheduling with Brian Grant
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Google has been building large-scale scheduling systems for more than fifteen years. Google Borg was started around 2003, giving engineers at Google a unified platform to issue long-lived service workloads as well as The post Workload Scheduling with Brian Grant appeared first on Software Engineering Daily....

Peloton: Uber’s Cluster Scheduler with Min Cai and Mayank Bansal
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Google’s Borg system is a cluster manager that powers the applications running across Google’s massive infrastructure. Borg provided inspiration for open source tools like Apache Mesos and Kubernetes. Over the last decade, some The post Peloton: Uber’s Cluster Scheduler with Min Cai and Mayank Bansal appeared first on Software Engineering Daily....

Scaling Log Management with Renaud Boutet
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Log management requires the processing and indexing of high volumes of semi-structured data. A log management service takes log data and puts it in a cloud-hosted application so that application operators can access The post Scaling Log Management with Renaud Boutet appeared first on Software Engineering Daily....


Security Businesses with Steve Herrod
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Steve Herrod was the CTO at VMware and now works as a managing director at General Catalyst, where he focuses on investments relating to security. Large enterprises are difficult to secure. An enterprise The post Security Businesses with Steve Herrod appeared first on Software Engineering Daily....

CodeSandbox: Online Code Editor with Bas Buursma and Ives van Hoorne
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Coding in the browser has been attempted several times in the last decade. Building a development environment in the browser has numerous technical challenges. How does the code execute safely? How do you The post CodeSandbox: Online Code Editor with Bas Buursma and Ives van Hoorne appeared first on Software Engineering Daily....

Apache Superset with Maxime Beauchemin
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Data engineering touches every area of an organization. Engineers need a data platform to build search indexes and microservices. Data scientists need data pipelines to build machine learning models. Business analysts need flexible The post Apache Superset with Maxime Beauchemin appeared first on Software Engineering Daily....


FaunaDB with Evan Weaver
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Twitter’s early engineers faced scalability problems that caused infrastructure failures on a regular basis. The infamous “fail whale” could happen as a result of problems in the application servers, the network, or the The post FaunaDB with Evan Weaver appeared first on Software Engineering Daily....

ElasticSearch at Scale with Volkan Yazici
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Bol.com is the biggest e-commerce company in the Netherlands and Belgium. For 20 years, Bol has been developing its software architecture, which includes a variety of services and databases, and a mix of The post ElasticSearch at Scale with Volkan Yazici appeared first on Software Engineering Daily....

Serverless GraphQL with Tanmai Gopal
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Modern web development tools have given frontend developers more power. On the frontend, JavaScript frameworks like React and Vue have become easier to work with. For deployment, tools like Netlify and Zeit give The post Serverless GraphQL with Tanmai Gopal appeared first on Software Engineering Daily....


OSS Businesses with Mike Volpi
Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Red Hat was the first commercial open source software company. For years, investors and entrepreneurs assumed there would never be another Red Hat. Red Hat’s business was built around enterprise operating system distribution The post OSS Businesses with Mike Volpi appeared first on Software Engineering Daily....

Crypto Bubble with Haseeb Qureshi
This is a post written and narrated by Haseeb Qureshi, a cryptocurrency investor and entrepreneur. Haseeb is speaking at an upcoming Software Engineering Daily Meetup. We can safely say the ICO bubble is over now. When the bubble finally popped last year, the “market cap” of all crypto fell over $700B, an 85% drop from The post Crypto Bubble with Haseeb Qureshi appeared first on Software Engineering Daily....

GitLab with Sid Sijbrandij
GitLab is an open source platform for software development. GitLab started with the ability to manage git repositories and now has functionality for collaboration, issue tracking, continuous integration, logging, and tracing. GitLab’s core business is selling to enterprises who want a self-hosted git installation, such as banks or other companies who prefer not to use The post GitLab with Sid Sijbrandij appeared first on Software Engineering Daily....


Linux Kernel Development with Shuah Khan
An operating system kernel manages the system resources that are needed to run applications. The Linux kernel runs most of the smart devices that we interact with, and is the largest open source project in history. Shuah Khan has worked on operating systems for two decades, including 13 years at HP and 5 years at The post Linux Kernel Development with Shuah Khan appeared first on Software Engineering Daily....

Cryptojacking: Bitcoin Malware with Estaban Vargas
Malware is malicious software that makes money for the creator of that software. Malware can appear onto a user’s computer if that user visits a malicious website or installs malicious software by accident. There are many types of malware. Spyware sits on your machine and logs your data in order to sell it. Ransomware can The post Cryptojacking: Bitcoin Malware with Estaban Vargas appeared first on Software Engineering Daily....

Ad Fraud Engineering with Praneet Sharma and Shailin Dhar
Advertising fraud occurs when a brand pays for an advertisement online and that advertisement is shown to an automated bot account that has been created to view ads. Advertising fraud is rampant on the Internet. It’s not possible to know how much money is lost to ad fraud, but the costs are in the billions The post Ad Fraud Engineering with Praneet Sharma and Shailin Dhar appeared first on Software Engineering Daily....


Energy Market Machine Learning with Minh Dang and Corey Noone
The demand for electricity is based on the consumption of the electrical grid at a given time. The supply of electricity is based on how much energy is being produced or stored on the grid at a given time. Because these sources of supply and demand fluctuate rapidly but predictably, energy markets present profit opportunities The post Energy Market Machine Learning with Minh Dang and Corey Noone appeared first on Software Engineering Daily....

Netlify with Mathias Biilmann Christensen
Cloud computing started to become popular in 2006 with the release of Amazon EC2, a system for deploying applications to virtual machines sitting on remote data center infrastructure . With cloud computing, application developers no longer needed to purchase expensive server hardware. Creating an application for the Internet became easier, cheaper, and simpler. As the The post Netlify with Mathias Biilmann Christensen appeared first on Software Engineering Daily....

LinkedIn Monitoring Infrastructure with Alexander Pucher
Monitoring tools are used by every area of an organization. Business development teams use monitoring to understand the metrics for product performance. Finance teams need to understand how the costs of cloud computing resources are changing. Site reliability engineers use monitoring dashboards that applications are up and running without problematic latency. Product managers evaluate the The post LinkedIn Monitoring Infrastructure with Alexander Pucher appeared first on Software Engineering Daily....


WebAssembly Execution with Syrus Akbary
WebAssembly is a runtime that lets languages beyond JavaScript to execute in frontend web applications. WebAssembly is novel because most modern frontend applications are written entirely in JavaScript. WebAssembly lets us use languages like Rust and C++ after they have been compiled down to a web assembly binary module. Language interoperability is only one part The post WebAssembly Execution with Syrus Akbary appeared first on Software Engineering Daily....

Ethereum Usability with Sean Li
Cryptocurrencies enable a large number of applications. Trustless reputation systems, decentralized identity tools, micropayments, non-fungible Internet items, borderless currencies, just to name a few. But cryptocurrencies have not yet impacted daily life, for most of us. Why is that? One reason is that it is still very hard for developers to build within the cryptocurrency The post Ethereum Usability with Sean Li appeared first on Software Engineering Daily....

StarkWare: Transparent Computational Integrity with Eli Ben Sasson
Computational integrity is a property that is required for financial transactions on the Internet. Computational integrity means that the output of a certain computation is correct. If I deposit money into my bank, my bank sends me a number that represents the new balance in my account. I assume that the number they have sent The post StarkWare: Transparent Computational Integrity with Eli Ben Sasson appeared first on Software Engineering Daily....


FindCollabs
Collaboration on the Internet creates innovation. New inventions, new art, and new products–built by people working together on the Internet. FindCollabs is a product we have been working on to enable people to find and collaborate with each other. If you want to try it out, you can go to FindCollabs.com. FindCollabs is for finding The post FindCollabs appeared first on Software Engineering Daily....

Internet History (and Future) with Brian McCullough
The Internet has transformed humanity. The Internet is the result of a long series of innovations from military, academia, business, and the open source community. In his book, How The Internet Happened: From Netscape to the iPhone, Brian McCullough tells the story of the last 25 years of Internet development through the lens of companies The post Internet History (and Future) with Brian McCullough appeared first on Software Engineering Daily....

Ad Fraud Economics with Craig Silverman
Advertising fraud steals billions of dollars every year. BuzzFeed reporter Craig Silverman reports on advertising fraud and its impact on the Internet. In one investigation, Craig uncovered a mobile advertising fraud scheme in which four people stole millions of dollars (perhaps as much as $75 million or even $750 million) by serving advertisements to automated The post Ad Fraud Economics with Craig Silverman appeared first on Software Engineering Daily....


Fake Podcast Charts with Jack Rhysider
Podcast listeners usually find out about a new podcast in one of two ways: either a friend recommends that podcast or the Apple podcast charts rank that new podcast highly. The Apple podcast charts are created using an algorithm that is not public. Many people believe that the chart ranking of a podcast is based The post Fake Podcast Charts with Jack Rhysider appeared first on Software Engineering Daily....

AWS Internet of Things with Dirk Didascalou
Many devices in our world are not “smart.” Air conditioners, electric guitars, power outlets, and factory conveyor belts, just to name a few. There are exciting software applications that we could build around these devices, but we need to be able to interface with them programmatically. We need to be able to know the state The post AWS Internet of Things with Dirk Didascalou appeared first on Software Engineering Daily....

Edge Computing Open Source with Arpit Joshipura
Edge computing refers to computation involving drones, connected cars, smart factories, or IoT sensors. Any software deployment that is not a large centralized server installation could qualify as an edge device–even a smartphone. Today, much of our heavy computation takes place in the cloud–a set of remote data centers some distance away from our client The post Edge Computing Open Source with Arpit Joshipura appeared first on Software Engineering Daily....


React Native Rearchitecture with G2i Team
React Native allows developers to build native applications for iOS and Android using components written in the React JavaScript framework. These ReactJS components render to native application code by going over a JavaScript bridge, a message bus that communicates between JavaScript code and native iOS or Android runtimes. For most mobile application use cases, React The post React Native Rearchitecture with G2i Team appeared first on Software Engineering Daily....

PlanetScale: Sharded Database Management with Jiten Vaidya and Dan Kozlowski
In the early days of YouTube, there were scalability problems with the MySQL database that hosted the data model for all of YouTube’s videos. The state of the art solution to scaling MySQL at the time was known as “application-level sharding.” To scale a database using application-level sharding, you break up the database into shards–disjoint The post PlanetScale: Sharded Database Management with Jiten Vaidya and Dan Kozlowski appeared first on Software Engineering Daily....

Zoox Self-Driving with Ethan Dreyfuss
Zoox is a full-stack self-driving car company. Zoox engineers work on everything a self-driving car company needs, from the physical car itself to the algorithms running on the car to the ride hailing system which the company plans to use to drive around riders. Since starting in 2014, Zoox has grown to over 500 employees. The post Zoox Self-Driving with Ethan Dreyfuss appeared first on Software Engineering Daily....


Store2Vec: DoorDash Recommendations with Mitchell Koch
DoorDash is a food delivery company where users find restaurants to order from. When a user opens the DoorDash app, the user can search for types of food or specific restaurants from the search bar or they can scroll through the feed section and look at recommendations that the app gives them within their local The post Store2Vec: DoorDash Recommendations with Mitchell Koch appeared first on Software Engineering Daily....

Policy Enforcement with Shimon Tolts
The nature of software projects is changing. Projects are using a wider variety of cloud providers and SaaS tools. Projects are being broken up into more git repositories, and the code in those repositories are being deployed into small microservices. With the increased number of tools, repositories, and deployment targets, it can become difficult to The post Policy Enforcement with Shimon Tolts appeared first on Software Engineering Daily....

Ethsimple: Ethereum Tools with Brian Soule
Ethereum allows developers to run decentralized applications. But the tooling for building and managing those decentralized applications is immature. Experienced software engineers have difficulty getting started with writing Ethereum applications because the stack of tools is so unfamiliar and different than traditional software tools. Whether or not Ethereum itself succeeds, developers in the future will The post Ethsimple: Ethereum Tools with Brian Soule appeared first on Software Engineering Daily....


Kubernetes Security with Liz Rice
A Kubernetes cluster presents multiple potential attack surfaces: the cluster itself, a node running on the cluster, a pod running in the node, a container running in a pod. If you are managing your own Kubernetes cluster, you need to be aware of the security settings on your etcd, your API server, and your container The post Kubernetes Security with Liz Rice appeared first on Software Engineering Daily....

Replicated: On-Prem Deployments with Grant Miller
Cloud computing has been popular for less than twenty years. Large software companies have existed for much longer. If your company was started before the cloud became popular, you probably have a large, data center on your companies premises. The shorthand term for this software environment is “on-prem”. Deploying software to your own on-prem servers The post Replicated: On-Prem Deployments with Grant Miller appeared first on Software Engineering Daily....

Uber’s Monitoring Platform with Rob Skillington
Uber manages the car rides for millions of people. The Uber system must remain operational 24/7, and the app involves financial transactions and the safety of passengers. Uber infrastructure runs across thousands of server instances and produce terabytes of monitoring data. The monitoring data is used to understand the health of the software systems as The post Uber’s Monitoring Platform with Rob Skillington appeared first on Software Engineering Daily....


Pachyderm: Data Pipelines with Joe Doliner
Data infrastructure is advancing beyond the days of Hadoop MapReduce, single-node databases, and nightly reporting. Companies are adopting modern data warehouses, streaming data systems, and cloud-specific data tools like BigQuery. Every company with a large amount of data wants to aggregate that data into a data lake and make the data available to developers. All The post Pachyderm: Data Pipelines with Joe Doliner appeared first on Software Engineering Daily....

Knative: Serverless Workloads with Ville Aikas
Infrastructure software is having a renaissance. Cloud providers offer a wide range of deployment tools, including virtual machines, managed Kubernetes clusters, standalone container instances, and serverless functions. Kubernetes has standardized the container orchestration layer and created a thriving community. The Kubernetes community gives the cloud providers a neutral ground to collaborate on projects that benefit The post Knative: Serverless Workloads with Ville Aikas appeared first on Software Engin...

VMware Kubernetes Strategy with Brad Meiseles
Virtualization software allows companies to get better utilization from their physical servers. A single physical host can manage multiple virtual machines using a hypervisor. VMware brought virtualization software to market, creating popular tools for allowing enterprises to deploy virtual machines throughout their organization. Containers provide another improvement to server utilization. A virtual machine can be The post VMware Kubernetes Strategy with Brad Meiseles appeared first on Software Engineering...


Cadre: Automated Investing with Leonid Movsesyan
Real estate is an asset that is not straightforward to invest in. Real estate can generate excellent returns for investors, but can require much more time and expertise than stocks. Cadre is a company that allows users to invest in real estate more easily and intelligently. Cadre provides users with lots of data about potential The post Cadre: Automated Investing with Leonid Movsesyan appeared first on Software Engineering Daily....

RocksDB with Dhruba Borthakur and Igor Canadi
RocksDB is a storage engine based on the log-structured merge tree data structure. RocksDB was developed at Facebook to provide a tool for embedded databases. The code for RocksDB is a fork of LevelDB, an embedded database built by Google for the Chrome browser. Every database has a storage engine. The storage engine is the The post RocksDB with Dhruba Borthakur and Igor Canadi appeared first on Software Engineering Daily....

Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto
HashiCorp was founded seven years ago with the goal of building infrastructure tools for automating cloud workflows such as provisioning, secret management, and service discovery. Hashicorp’s thesis was that operating cloud infrastructure was too hard: there was a need for new tools to serve application developers. Hashicorp founders Mitchell Hashimoto and Armon Dadgar began releasing The post Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto appeared first on Software Engineering Daily....


Engineering Philosophy with Tyler Cowen
Tyler Cowen’s book Stubborn Attachments outlines a framework that individuals can use to make decisions grounded in economic philosophy. In his previous books, Tyler examined recent economic history. Stubborn Attachments gives his perspective for navigating the future. Tyler is a professor of economics at George Mason University. He is also the host of Conversations with The post Engineering Philosophy with Tyler Cowen appeared first on Software Engineering Daily....

Architects of Intelligence with Martin Ford
Artificial intelligence is reshaping every aspect of our lives, from transportation to agriculture to dating. Someday, we may even create a superintelligence–a computer system that is demonstrably smarter than humans. But there is widespread disagreement on how soon we could build a superintelligence. There is not even a broad consensus on how we can define The post Architects of Intelligence with Martin Ford appeared first on Software Engineering Daily....

Anatomy of Next: New World with Mike Solana
Mars is a cold, inhospitable planet far from earth. It presents one of the most complex challenges faced by engineers: how can we create a new world? To create a new world, first we have to get there. We can build new rockets with improved propulsion systems. We can build ships that allow us to The post Anatomy of Next: New World with Mike Solana appeared first on Software Engineering Daily....


Likewar: The Weaponization of Social Media with P.W. Singer
Social media has transformed our lives. It has also transformed how wars are fought. P.W. Singer’s new book “Likewar: The Weaponization of Social Media” describes the far-reaching impact of social media on the tactics and strategies used by military, business, and everyday citizens. We have all read about stories such as Russian bots and Cambridge The post Likewar: The Weaponization of Social Media with P.W. Singer appeared first on Software Engineering Daily....

Software Chasms with Martin Casado
Infrastructure software can be a great business. An infrastructure software company sells core technology to a large enterprise such as a bank or insurance company. This software has near zero marginal cost and generates a large annuity for the infrastructure software company. Once a bank has purchased your infrastructure software, the bank is likely to The post Software Chasms with Martin Casado appeared first on Software Engineering Daily....

Kubeflow: TensorFlow on Kubernetes with David Aronchick
When TensorFlow came out of Google, the machine learning community converged around it. TensorFlow is a framework for building machine learning models, but the lifecycle of a machine learning model has a scope that is bigger than just creating a model. Machine learning developers also need to have a testing and deployment process for continuous The post Kubeflow: TensorFlow on Kubernetes with David Aronchick appeared first on Software Engineering Daily....


TiDB: Distributed NewSQL with Kevin Xu
When a user interacts with an application to order a ride with a ridesharing app, the data for that user interaction is written to a “transactional” database. A transactional database is a database where specific rows need to be written to and read from quickly and consistently. Speed and consistency are important for applications like The post TiDB: Distributed NewSQL with Kevin Xu appeared first on Software Engineering Daily....

Storybook: UI Engineering with Zoltan Olah
React, Vue, and Angular are the most popular frontend JavaScript frameworks. Each of these frameworks lets frontend developers build components. A component is a high level visual abstraction that is used to compose a user interface. Frontend development has moved towards component-driven-development. At a typical technology company, a designer will put together a design file The post Storybook: UI Engineering with Zoltan Olah appeared first on Software Engineering Daily....

RSocket: Reactive Streaming Service Networking with Ryland Degnan
Netflix has thousands of service instances communicating with each other. When a Netflix client on a smartphone makes a request for a movie, that request hits Netflix’s backend, where the request is fulfilled by a chain of requests through different services. Services and clients communicate using several different interaction patterns. A service might send a The post RSocket: Reactive Streaming Service Networking with Ryland Degnan appeared first on Software Engineering Daily....


Prometheus Scalability with Bryan Boreham
Prometheus is an open source monitoring system and time series database. Prometheus includes a multi-dimensional data model, a query language called PromQL, and a pull model for gathering metrics from your different services. Prometheus is widely used by large distributed systems deployments such as Kubernetes and Cloud Foundry. Prometheus gathers metrics from your services by The post Prometheus Scalability with Bryan Boreham appeared first on Software Engineering Daily....

Spot Instances with Amiram Shachar
When a developer provisions a cloud server, that server is called an “instance”. These instances can be used for running whatever workload a developer has, whether it is a web application, a database, or a set of containers. The cloud is cheap to get started on. New applications with few users can often be hosted The post Spot Instances with Amiram Shachar appeared first on Software Engineering Daily....

Looker: Business Intelligence Platform with Daniel Mintz
If a business has been operating successfully for a few years, that business has accumulated a high volume of data. That data exists in spreadsheets, CSV files, log files, and balance sheets. Data might be spread across local files on a user’s laptop, databases in the cloud, or storage systems in an on-premise data center. The post Looker: Business Intelligence Platform with Daniel Mintz appeared first on Software Engineering Daily....


Human Sized Robots with Zach Allen
Robots are making their way into every area of our lives. Security robots roll around industrial parks at night, monitoring the area for intruders. Amazon robots tirelessly move packages around in warehouses, reducing the time and cost of logistics. Self-driving cars have become a ubiquitous presence in cities like San Francisco. For a hacker in The post Human Sized Robots with Zach Allen appeared first on Software Engineering Daily....

Notebooks at Netflix with Matthew Seal
Netflix has petabytes of data and thousands of workloads running across that data every day. These workloads generate movie recommendations for users, create dashboards for data analysts to study, and reshape data in ETL jobs, to make it more accessible across the organization. Over the last ten years, data engineering has become a key component The post Notebooks at Netflix with Matthew Seal appeared first on Software Engineering Daily....

Kubernetes in China with Dan Kohn
Chinese Internet companies operate at a massive scale. WeChat has over a billion users and is widely used as the primary means of payment by urban Chinese consumers. Alibaba ships 12 million packages per day, which is four times the amount of Amazon. JD.com, a Chinese ecommerce company, has perhaps the largest production Kubernetes installation The post Kubernetes in China with Dan Kohn appeared first on Software Engineering Daily....


AWS Analysis with Corey Quinn
Amazon Web Services changed how software engineers work. Before AWS, it was common for startups to purchase their own physical servers. AWS made server resources as accessible as an API request, and has gone on to create higher-level abstractions for building applications. For the first few years of AWS, the abstractions were familiar. S3 provided The post AWS Analysis with Corey Quinn appeared first on Software Engineering Daily....

Zeit: Serverless Cloud with Guillermo Rauch
Serverless computing is a technique for deploying applications without an addressable server. A serverless application is running on servers, but the developer does not have access to the server in the traditional sense. The developer is not dealing with IP addresses and configuring instances of their different services to be able to scale. Just as The post Zeit: Serverless Cloud with Guillermo Rauch appeared first on Software Engineering Daily....

Cloud Events with Doug Davis
Functions-as-a-service allow developers to run their code in a “serverless” environment. A developer can provide a function to a cloud provider and the code for that function will be scheduled onto a container and executed whenever an event triggers that function. An “event” can mean many different things. It is a signal that something has The post Cloud Events with Doug Davis appeared first on Software Engineering Daily....


Multicloud with Ben Hindman
Most applications today are either deployed to on-premise environments or deployed to a single cloud provider. Developers who are deploying on-prem struggle to set up complicated open source tools like Kafka and Hadoop. Developers who are deploying to a cloud provider tend to stay within that specific cloud provider, because moving between different clouds and The post Multicloud with Ben Hindman appeared first on Software Engineering Daily....