Managing Serverless Costs With Kubernetes (DeveloperWeek Global 2020)

Learn how to effectively manage serverless costs with Kubernetes, optimize serverless functions and containers for high-throughput workloads, and achieve cost savings and improved efficiency.

Key takeaways
  • Serverless functions can be cost-effective, but can also be limited by cold starts, which can lead to decreased performance and increased costs.
  • Using serverless containers can help alleviate cold start limitations by allowing multiple invocations to run concurrently on a single instance.
  • Serverless containers are often misused, as users may over-allocate resources to avoid instance killing, leading to wasted spending.
  • Serverless functions can be throttled to reduce costs, leading to increased savings and more efficient use of resources.
  • Kubernetes-enabled serverless containers can help manage costs by automatically scaling and provisioning resources.
  • Serverless functions can be used as a good solution for predictable workloads, while serverless containers are better suited for unpredictable workloads.
  • Using a managed Kubernetes service can further reduce costs and improve efficiency by automatically managing infrastructure and scaling.
  • Throttling and limiting invocations can help reduce costs and improve resource utilization.
  • Serverless functions can be used to run containerized applications by packaging code into a container and running it using a serverless framework.
  • Serverless containers can be used with managed Kubernetes services to achieve cost savings and improved efficiency.
  • The cost of serverless functions is billed per invocation, while the cost of serverless containers is billed per instance and per invocation.
  • Serverless containers can be used to run multiple concurrent invocations on a single instance, making them more cost-effective for high-throughput workloads.
  • Kubernetes-enabled serverless containers can automatically scale and provision resources, making them a good solution for unpredictable workloads.
  • Throttling and limiting invocations can help reduce costs and improve resource utilization, but may require careful monitoring to ensure optimal performance.
  • Serverless functions can be used to run RESTful APIs without deploying any web servers.
  • Serverless containers can be used with managed Kubernetes services to achieve cost savings and improved efficiency, but may require careful configuration to ensure optimal performance.