ElixirConf 2023 - Katelynn Burns - Motion Commotion: Motion Tracking with Bumblebee and LiveView

Discover how Katelynn Burns uses Bumblebee and LiveView for motion tracking, exploring techniques like contouring, thresholding, and Gaussian blur to create a smooth motion tracking experience.

Key takeaways
  • Bumblebee is a machine learning library in Elixir that allows for pre-trained models to be used in applications.
  • LiveView is a framework in Elixir that provides a way to create interactive web applications.
  • Contouring is a technique used in image processing to highlight the edges of an object.
  • Thresholding is a technique used to remove background noise from an image.
  • Gaussian blur is a technique used to smooth out an image.
  • Can you prevent the algorithm from getting overwhelmed by limiting the number of objects being tracked?
  • If you can’t see the object, the algorithm will try to track it anyway.
  • You can use Bumblebee’s image classification function to classify an image frame by frame.
  • You can use the eVision library to capture and process video frames. NX is the framework in which Bumblebee is built on. There are many dependencies and assumptions that need to be made when building an application that uses machine learning. The speaker has no affiliation with Wistr Holdings, but was a keynote speaker at ElixirConf. The speaker is more focused on the motion tracking aspect rather than the video manipulation. The speaker is exploring the use of Bumblebee for motion tracking due to its ease of use and compatibility with Elixir. The speaker has already written a function in Python to classify an image frame by frame and has been experimenting with Elixir. The speaker is creating a motion tracking application using Bumblebee and LiveView. The speaker is encouraging others to explore and experiment with Bumblebee and Elixir.