Why Most Data Projects Fail & How to Avoid It • Jesse Anderson • GOTO 2023

Jesse Anderson

Explore the common pitfalls that lead to failed data projects and learn how to avoid them by implementing successful strategies for data science and engineering.

Key takeaways
  • 85% of data projects fail
  • Wrong ratio of data scientists to data engineers (1:1 instead of 5:1)
  • Importance of clear goals and definition of success
  • Need for people with specialized skills
  • Importance of organization and communication
  • Organizational change required
  • Avoid blindly following vendors
  • Need for accountability and measurable return on investment (ROI)
  • Data projects require plan and execution
  • Success is correlated with having the right people and definitions
  • Care should be taken when selecting data engineers
  • Multiple teams and skills required for success
  • Value creation is a people change, not just a technical one

More talks

Angular Community Meetup | Aug 22nd, 2023 | Dan Wahlin, Tony Alicea, & Joe Skeen Dan Wahlin Giuditta Parolini - The Hell, According to a Data Scientist | PyData Global 2023 Giuditta Parolini "The Vera C. Rubin Observatory Legacy Survey of Space and Time" by Andrés Plazas Malagón Andrés Plazas Malagón How non-violent Communication can help keep the Peace on your Team | Casie Siekman Casie Siekman Pairing, Sharing, Caring - One team's journey to Pair Programming - Mark Bradley Mark Bradley Too many ideas, too little data | Markus Nutz & Thomas Pawlitzki | ML Conference 2018 Markus Nutz & Thomas Pawlitzki Anniversary Edition of The Pragmatic Programmer • Dave Thomas & Andy Hunt Dave Thomas & Andy Hunt Tackling Burnout in theIT Industry • Sonia Cuff • YOW! 2018 Sonia Cuff