Lead Data Engineer

At Cast & Crew, we’ve empowered creativity and supported the global entertainment industry for decades. Together with our family of brands - Backstage, CAPS, Checks & Balances, Final Draft, Media Services, Sargent-Disc, and The TEAM Companies – we operate as a combined entertainment technology and services provider offering industry standard screenwriting accounting software, digital payroll products, data & reporting, and a host of creative tools.  The industry continues to move faster than ever, and the need for our expertise, our technology, and our people has never been greater.  We are a production’s best ally every step of the way. #OneCastOneCrew

About Cast & Crew 
We grew from a modest small business in 1976 to be the premiere provider of entertainment technology and solutions, staying true to our mission of modernizing content production and leading the digital transformation within the industry. Our cloud-based solutions and industry expertise help streamline the entire production lifecycle and have revolutionized how content is made. We now have a global workforce across a host of storied brands, spanning all areas of produced and live entertainment, from film, television, streaming, to advertising, live events, and short-form. 

Lead Data Engineer                                                                                                                                   

Position Overview

A Lead Data Engineer will play a crucial role in turning vast amounts of complex data into valuable insights that will drive business decisions and innovation. You will work closely with cross-functional teams, including engineers, analysts, and business stakeholders, to identify opportunities, design experiments, build predictive models, feature engineering, and develop data-driven solutions. The ideal candidate should have a strong background in statistics, machine learning, programming, and data analysis, along with excellent communication and problem-solving skills. A background in financial systems is a plus, as is development experience in an iterative, Agile/SCRUM environment.

Responsibilities

• Analyze large, complex datasets to identify patterns, trends, and insights that can be used to enhance business strategies and decision-making processes
• Design and implement statistical models, machine learning algorithms, feature engineering, and data mining techniques to develop predictive models and extract actionable insights from data
• As a lead data engineer, implement large, complex enterprise data solutions from the ground up to drive innovation
• Recommend new technologies, tools and standards to improve efficiency and productivity
• Research, POC, test, and implement new technologies to support the application and data solutions architecture.
• The core skill set will be centered around data science, data engineering, machine learning, AI modeling: Python, SQL, Spark, Snowflake, JavaScript, visualizations, and cloud computing
• Review and audit design solution, and mentor software engineers.
• Other duties as assigned.

Qualifications

• Excellent communication and teamwork skills
• 7+ years hands-on experience in Python or R
• 7+ years of experience in SQL, Spark, Airflow, data modeling, and ETL/Data pipeline
• 3+ years of hands-on experience in data visualization using tools like Tableau, Power BI
• 3+ years of experience in machine learning and feature engineering
• Solid hands-on cloud computing experience (AWS, Microsoft Azure, GCP)
• Solid experience using event and data streaming tools such as Apache Kafka, Kinesis or any related technology
• Solid experience in troubleshooting and debugging is critical.
• Solid experience designing and building data APIs
• Experience using frontend technologies such HTML5/CSS, JavaScript is a plus
• Solid experience in Agile/SCRUM development methodologies and best practices

Special Work Conditions    

Sedentary – Involves sitting most of the time but may involve walking or standing for brief periods of time. Some positions may entail exerting up to 15 lbs. of force occasionally and/or a negligible amount of force to lift, carry, push, or pull.

Compensation is commensurate with various factors including, but not limited to, relevant experience, qualifications, skills, training, licensure, certifications, geographic cost of labor, and other business and organizational needs. Compensation range for candidates in other locations may differ based on the cost of labor in that location.The compensation range for this position is:$150,000—$170,000 USD

Benefits 

Cast & Crew provides a comprehensive package of employee benefits including: Medical, Dental, Vision, PTO, health and wellness programs, employee discounts, and more! Note: Cast & Crew benefits are subject to eligibility requirements. 

Due to the high volume of applicants, it is likely that only shortlisted candidates will be contacted.  

CA residents: Your personal information may be collected in connection with certain services provided by Cast & Crew or its affiliated companies.  A summary of your California privacy rights can be found at: https://www.castandcrew.com/privacy-policy/  

Cast & Crew is an equal opportunity employer committed to hiring a diverse workforce and sustaining an inclusive culture. It is our policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.