This job might no longer be available.
Data Platform Engineer - Technical Lead
4 years ago
About the Team
Data Engineering has a significant part in all of our strategic efforts and decisions at Wildlife. Our mission is to provide our company with complete, secure, reliable, high quality and highly available data. To accomplish this mission we are looking for engineers to help us to develop cutting-edge Data Science infrastructure. We love working with large datasets, low latency data systems and complex business logic.
About the Role
At Data Platform we are focused on providing the interfaces between our computational resources and the people willing to use it to process data. Our current tech stack for data processing is Hadoop (MR), Hive, Presto and Spark, the challenge here is dealing with +1PB of historical data and Spark streaming for near real-time processing with a volume around 200k RPM. For this role what we want is to make happen that our stakeholders have all the tools and services they need to seamlessly extract, ingest, transform, load and consume data.
More about you
- Leadership capabilities, leading development activities, a team player and a mentor for other team members
- Enjoy working with complex business logic and deal with large scale to build low latency systems;
- Smart and creative, both, you have the ability and persistence to solve problems, big and small. Curious by nature, you're constantly looking for ways to improve upon things;
- Demonstrate critical thinking and problem-solving capabilities both independently and collaboratively;
- You're flexible, fearless, and excited to help build something;
- You're hands-on, in the right ways; willing and able to do what's needed, no matter the task.
What you'll do
- Lead technically a team of Data Platform Engineers, provide them with relevant inputs to reduce risks of their projects;
- Promote best practices coding, standards and design patterns;
- Mentor and coach junior team members to elevate their technical skills and help them grow
- Working proactively and closely with data scientists on the various group projects developing tools for data exploration and feature engineering pipelines;
- Work proactively with our cloud infrastructure team and propose new solutions to ingest data;
What you'll need
- BS in Computer Science or a related field
- At least 5 years of experience as a Data engineer
- At least 2 years of experience with Spark
- Strong experience with Python, Scala, Java (at least two);
- Know how to design and code REST APIs;
- You have experience with real-time technologies like Kafka, Kinesis, Storm or Spark Streaming;
- Experience with the state of the art of software engineering development practices (scrum, unit tests, CI/CD and deployment automation);
- Experience prioritizing and developing several projects simultaneously;
- Experience with orchestration frameworks like airflow.
We welcome people from all backgrounds who seek the opportunity to help build the best gaming company, where everyone thrives.
Create Your Profile — Game companies can contact you with their relevant job openings.