Working experience with Python, Pandas. Prior experience with Luigi is a plus.
Working experience with Scala and Airflow is a big plus.
Familiarity with Google Cloud Platform (e.g. GCS and BigQuery) is a plus.
Working experience with Dimensional Modeling and Rails is a plus.
Familiarity with the basic principles of distributed computing and data modeling.
Extensive experience with object-oriented design and coding and testing patterns, including experience with engineering software platforms and data infrastructures.
Familiarity with functional programming concepts is a plus.
Outstanding communication and interpersonal skills.
Be excited about collaborating daily with your team and other groups while working via a distributed model.
Be eager to help your teammates, share your knowledge with them, and learn from them.
Be open to receiving constructive feedback.
You must be a world-class individual contributor to thrive at Toptal.
Build scalable, highly performant infrastructure for delivering clear business insights from a variety of raw data sources.
Develop batch & real-time analytical solutions, prototypes, and proofs of concept for selected solutions.
Implement complex analytical projects with a focus on collecting, managing, analyzing, and visualizing data.
Build frameworks and tools to empower our data scientists and analysts.
Be in constant communication with team members and other relevant parties and convey results efficiently and clearly.
At Toptal, we measure everything and always rely on data to guide all of our initiatives, including both our long-term strategy and our day-to-day operations.
As a Data Engineer, your main goal is to be one step ahead of data scientists and analysts and support them by providing infrastructure and tools they can use to deliver end-to-end solutions to business problems that can be developed rapidly and maintained easily. This is more than building and maintaining ETL pipelines. We need innovation, creativity and solutions that will have a significant impact on our velocity. We, in turn, will give you autonomy and freedom to turn your ideas into reality.
Please let Toptal know you found this job on Remote Only as a thank you to us! 👌