Sr. Data Engineer

Upwork has partnered with an Enterprise client that specializes in helping businesses across all industries modernize through cloud adoption to achieve data-driven transformation. Their team of experts leverages the latest Google Cloud technologies and best practices to create customized solutions for each client.

They are currently looking to partner with a Senior Data Engineer who will design, develop, maintain, and test data pipelines and infrastructure that enable efficient, secure, and scalable data processing and analysis. This project will last roughly 3 months and require 40 hours a week to support a specific client project.

Responsibilities

• Work with large, complex data sets and high throughput data pipelines that meet business requirements.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
• Build data and analytics tools that utilize the data pipeline to provide actionable insights into operational efficiency.

Requirements

• Previous experience as a Senior Data Engineer.
• Experience with Spark Streaming is required.
• 5+ years of Python development experience is necessary.
• Hands-on experience with database technologies (e.g. SQL and MongoDB).
• Experience with machine learning techniques.
• Great numerical and analytical skills
• Ability to write reusable code components.
• Degree in Computer Science, IT, or similar field.

Nice to Have/ Not Required:

Understanding Blockchain system mechanism

What’s in it for you?

• Work with an incredible team
• 100% remote (work anywhere you want)