Data Engineer

ConsenSys

ConsenSys is a venture production studio and the leading technology firm in blockchain globally. We deliver products, solutions and platforms built using blockchain technology to transform how business is done in a complex network of buyers, suppliers and consumers. Our teams are busy at work building the future of identity, financial markets, commerce, the music industry, security, infrastructure and more. To accomplish this we've built out a flat organizational structure which we call the ConsenSys Mesh: a network of individuals & teams working autonomously towards the same goal. Our mission is to use these decentralized solutions to fundamentally reshape the economic, social, and political operating systems of the planet. Are you passionate about decentralizing our future and taking control of how we evolve? Then join us! We are seeking passionate, determined and resilient individuals who thrive in a self-directed, collaborative culture. Our technology is transforming global society and humanity - we welcome you to this exciting opportunity.

About Infura

Infura’s development suite provides instant, scalable API access to the Ethereum and IPFS networks. Our world-class infrastructure ensures that developers can reliably scale their decentralized application to meet user demand. It’s powered by a cutting-edge microservice-driven architecture that dynamically scales to support our APIs.  Thousands of developers are actively using Infura every day and we process billions of events per day! The strength, reliability and stability of Infura’s infrastructure service makes the brand an essential pillar of the Ethereum ecosystem and the leading blockchain infrastructure provider.

Job Responsibilities: A day in the life of a Data Engineer

Infura is building a data platform to serve the needs of data scientists, business analysts, and end users. You will be collaborating with the product organization, data scientists, and business analysts to build both the underlying platform as well as data pipelines. Data pipelines will encompass both large-scale batch processing as well as real-time / stream data pipelines. You will design, develop, and operate data integration pipelines to provide high quality datasets for end user, analytical, and machine learning use-cases. You will bring a deep understanding of software engineering best practices, such as proper use of source control, end to end testing process, and automated deployment mechanism to build a high quality data platform. While we have existing systems that require support and maintenance, you will also provide expertise to multiple teams at Infura by acting as a subject matter expert on best practices, tooling, and data engineering practices.

Required Skills

First and foremost, we want our data engineers to be great software engineers with a passion for writing high quality code. You appreciate agile software processes, data-driven development, reliability, and responsible experimentation. The ability to be pragmatic and articulate tradeoffs between a perfect solution and a working solution will make you successful in this role. The ideal candidate will have strong experience with various OLTP and OLAP databases, row and columnar oriented storage formats, ELT vs ETL processing, data lakes, and data warehousing.  Using strong programming skills in a language such as Python, Scala, Java, or Go, you have built production quality ETL pipelines at scale using Spark, Hadoop or similar framework. Ideally, you will have worked with modern data stores: AWS S3 based data lakes, AWS Redshift, or Snowflake. We are looking for a senior level candidate that can understand requirements, work autonomously, and communicate effectively. If taking ownership of scoping problems and delivering pragmatic solutions sounds interesting, this is the role for you

Bonus points for:

We use Druid, so any practical experience with this would be a bonus. Deep experience with data engineering in the AWS ecosystem, experience with orchestration tools (such as Airflow) or experience with infrastructure management tools such as terraform is beneficial. If you don’t check these boxes, don’t sweat it. We’d love to hear from you.

Perks of the Mesh

• A dynamic startup environment. ConsenSys is a leader with vision in the blockchain space and we are absorbing a significant portion of the attention. This is both exciting and challenging, as we learn to scale our organization while adhering to the principles of decentralization.
• Unlimited vacation
• Decentralized culture. We offer a new way of structuring an organization: holacratic (non-hierarchical) meaning you are free from hierarchical restraints, working in an environment that truly encourages all levels of collaboration.
• Remote work
• Global reach. Connect with brilliant minds across 6 continents as we continue to grow and build a diversified culture.

Opportunities for the Decentralized Future

• The forefront of a revolution. At ConsenSys we fundamentally believe that the next generation of technology presents an opportunity to craft a more just and equitable society.
• Continuous learning. You’ll be constantly exposed to new languages, frameworks and ideas from your peers and as you work on different projects -- challenging you to stay at the top of your game.
• Deep technical challenges. The entire ecosystem is about 10 years old. Ethereum itself is still a toddler. For these platforms to scale to the order of millions or billions of users we have much work ahead. The team at ConsenSys is building technology platforms that can get us to those next thresholds of scale.
• Entrepreneurial opportunities. We are always encouraging our community to push the boundaries with innovative dApps.

Click here for the latest updates from ConsenSys. ConsenSys is an equal opportunity employer. All employment decisions are made without regard to race, color, national origin, ancestry, sex, gender, gender identity or expression, sexual orientation, age, genetic information, religion, disability, medical condition, pregnancy, marital status, family status, veteran status, or any other characteristic protected by law. #LI-CB1

Benefits

Competitive benefits

We have a comprehensive and competitive benefits package to make sure we’re looking after you and what matters most.

Equity

We believe in ownership and want everyone to have a stake in our future success, that’s why you’ll receive equity when you join us.

Recognized in the blockchain and Web3 ecosystem

Working at ConsenSys is a tremendous reference for your career. You’ll join a network of entrepreneurs and technologists that extends across the global crypto ecosystem.

Continuous learning & opportunities

We provide ongoing growth and development through on-the-job learning, and the ConsenSys Advance Program which includes full access to Coursera, bespoke and technical learning programs and ConsenSys Academy our world-class blockchain and Ethereum program.

Unlimited vacation/holidays

We value downtime to recharge and reset, ensuring everyone at ConsenSys has work/life balance. In addition, company-wide we participate in “zero productivity” days to take a break from work, shut down, and sit back and relax.

Flexible working arrangements

With our global workforce we have fine-tuned asynchronous working which means we have a lot of flexibility in the structure of when we work and how we work together.

Remote first

You’ll be joining a team based all over the world. Providing the unique opportunity to work with people from across 6 continents.