Senior Data Engineer

Department: Engineering
Experience: Middle Senior
Technologies: Python
Client: Patch.com
Special referral bonus: No
Hot position?: Hot
Work model: Remote

Qualifications

  • Data engineering/architecture/warehousing experience in Google Cloud
  • Experience implementing production Google analytics platforms
  • The ability to apply the above to solve business problems using one or more Google Cloud data services in combination with building data pipelines, data streams, and system integration
  • Familiarity with tools like Tableau, Looker, Data Studio, Power BI or other cloud data/BI tools
  • Proficient in Python

Requirements:

  • Knowledge with ETS, SQL, GCP, Spark. …
  • Knowledge of Business Intelligence and Data Warehousing best practices, including Data Cataloging, Data Security and Data Quality
  • Proven passion for everything you build to be elegant and maintainable, in architecture and implementation
  • Intuition for and experience in design of highly fault-tolerant architecture of loosely-coupled services
  • Strong individual contributor, self-motivated, and a proven team player
  • Demonstrated eagerness to learn and develop new experience

Will be a plus:

  • Expertise with some of the following technologies:
      • Experience with BigQuery ML
      • Container-based virtualization (Docker)
      • Distributed pub/sub frameworks (Kafka), distributed high-throughput key-value
      • storage (Redis)
      • Big data storage (Cassandra, Redshift, BigQuery) and processing (Cloud Dataflow, Spark)
      • High-concurrency relational databases (PostgreSQL)
      • Distributed log collection and analysis
  • Advanced academic training in distributed systems, security, or a related field

Responsibilities:

  • Implement data services including Google BigQuery, Apache Spark & Hadoop (Dataproc), Data Fusion / Dataflow, Cloud Composer, Cloud Function, Cloud Run, Cloud Pub/Sub, Google Data Studio
  • Design and develop scalable data ingestion frameworks to transform a wide variety of datasets
  • Research, analyze, recommend and select technical approaches for solving challenging and complex development and integration problems
  • Assist in designing multi-phased data strategies, including designing multi-phased implementation roadmaps
  • Own the full software development lifecycle for user-facing features
  • Constantly pay down technical debt and improve software development processes through tool development
  • Constantly learn the latest trends and tools applicable to PatternData problem, evaluating and integrating them as appropriate
  • Work with management to define and refine backend service technology roadmap
  • Evangelize and educate best practices for maintainable high-concurrency server code among the rest of the software organization

About AgileEngine

Founded as a dev tool vendor with a 2-person team

2010

Opened a dev center in Ukraine

2012

Pivoted into outsourced product development

2014

Launched mobile and UI labs

2015

Got our first Inc. 5000 award

2016

Opened a dev center in Argentina

2017

Became a top-3 ranked custom software developer in DC, Ukraine, and Argentina

2019

Became the #1 software development company to hire in 2020

2020

Opened new dev centers in Mexico and Colombia, counting 500+ experts

2021

How we lead

A company where experts grow, hone their skills, and do what they love, AgileEngine is guided by these principles:

Stay agile and embrace changes

Thrive in a results-driven culture with individual autonomy

Innovate with fellow experts in a no-blame environment

Learn from mistakes and move on

Foster mutual trust and support

Haven’t found the right position?

We are always in search of awesome experts. Share your CV, and we’ll notify you once we have the right opportunity.

Subscribe

Our geography

UTC-5
WASHINGTON DC USA
UTC-5
MIAMI USA
UTC-6
MEXICOMexico
UTC-5
ColombiaColombia
UTC-3
BrazilBrazil
UTC-3
ArgentinaArgentina
UTC+2
UkraineEurope
UTC+1
PolandEurope
UTC+0
PortugalPortugal
UTC+5:30
IndiaIndia

Apply for this position

Allowed Type(s): .pdf, .doc, .docx