Data Engineer

Department: Engineering
Specialization: Data Engineer/Big Data
Experience: Lead Senior
Technologies: Java Python Scala Spark
Client: Cardlytics
Special referral bonus: No
Hot position?: Not Hot
Work model: Remote

About the Client

Cardlytics makes marketing more relevant and measurable through their Purchase Intelligence™ platform. Partnering with financial institutions (FIs) to run their banking rewards programs, Cardlytics has a secure view into where and when consumers are spending their money. By applying advanced analytics to this massive aggregation of purchase data, Cardlytics makes it actionable, helping marketers/ advertisers identify, reach and influence likely buyers at scale, and measure the true sales impact of their marketing spend.
    On Behalf of Cardlytics, AgileEngine is looking for an experienced Senior Scala Data Engineer focused on backend and data development to join our team full time. You will be primarily responsible for the design and coding of new features and applications, enhancing existing products, and implementing new technologies, paradigms, and practices to provide the best solutions to our customers. This includes technical design and development of Cardlytics current and future systems as a part of a team of other data engineers and across other Engineering and business teams. The senior data engineer will also be responsible for implementing organizational and industry standards and best practices to ensure compatibility, reliability, resiliency, scalability, performance, and maintainability.

      Requirements

      • 4+ years of experience in data engineering using Scala, Apache Spark
      • Hands-on experience with Apache Spark (Batch & Streaming)
      • Experienced in building high performing, scalable, observable, reliable, extensible data pipelines that process large volumes of data in both batches and streams
      • Practical experience in designing and using Data Lakes and MPP DW systems (Snowflake, Yellowbrik, Vertica)
      • Using logs, tools, and other data to methodically identify issues (performance, environmental or otherwise)
      • Consuming and supplying data via APIs
      • Well versed in a variety of Spark, Kafka, RDBS, and other Big Data technologies
      • Self-motivated and self-managing, with strong organizational skills
      • Team Leadership skills and experience setting up process on the project
      • Great English and communication skills

        Responsibilities

        • Develop new applications and features within a scrum team providing data and data services to the enterprise, other engineering teams, data science, analysts, product, management/executives, and other business teams
        • Build high performing and scalable data platforms to support multiple data pipelines to ingest and deliver data as fast and reliably as possible
        • Implement new technologies and practices to provide the best solutions to our customers
        • Develop and maintain solutions on our tech stack environments (Spark Streaming, Spark, Kafka, Vertica, SQL Server, etc.)
        • Work with business teams to create technical requirements and deliver within time and scope
        • Help develop team members through code reviews, enforcing standards, best practices, policies, and processes
        • Perform functional testing, end-to-end testing, performance testing, and UAT of applications and code written by self and other members of the team

          We offer

          • Great compensation package, highest salaries on the market
          • Flexible work schedule
          • Zero bureaucracy
          • Friendly and a very skilled team with great corporate culture and mentorship (visit us and see it yourself)
          • US democratic management style
          • Opportunities for self-realization, professional and career growth
          • Cool events and team activities
          • Professional workshops and training, a great engineering culture

          About AgileEngine

          Founded as a dev tool vendor with a 2-person team

          2010

          Opened a dev center in Ukraine

          2012

          Pivoted into outsourced product development

          2014

          Launched mobile and UI labs

          2015

          Got our first Inc. 5000 award

          2016

          Opened a dev center in Argentina

          2017

          Became a top-3 ranked custom software developer in DC, Ukraine, and Argentina

          2019

          Became the #1 software development company to hire in 2020

          2020

          Opened new dev centers in Mexico and Colombia, counting 500+ experts

          2021

          How we lead

          A company where experts grow, hone their skills, and do what they love, AgileEngine is guided by these principles:

          Stay agile and embrace changes

          Thrive in a results-driven culture with individual autonomy

          Innovate with fellow experts in a no-blame environment

          Learn from mistakes and move on

          Foster mutual trust and support

          Haven’t found the right position?

          We are always in search of awesome experts. Share your CV, and we’ll notify you once we have the right opportunity.

          Subscribe

          Our geography

          UTC-5
          WASHINGTON DC USA
          UTC-5
          MIAMI USA
          UTC-6
          MEXICOMexico
          UTC-5
          ColombiaColombia
          UTC-3
          BrazilBrazil
          UTC-3
          ArgentinaArgentina
          UTC+2
          UkraineEurope
          UTC+1
          PolandEurope
          UTC+0
          PortugalPortugal
          UTC+5:30
          IndiaIndia

          Apply for this position

          Allowed Type(s): .pdf, .doc, .docx