Data Engineer

Department: Engineering
Specialization: Data Engineer/Big Data
Experience: Lead Senior
Technologies: Java Python Scala Spark
Client: Cardlytics
Special referral bonus: No
Hot position?: Not Hot
Work model: Remote

About the Client

Cardlytics makes marketing more relevant and measurable through their Purchase Intelligence™ platform. Partnering with financial institutions (FIs) to run their banking rewards programs, Cardlytics has a secure view into where and when consumers are spending their money. By applying advanced analytics to this massive aggregation of purchase data, Cardlytics makes it actionable, helping marketers/ advertisers identify, reach and influence likely buyers at scale, and measure the true sales impact of their marketing spend.
    On Behalf of Cardlytics, AgileEngine is looking for an experienced Senior Scala Data Engineer focused on backend and data development to join our team full time. You will be primarily responsible for the design and coding of new features and applications, enhancing existing products, and implementing new technologies, paradigms, and practices to provide the best solutions to our customers. This includes technical design and development of Cardlytics current and future systems as a part of a team of other data engineers and across other Engineering and business teams. The senior data engineer will also be responsible for implementing organizational and industry standards and best practices to ensure compatibility, reliability, resiliency, scalability, performance, and maintainability.


      • 4+ years of experience in data engineering using Scala, Apache Spark
      • Hands-on experience with Apache Spark (Batch & Streaming)
      • Experienced in building high performing, scalable, observable, reliable, extensible data pipelines that process large volumes of data in both batches and streams
      • Practical experience in designing and using Data Lakes and MPP DW systems (Snowflake, Yellowbrik, Vertica)
      • Using logs, tools, and other data to methodically identify issues (performance, environmental or otherwise)
      • Consuming and supplying data via APIs
      • Well versed in a variety of Spark, Kafka, RDBS, and other Big Data technologies
      • Self-motivated and self-managing, with strong organizational skills
      • Team Leadership skills and experience setting up process on the project
      • Great English and communication skills


        • Develop new applications and features within a scrum team providing data and data services to the enterprise, other engineering teams, data science, analysts, product, management/executives, and other business teams
        • Build high performing and scalable data platforms to support multiple data pipelines to ingest and deliver data as fast and reliably as possible
        • Implement new technologies and practices to provide the best solutions to our customers
        • Develop and maintain solutions on our tech stack environments (Spark Streaming, Spark, Kafka, Vertica, SQL Server, etc.)
        • Work with business teams to create technical requirements and deliver within time and scope
        • Help develop team members through code reviews, enforcing standards, best practices, policies, and processes
        • Perform functional testing, end-to-end testing, performance testing, and UAT of applications and code written by self and other members of the team

          We offer

          • Great compensation package, highest salaries on the market
          • Flexible work schedule
          • Zero bureaucracy
          • Friendly and a very skilled team with great corporate culture and mentorship (visit us and see it yourself)
          • US democratic management style
          • Opportunities for self-realization, professional and career growth
          • Cool events and team activities
          • Professional workshops and training, a great engineering culture

          About AgileEngine

          Founded as a dev tool vendor with a 2-person team


          Opened a dev center in Ukraine


          Pivoted into outsourced product development


          Launched mobile and UI labs


          Got our first Inc. 5000 award


          Opened a dev center in Argentina


          Became a top-3 ranked custom software developer in DC, Ukraine, and Argentina


          Became the #1 software development company to hire in 2020


          Opened new dev centers in Mexico and Colombia, counting 500+ experts


          How we lead

          A company where experts grow, hone their skills, and do what they love, AgileEngine is guided by these principles:

          Stay agile and embrace changes

          Thrive in a results-driven culture with individual autonomy

          Innovate with fellow experts in a no-blame environment

          Learn from mistakes and move on

          Foster mutual trust and support

          Haven’t found the right position?

          We are always in search of awesome experts. Share your CV, and we’ll notify you once we have the right opportunity.


          Our geography

          MIAMI USA

          Apply for this position

          Allowed Type(s): .pdf, .doc, .docx