Senior Java Data Engineer

Department: Engineering
Specialization: Data Engineer/Big Data
Experience: Senior
Technologies: AWS Java
Client: Arity
Special referral bonus: No
Hot position?: Hot
Work model: Remote
AgileEngine is seeking highly motivated and experienced Data Engineers to join our team.  You’ll design, build and maintain big data systems – extracting, transforming, and loading big data.  The role is a part of our Analytics organization and requires the ability to design, iterate, learn, and improve.  You’ll work in a highly collaborative organization with a high degree of autonomy. 
     

    Arity and its mission

    An estimated $3 trillion in wasted spending. One workweek spent in traffic. 40,000 lives lost—every single year. Does that seem like a system working as it should? 
      Founded by Allstate in 2016, we’re an analytics company that combines massive amounts of data, cutting-edge technology, and decades of transportation expertise to help partners make data-based decisions that solve real problems for real people. Arity insurance, sharing economy, marketing, and mobile app solutions leverage exclusive data to power insights that help your company make informed choices and reduce costs.
         

        Technical Experience & Skills

        • Experience in building ETL pipelines using AWS services using Java
        • AWS services knowledge: AWS Glue, AWS Step Functions
        • Good to have experience workflow orchestration pipelines like Apache Airflow etc.
        • Prior experience working on batch processing and end to end data processing systems.
        • Understanding of data transformation specifications and data formats like JSON, Avro, XML, CSV, UTF-8, Base-64 encoded and standard HTTP response/ error codes
          

        Qualifications

        • A college degree or equivalent experience in Computer Science or a similar field, including a solid understanding of Computer Science fundamentals
        • 3+ years of experience in developing data engineering solutions with Java technologies
        • Strong understanding of computer science concepts, object-oriented design principles
        • Experience in building RESTful API
        • Excellent Git flow patterns
        • Experience with AWS native data storage and processing technologies 
        • Experience working with stream and batch data processing environments
        • Scala knowledge is a great plus

        About AgileEngine

        Founded as a dev tool vendor with a 2-person team

        2010

        Opened a dev center in Ukraine

        2012

        Pivoted into outsourced product development

        2014

        Launched mobile and UI labs

        2015

        Got our first Inc. 5000 award

        2016

        Opened a dev center in Argentina

        2017

        Became a top-3 ranked custom software developer in DC, Ukraine, and Argentina

        2019

        Became the #1 software development company to hire in 2020

        2020

        Opened new dev centers in Mexico and Colombia, counting 500+ experts

        2021

        How we lead

        A company where experts grow, hone their skills, and do what they love, AgileEngine is guided by these principles:

        Stay agile and embrace changes

        Thrive in a results-driven culture with individual autonomy

        Innovate with fellow experts in a no-blame environment

        Learn from mistakes and move on

        Foster mutual trust and support

        Haven’t found the right position?

        We are always in search of awesome experts. Share your CV, and we’ll notify you once we have the right opportunity.

        Subscribe

        Our geography

        UTC-5
        WASHINGTON DC USA
        UTC-5
        MIAMI USA
        UTC-6
        MEXICOMexico
        UTC-5
        ColombiaColombia
        UTC-3
        BrazilBrazil
        UTC-3
        ArgentinaArgentina
        UTC+2
        UkraineEurope
        UTC+1
        PolandEurope
        UTC+0
        PortugalPortugal
        UTC+5:30
        IndiaIndia

        Apply for this position

        Allowed Type(s): .pdf, .doc, .docx