Middle Scala Data Engineer

Department: Engineering
Specialization: Data Engineer/Big Data
Experience: Middle
Client: Arity
Special referral bonus: No
Hot position?: Hot
Work model: Remote

About the Client

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.
    At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.
      That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here.

        The Engineering Team

        Our engineers are fueled by a passion to impact the future of mobility. They push the boundaries of telematics and transportation tech by creating and supporting cutting-edge products. As part of an Agile team, they are armed with the freedom to innovate and the opportunity to see projects through from start to finish. Using a variety of languages and a top-notch technology stack, our engineers make critical advances in areas like sensor technology, enterprise engineering and platform development. Our team understands what it means to collaborate and communicate in an interconnected global team, all while having trust, transparency and empathy for the end user. Which is pretty cool, if you ask us.

          The Role

          The Engineer Operations role is responsible for processing data into and out of the Arity insurance platform.  This will include taking over existing flows, converting them to a new platform, as well as taking on some Spark processing that pulls data together and then store in data lakes.

            Responsibilities

            • Collaborates with other Engineers, IT Architects, and business clients to ensure complete understanding of the platform’s technical and business functionality.
            • Participates in daily site, cross-site, and product team ceremonies associated with scrum principals.
            • Establish continuous integration, continuous delivery, and continuous deployment pipelines and practices
            • Designs, develops, and tests components of the new attribute platform including data ingestion and delivery functions
            • Test, debug, and analyze performance, and document hardware and software technology components.
            • Ensure that plans integrate effectively with other components accounting for compliance and security standards.
            • Rotates into production support of applications which could include off-hours support.
            • Participated in knowledge sharing and contributes to the overall growth of the collective knowledge of the team.

            Qualifications

              • 1 to 3 years experience with Scala, Spark,
              • Strong understanding of computer science concepts, big data design principles and implementing and managing large data sets.
              • Experience in Test Driven Development; including knowledge and experience in testing frameworks (such as MSTest, NUnit, xUnit.net, junit, mockito, jasmine, protractor, cucumber, and other like technologies)
              • Experience with AWS components such as MSK, S3, AWS step functions, Lambda, Kinesis Firehose, Dynamo Database, Elastic cache technologies will be an added advantage,
              • Experience with Apache Flink will be beneficial.
              • Clear understanding of data management, process automation, system monitoring, and maintainability.
              • Understanding of cloud services, deployment models, and distributed systems

            About AgileEngine

            Founded as a dev tool vendor with a 2-person team

            2010

            Opened a dev center in Ukraine

            2012

            Pivoted into outsourced product development

            2014

            Launched mobile and UI labs

            2015

            Got our first Inc. 5000 award

            2016

            Opened a dev center in Argentina

            2017

            Became a top-3 ranked custom software developer in DC, Ukraine, and Argentina

            2019

            Became the #1 software development company to hire in 2020

            2020

            Opened new dev centers in Mexico and Colombia, counting 500+ experts

            2021

            How we lead

            A company where experts grow, hone their skills, and do what they love, AgileEngine is guided by these principles:

            Stay agile and embrace changes

            Thrive in a results-driven culture with individual autonomy

            Innovate with fellow experts in a no-blame environment

            Learn from mistakes and move on

            Foster mutual trust and support

            Haven’t found the right position?

            We are always in search of awesome experts. Share your CV, and we’ll notify you once we have the right opportunity.

            Subscribe

            Our geography

            UTC-5
            WASHINGTON DC USA
            UTC-5
            MIAMI USA
            UTC-6
            MEXICOMexico
            UTC-5
            ColombiaColombia
            UTC-3
            BrazilBrazil
            UTC-3
            ArgentinaArgentina
            UTC+2
            UkraineEurope
            UTC+1
            PolandEurope
            UTC+0
            PortugalPortugal
            UTC+5:30
            IndiaIndia

            Apply for this position

            Allowed Type(s): .pdf, .doc, .docx