Senior Scala Data Engineer

Department: Engineering
Specialization: Data Engineer/Big Data
Experience: Senior
Locations: India
Client: Arity
Special referral bonus: No
Hot position?: Hot
Work model: Remote

About the Client

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.
    At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.
      That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here.

        The Engineering Team

        Our engineers are fueled by a passion to impact the future of mobility. They push the boundaries of telematics and transportation tech by creating and supporting cutting-edge products. As part of an Agile team, they are armed with the freedom to innovate and the opportunity to see projects through from start to finish. Using a variety of languages and a top-notch technology stack, our engineers make critical advances in areas like sensor technology, enterprise engineering and platform development. Our team understands what it means to collaborate and communicate in an interconnected global team, all while having trust, transparency and empathy for the end user. Which is pretty cool, if you ask us.

          The Role

          The Engineer Operations role is responsible for processing data into and out of the Arity insurance platform.  This will include taking over existing flows, converting them to a new platform, as well as taking on some Spark processing that pulls data together and then store in data lakes.


          • Collaborates with other Engineers, IT Architects, and business clients to ensure complete understanding of the platform’s technical and business functionality.
          • Participates in daily site, cross-site, and product team ceremonies associated with scrum principals.
          • Establish continuous integration, continuous delivery, and continuous deployment pipelines and practices
          • Designs, develops, and tests components of the new attribute platform including data ingestion and delivery functions
          • Test, debug, and analyze performance, and document hardware and software technology components.
            • Ensure that plans integrate effectively with other components accounting for compliance and security standards.
            • Rotates into production support of applications which could include off-hours support.
            • Participated in knowledge sharing and contributes to the overall growth of the collective knowledge of the team.
              • Qualifications

              • 4 to 6 years experience with Scala, Spark,
              • Strong understanding of computer science concepts, big data design principles and implementing and managing large data sets.
              • Experience in Test Driven Development; including knowledge and experience in testing frameworks (such as MSTest, NUnit,, junit, mockito, jasmine, protractor, cucumber, and other like technologies)
              • Experience with AWS components such as MSK, S3, AWS step functions, Lambda, Kinesis Firehose, Dynamo Database, Elastic cache technologies will be an added advantage,
              • Experience with Apache Flink will be beneficial.
              • Clear understanding of data management, process automation, system monitoring, and maintainability.
              • Understanding of cloud services, deployment models, and distributed systems

              About AgileEngine

              Founded as a dev tool vendor with a 2-person team


              Opened a dev center in Ukraine


              Pivoted into outsourced product development


              Launched mobile and UI labs


              Got our first Inc. 5000 award


              Opened a dev center in Argentina


              Became a top-3 ranked custom software developer in DC, Ukraine, and Argentina


              Became the #1 software development company to hire in 2020


              Opened new dev centers in Mexico and Colombia, counting 500+ experts


              How we lead

              A company where experts grow, hone their skills, and do what they love, AgileEngine is guided by these principles:

              Stay agile and embrace changes

              Thrive in a results-driven culture with individual autonomy

              Innovate with fellow experts in a no-blame environment

              Learn from mistakes and move on

              Foster mutual trust and support

              Haven’t found the right position?

              We are always in search of awesome experts. Share your CV, and we’ll notify you once we have the right opportunity.


              Our geography

              WASHINGTON DC USA
              MIAMI USA

              Apply for this position

              Allowed Type(s): .pdf, .doc, .docx