Middle Scala Data Engineer

About the Client

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.

At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.

That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here.

The Engineering Team

Our engineers are fueled by a passion to impact the future of mobility. They push the boundaries of telematics and transportation tech by creating and supporting cutting-edge products. As part of an Agile team, they are armed with the freedom to innovate and the opportunity to see projects through from start to finish. Using a variety of languages and a top-notch technology stack, our engineers make critical advances in areas like sensor technology, enterprise engineering and platform development. Our team understands what it means to collaborate and communicate in an interconnected global team, all while having trust, transparency and empathy for the end user. Which is pretty cool, if you ask us.

The Role

The Engineer Operations role is responsible for processing data into and out of the Arity insurance platform.  This will include taking over existing flows, converting them to a new platform, as well as taking on some Spark processing that pulls data together and then store in data lakes.

Responsibilities

• Collaborates with other Engineers, IT Architects, and business clients to ensure complete understanding of the platform’s technical and business functionality.
• Participates in daily site, cross-site, and product team ceremonies associated with scrum principals.
• Establish continuous integration, continuous delivery, and continuous deployment pipelines and practices
• Designs, develops, and tests components of the new attribute platform including data ingestion and delivery functions
• Test, debug, and analyze performance, and document hardware and software technology components.
• Ensure that plans integrate effectively with other components accounting for compliance and security standards.
• Rotates into production support of applications which could include off-hours support.
• Participated in knowledge sharing and contributes to the overall growth of the collective knowledge of the team.

Qualifications

• • 1 to 3 years experience with Scala, Spark,
  • Strong understanding of computer science concepts, big data design principles and implementing and managing large data sets.
  • Experience in Test Driven Development; including knowledge and experience in testing frameworks (such as MSTest, NUnit, xUnit.net, junit, mockito, jasmine, protractor, cucumber, and other like technologies)
  • Experience with AWS components such as MSK, S3, AWS step functions, Lambda, Kinesis Firehose, Dynamo Database, Elastic cache technologies will be an added advantage,
  • Experience with Apache Flink will be beneficial.
  • Clear understanding of data management, process automation, system monitoring, and maintainability.
  • Understanding of cloud services, deployment models, and distributed systems