About the role
We are looking for a Data Engineer to build the pipelines, storage, and retrieval systems behind a data platform that helps AI agents produce better forecasts.
The mandatory requirements are 5+ years of experience with Python software engineering, strong SQL, database and data modeling skills, production ingestion pipelines, unstructured data processing and RAG, vector databases or vector search, and an upper-intermediate English level.
What you will do
- Build reliable ingestion pipelines. Acquire and process diverse datasets, handling incremental updates, deduplication, schema changes, retries, backfills, and monitoring.
- Design the data platform. Develop storage and indexing architectures that support SQL queries, keyword and vector search, and graph-based retrieval.
- Make data useful to AI agents. Build document processing, chunking, embedding, and retrieval pipelines that deliver relevant context quickly and efficiently.
- Support historical reasoning and evaluation. Implement bitemporal models and point-in-time queries that distinguish when something happened from when it became known, preventing future information from leaking into historical tests.
- Own data quality and provenance. Define schemas, validation rules, source attribution, lineage, and timestamp semantics. Investigate inconsistencies and make data limitations visible to downstream users.
- Improve performance, cost, and access controls. Optimize queries and pipelines, measure retrieval quality, and provide secure access across datasets and agent workflows.
Must haves
- 5+ years of experience with Python software engineering, including testing, maintainable system design, and production debugging.
- Strong SQL, database, and data modeling skills, with experience optimizing queries and working with large datasets.
- Experience building and operating production ingestion and transformation pipelines, including monitoring and recovery from partial failures.
- Experience processing unstructured data, including document extraction, chunking, embeddings, and retrieval-augmented generation (RAG).
- Practical experience with vector databases or vector search systems, including indexing, metadata filtering, and retrieval performance. This includes methods to tune search quality and relevance.
- Careful judgment about data correctness and meaning: timestamps, units, identifiers, missing values, revisions, and source reliability.
- The ability to take an ambiguous requirement, make architectural tradeoffs, and deliver a working system.
- Upper-intermediate English level.
Nice to haves
- Databricks, Snowflake, or comparable lakehouse and warehouse platforms.
- AWS infrastructure, object storage, queues, and distributed processing.
- Financial, economic, news, or other frequently revised datasets.
- Bitemporal modeling, historical snapshots, and reproducible backtesting.
- Search relevance, hybrid retrieval, and RAG evaluation.
- Graph databases, entity resolution, and knowledge graphs.
- TurboPuffer or other vector databases.
Perks
- Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
- Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
- Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
- Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
- Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
- Well-being & support: access local well-being programs and people-focused support tailored to your location
Didn’t find the perfect fit?
Subscribe to get notified about new roles that match your skills and interests.
Hiring process timeline
We designed our hiring process to be fast, transparent, and convenient — so you always know what to expect and can move through the steps without unnecessary delays.
A quick note
After applying, keep an eye on your inbox — including your spam folder. Occasionally, emails from our hiring platform, LaunchPod, may land there.
Tell us about yourself
Submit a short application form.
Pass a quick test
Pass a 30’- 60’ test.
Record a short video
Introduce yourself on video to fast-track your application process.
Meet our team
Once you pass the video review, grab a spot on our calendar for a technical interview.
Get an offer
Welcome to AgileEngine!
Have any questions?
What is the work format and schedule?
We are a remote-first company, so all our positions are remote. Schedules are flexible, but the main requirement is to have an overlap with your client’s schedule to ensure smooth collaboration. Specific details depend on the project and are discussed during the interview process.
What level of English is required?
We look for Upper-Intermediate (B2) proficiency or higher. Since you will be collaborating with international teams and global clients (including Fortune 500 companies), English is a part of your daily work.
Does AgileEngine provide work equipment?
It depends on your location. We provide equipment in Ukraine, Poland, Argentina, Colombia, Mexico, Brazil, Guatemala, Portugal, Spain, and India. In the USA, equipment is usually provided by the client; otherwise, you will be expected to use your own setup.
What opportunities for professional growth do you offer?
We support continuous growth through personalized development paths tailored to each expert. Also, you can expect:
- An annual learning and development budget
- Internal workshops, tech talks, and mentorship programs
- Opportunities to switch projects or grow into new roles over time
What does a typical team look like, and what tools do you use?
Teams vary by project, but you’ll usually work with a mix of experts across different fields, along with a delivery or project manager who supports collaboration and onboarding.
For day-to-day work, teams commonly use tools like Jira and Google Workspace, along with communication platforms such as Google Chat. Depending on the client, you may also work with Slack, Confluence, Notion, or similar tools.
Need help?
Want more details? See full FAQ
If something doesn’t work or you have questions regarding your application process, drop us a line.