DETAILS
ID71008
Developer
Python
Engineering
Python
Python
ETL pipelines
OLAP Data Architecture
Full-time
- Argentina,
- Brazil,
- Colombia,
- Mexico,
- Guatemala
- LATAM
7+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
ETL pipelines
OLAP Data Architecture
AWS Data Ecosystem
Data Lakes
Airflow
Python
Kubernetes/EKS
S3
Athena
Spark SQL
Parquet/ORC
PostgreSQL
Docker
REST
GraphQL
About the role
We are looking for a Lead Data Engineer to own the data pipeline and analytical architecture layer for a large-volume marketing analytics platform. You will make architectural decisions around partitioning strategy, file formats, schema design, and near-real-time processing for OLAP-oriented workloads built on an S3-backed data lake. You will design and govern ETL pipelines, define DAG-based orchestration strategies using Airflow, drive the AWS data stack including Athena and EKS, and lead a team of senior developers while enforcing code quality standards.
What you will do
- Design and own ETL pipelines that extract, transform, and validate data from internal databases and external APIs at scale.
- Make architectural decisions around partitioning, file formats, schema and data-type strategy, and near-real-time processing for large-volume, OLAP-oriented data systems built on an object-storage data lake.
- Own the design of scheduled batch workflows (DAGs) on the client's Airflow setup, defining pipeline structure, dependencies, and triggering strategies, and driving architectural discussions around them.
- Drive the use of the client's AWS data stack, including an S3-backed data lake, Athena, and EKS/Kubernetes.
- Partner directly with the client's DevOps team to clarify functional and non-functional requirements.
- Review pull requests and enforce code quality standards.
- Guide senior developers and ensure alignment with the client's engineering practices.
Must haves
- 7+ years of engineering experience, with a proven track record designing and implementing ETL pipelines and making architectural decisions for large-volume data systems.
- Hands-on experience with OLAP-style analytical data architecture, with experience in Athena, Trino/Presto, BigQuery, Snowflake, Spark SQL, ClickHouse, or similar technologies.
- Hands-on experience designing data lakes backed by object storage such as S3 or equivalent, including partitioning strategies, file formats such as Parquet/ORC, and cost/performance tradeoffs.
- Deep familiarity with DAG-style workflow definition and triggering, with substantial experience in Airflow or comparable orchestrators such as Dagster, Prefect, Luigi, or Step Functions.
- Practical experience across the AWS data ecosystem, including S3-backed data lakes, serverless query engines such as Athena or equivalent, and EKS/Kubernetes.
- Strong backend proficiency in Python, with experience using FastAPI or Flask.
- Comfortable working with REST and GraphQL.
- Experience with Docker and PostgreSQL for transactional and application layers.
- Highly comfortable working in Mac/Linux terminal-centric environments.
- Practical, hands-on experience with AI-assisted development tools such as Claude Code, combined with the critical judgment to challenge AI-generated output when it compromises long-term maintainability.
- Leadership experience setting standards for responsible use of AI tooling, including identifying risky AI-driven shortcuts during code review.
- Strong communication and technical judgment, with the ability to defend technical decisions, challenge quick fixes with sound reasoning, and balance long-term maintainability with pragmatic delivery.
- Upper-Intermediate English level.
Nice to haves
- Direct production experience with Athena.
- Working knowledge of TypeScript and React, sufficient to guide integrations and review frontend-adjacent pull requests.
- Production experience building AI features using AWS Bedrock, LangChain, Pydantic AI, or similar technologies.
- Experience with monorepo tooling such as Nx or modern package managers such as Poetry, UV, or Yarn.
- Experience with Redis and caching layers or SageMaker.
- Experience with marketing data structures, campaign management APIs, or digital advertising metrics.
Perks
- Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
- Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
- Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
- Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
- Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
- Well-being & support: access local well-being programs and people-focused support tailored to your location
Other roles you may like
DETAILS
ID71009
Developer
Python / React.js
Engineering
Python / React.js
Python
React.js
REST APIs
Full-time
- Argentina,
- Brazil,
- Colombia,
- Mexico,
- Guatemala
- LATAM
7+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
React.js
REST APIs
TypeScript
PostgreSQL
AWS (S3/Athena/EKS)
Docker
DETAILS
ID80143
Developer
Python
Engineering
Python
Python
REST APIs
Generative AI
Full-time
- India
- Asia
6+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
REST APIs
Generative AI
RAG
Vector Databases
AWS
Python
REST APIs
Generative AI
RAG
Vector Databases
AWS
Cloud Architecture
Terraform
Infrastructure as Code (IaC)
DETAILS
ID80140
Developer
Python
Engineering
Python
Python
REST APIs
Generative AI
Full-time
- Poland,
- Portugal,
- Ukraine,
- Bulgaria,
- Romania,
- Spain,
- Slovakia,
- Slovenia
- Europe
6+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
REST APIs
Generative AI
OpenAI
Python
REST APIs
Generative AI
OpenAI
Anthropic
RAG
Vector Databases
AWS
Cloud Architecture
Terraform
Infrastructure as Code (IaC)
DETAILS
ID80139
Developer
Python
Engineering
Python
Python
REST API
LLM APIs
Full-time
- India
- Asia
5+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
REST API
LLM APIs
OpenAI
Python
REST API
LLM APIs
OpenAI
Anthropic
RAG
Vector Embeddings
AWS
Terraform
Cloud Deployment
DETAILS
ID80138
Developer
Python
Engineering
Python
Python
REST API
LLM APIs
Full-time
- Poland,
- Portugal,
- Ukraine,
- Bulgaria,
- Romania,
- Spain,
- Slovakia,
- Slovenia
- Europe
5+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
REST API
LLM APIs
OpenAI
Python
REST API
LLM APIs
OpenAI
Anthropic
RAG
Vector Embeddings
AWS
Terraform
Infrastructure as Code (IaC)
DETAILS
ID75059
Data Engineer
Data Engineer Python
Data & AI
Python
Python
Big Data
Full-time
- United States
- North America
5+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
Big Data
DETAILS
ID52365
Developer
Python
Engineering
Python
Java
.NET
Python
Full-time
- Argentina,
- Brazil,
- Colombia,
- Mexico,
- Guatemala,
- Poland,
- Portugal,
- Ukraine,
- Bulgaria,
- Romania,
- Spain,
- Slovakia,
- Slovenia
- LATAM,
- Europe
5+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Java
.NET
Python
Node.js
AdTech
DETAILS
ID68432
Developer
Python
Engineering
Python
Java
.NET
Node.js
Full-time
- Argentina,
- Brazil,
- Colombia,
- Mexico,
- Guatemala,
- Poland,
- Portugal,
- Ukraine,
- Bulgaria,
- Romania,
- Spain,
- Slovakia,
- Slovenia
- LATAM,
- Europe
5+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Java
.NET
Node.js
DETAILS
ID71665
Developer
Python
Engineering
Python
Python
DevSecOps
Cloud Security
Full-time
- India
- Asia
6+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
DevSecOps
Cloud Security
CI/CD
DETAILS
ID71664
Developer
Python
Engineering
Python
Python
DevSecOps
Cloud Security
Full-time
- Poland,
- Portugal,
- Ukraine,
- Bulgaria,
- Romania,
- Spain,
- Slovakia,
- Slovenia
- Europe
6+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Python
DevSecOps
Cloud Security
CI/CD
DETAILS
ID71671
Developer
Python
Engineering
Python
Python
CI/CD
Full-time
- Argentina,
- Brazil,
- Colombia,
- Mexico,
- Guatemala,
- United States
- LATAM,
- North America
3+ years of experience
3–5 years
Middle Senior
Remote
TECH STACK
Python
CI/CD
71669
DETAILS
ID71672
Developer
Python
Engineering
Python
Application Security
DevSecOps
Python
Full-time
- Argentina,
- Brazil,
- Colombia,
- Mexico,
- Guatemala,
- United States
- LATAM,
- North America
5+ years of experience
5+ years
Senior Lead Architect C-level
Remote
TECH STACK
Application Security
DevSecOps
Python
71668
DETAILS
ID71662
Developer
Python
Engineering
Python
Python
CI/CD
Full-time
- Poland,
- Portugal,
- Ukraine,
- Bulgaria,
- Romania,
- Spain,
- Slovakia,
- Slovenia
- Europe
3+ years of experience
3–5 years
Middle Senior
Remote
TECH STACK
Python
CI/CD
70123
Didn’t find the perfect fit?
Subscribe to get notified about new roles that match your skills and interests.
Hiring process timeline
We designed our hiring process to be fast, transparent, and convenient — so you always know what to expect and can move through the steps without unnecessary delays.
A quick note
After applying, keep an eye on your inbox — including your spam folder. Occasionally, emails from our hiring platform, LaunchPod, may land there.
Tell us about yourself
Submit a short application form.
Pass a quick test
Pass a 30’- 60’ test.
Record a short video
Introduce yourself on video to fast-track your application process.
Meet our team
Once you pass the video review, grab a spot on our calendar for a technical interview.
Get an offer
Welcome to AgileEngine!
Have any questions?
What is the work format and schedule?
We are a remote-first company, so all our positions are remote. Schedules are flexible, but the main requirement is to have an overlap with your client’s schedule to ensure smooth collaboration. Specific details depend on the project and are discussed during the interview process.
What level of English is required?
We look for Upper-Intermediate (B2) proficiency or higher. Since you will be collaborating with international teams and global clients (including Fortune 500 companies), English is a part of your daily work.
Does AgileEngine provide work equipment?
It depends on your location. We provide equipment in Ukraine, Poland, Argentina, Colombia, Mexico, Brazil, Guatemala, Portugal, Spain, and India. In the USA, equipment is usually provided by the client; otherwise, you will be expected to use your own setup.
What opportunities for professional growth do you offer?
We support continuous growth through personalized development paths tailored to each expert. Also, you can expect:
- An annual learning and development budget
- Internal workshops, tech talks, and mentorship programs
- Opportunities to switch projects or grow into new roles over time
What does a typical team look like, and what tools do you use?
Teams vary by project, but you’ll usually work with a mix of experts across different fields, along with a delivery or project manager who supports collaboration and onboarding.
For day-to-day work, teams commonly use tools like Jira and Google Workspace, along with communication platforms such as Google Chat. Depending on the client, you may also work with Slack, Confluence, Notion, or similar tools.
Need help?
Want more details? See full FAQ
If something doesn’t work or you have questions regarding your application process, drop us a line.