From the listing
About the role
The Data Platform team builds and operates the shared infrastructure that powers how data is stored, moved, and consumed across Alpaca. The platform supports financial transactions, customer data, API and system events, enriched datasets, and third-party sources, processing hundreds of millions of events each day.
As a Data Platform Engineer, you will build and operate reliable systems across Alpaca’s data platform, contributing to distributed query, lakehouse, CDC, and real-time streaming infrastructure. You’ll own projects from implementation through production operation and help improve scalability, reliability, and developer experience.
Our team is 100% distributed and remote.
What you'll do
- Design, develop, and evolve Alpaca’s core data platform, including distributed query engines, orchestration, lakehouse storage, metadata, and cataloging.
- Own our lakehouse infrastructure as code, building reliable and repeatable deployment workflows with Terraform and Ansible on Kubernetes.
- Build and operate scalable, low-latency streaming and CDC pipelines alongside dependable batch ingestion paths into Apache Iceberg.
- Develop and scale our serving and BI infrastructure, giving downstream teams and agents performant, governed, self-service access to lakehouse data.
- Take end-to-end ownership of platform reliability through observability, actionable alerting, on-call practices, incident response, maintenance procedures, runbooks, and service-level objectives.
- Partner with DevOps, Analytics Engineering, and stakeholders across Alpaca to close infrastructure gaps, shape technical requirements, and deliver reusable platform capabilities.
What they're looking for
- 4+ years of experience in software engineering, data infrastructure, or platform engineering, with demonstrated ownership of complex production systems and technical projects.
- Strong understanding of distributed systems and production experience with query engines such as Trino or Presto.
- Strong experience operating Kubernetes-based data infrastructure using infrastructure-as-code and deployment tools such as Terraform, Helm, Ansible, or Argo CD.
- Experience designing and operating compute platforms across multiple cloud regions, balancing workload locality, peak and bursty demand, resource isolation, workload prioritization, and cost-performance trade-offs.
- Hands-on experience designing and operating cloud lakehouse architectures on GCP, AWS, or Azure, including object storage, metastores, and open table formats, particularly Apache Iceberg.
- Experience operating large-scale streaming and CDC systems using technologies such as Kafka, Redpanda, and Debezium.
- Strong Python and SQL skills, with experience building reliable data pipelines and platform tooling using orchestration and ingestion frameworks such as Airflow and Airbyte.
- Strong operational judgment and the ability to make sound technical decisions, communicate trade-offs, and work effectively through ambiguity.
Nice to have
- Experience with semantic or metrics layers such as Cube, dbt, or Looker.
- Experience deploying and operating infrastructure for AI agents.
- Experience building or integrating context layers that connect structured and unstructured organizational data.
- Experience with data governance and access-control frameworks such as Apache Ranger.
Benefits, as listed
The hot takeJeff's read on Alpaca
I like their clear views on the value of remote work, check out this quote from their careers page:
> "Our teams are not just global, we're also 100% remote and have team members in almost every time zone and continent (except Antarctica). By joining Alpaca you'll be part of a multicultural, international organization."
I also like that their Glassdoor scores are going up (now 3.7/5), and they have some solid testimonials. I'm a LITTLE wary of this statement that gives me a bit of a "hustle culture" vibe:
> "We're keen on that last 10% of effort and believe that the details do matter. If this sounds like you, then you're in the right place."