Software Engineer

A World-Changing Company   Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.
The Role   We are a software engineering team applying open-source data technologies to some of the world’s hardest and most important problems. We build the data processing infrastructure that underpins Palantir Foundry, supporting applications that help hospitals care for more patients, help clinical teams coordinate timely diagnoses, and keep essential supplies moving through global disruption.   You will work deep inside the systems that make this possible: how computations are represented, how query plans are optimized, how operators execute, and how data is read and written efficiently. We build on and extend Apache Spark, Apache DataFusion, and Apache Iceberg, bringing advances in open-source engines and table formats into the demanding environments our customers operate in. Our work serves many products and workloads across Foundry, including no-code pipelines, interactive analysis, and the processing that keeps the Ontology up to date.   You will own improvements from design through production, whether that means developing a planning rule, extending a native execution engine, or improving the way large tables are scanned and updated. Correctness, compatibility, and predictable performance are central to everything we build. A change in a shared engine can benefit applications across the platform and the people who rely on them.   Join us if you want to advance the capabilities of modern data systems and apply that work to consequential problems.

Technologies We Use

• Java, Scala, Rust, and Python
• Apache Spark, Apache DataFusion, Apache Comet, and Velox for data processing and query execution
• Apache Iceberg for table management and catalog interoperability
• Apache Arrow and Apache Parquet for in-memory data processing and columnar storage
• Industry-standard build tooling, including Gradle, Cargo, and GitHub.

Core Responsibilities

• Designing and implementing query planning and optimization capabilities that turn complex computations into efficient execution plans
• Extending execution engines with new capabilities and improving query operators, parallelism, memory management, and data movement
• Developing Foundry’s Iceberg catalog and engine integrations, including table metadata, transactions, and efficient reads and writes
• Building shared transformation semantics and execution interfaces for workloads across Foundry’s products and platform services