Sr. Software Engineer, Data Engineering
PoshmarkUS California (Redwood City) - OfficeRemote
Needs a free Superjobs account. You'll finish on Poshmark's Ashby page.
Skill score
Summary
This senior engineer builds and maintains real-time and batch data pipelines and a petabyte-scale data lakehouse at Poshmark. They own critical pipelines, lead architecture and design reviews, and mentor junior engineers, which suits an experienced distributed-systems engineer who works independently.
- Function
- Data Science
- Estimated salary
- Est. $145k–218k/yr
- Estimated for a senior role, ~4 yrs experience, United States. Not published by the employer.
- Work mode and location
- Remote, US California (Redwood City) - Office
- Experience
- 4–6 yrs
- Employment type
- Full-time
Job description
Overview
The Big Data team is a central player in the Poshmark organization. Our mission is to build a world-class big data platform to bring value out of data for us and for our customers. Our goal is to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.
The Data Engineering team at Poshmark is looking for an experienced software engineer to scale Data lake, ensuring real-time access to quality data for all the stakeholders. The role provides opportunity to showcase in-depth software development skills to build and maintain real-time and batch data pipelines with a focus on scalability and optimizations while collaborating with Data Science, Analytics, and Platform Engineering teams to build tools to access petabyte scale data.
Roles and responsibilities
- Build highly scalable, available, fault-tolerant data processing systems using AWS technologies, MapReduce, Hive, Kafka, Spark, Flink and other big data technologies to handle batch and real-time data processing within 10s for terabytes of data ingested every day and a petabyte-sized data warehouse.
- Responsible for taking care of some of the most critical data pipelines at Poshmark.
- Identify areas of opportunity from a technical perspective for improvements to the data platform and lead the areas to achieve scalable, easy to use pipelines/infrastructure.
- Participate in architecture discussions, influence product roadmap, build best practices, take ownership and responsibility over new projects.
- Create technical scoping for projects and execute them, taking full ownership, with minimal guidance.
- Work cross-functionally with other engineering teams, product managers, data analysts, data scientists and data engineers to drive projects from conception to release.
6-Month Accomplishments
- Become familiar with Poshmark’s code and infrastructure of data lake house, including realtime and batch processing.
- Take full ownership of at least one major data domain or critical system, ensuring its high availability and scalability.
- Understand exactly what different stakeholders need from the data.
12+ Month Accomplishments
- Establish yourself as an expert in one of more areas of Poshmark data platform and as a technical lead on the data engineering team.
- Identify technical debt and propose a concrete 6-to-12-month roadmap for systemic improvements and platform modernization.
- Work alongside security and governance partners on access reviews, data classification.
- Collaborate with Product, Data Science, and Engineering teams to seamlessly sequence technical work across various dependencies.
Skills required
Top skills
- Apache Kafka
- Apache Flink
- Apache Spark
- Scala
All skills (8)
- Java
- Python
- SQL
- AWS data services
- Delta Lake
- Redshift
- Snowflake
- Apache Iceberg
Qualifications
- 4–6+ years of dedicated production experience in Data Engineering or Distributed Systems Engineering.
- Deep production experience building event-driven architectures and real-time processing applications using Apache Kafka and Apache Flink.
- Expert-level Scala, Java, Python and SQL skills paired with hands-on production experience using Apache Spark/Flink for heavy distributed processing workloads.
- Familiarity with modern open table formats like Apache Iceberg or Delta Lake (Parquet/Avro).
- Production experience with a distributed processing engine and a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, Redshift), utilizing AWS data services (S3, Glue, Lambda, Step Functions)
- Active participant in architecture discussions who is comfortable leading code and technical design reviews, setting engineering standards, and providing technical guidance to junior team members.
- Excellent communication skills, a strong team-player mentality, and an eagerness to evaluate and adopt newer technologies when necessary.
Company info
About Poshmark
Poshmark is the leading fashion marketplace where style comes alive through discovery, self-expression, and human connection. Powered by a vibrant community of 165 million members, Poshmark brings real people and taste to shopping through a social experience shaped by shared discovery. Poshmark empowers sellers to grow meaningful businesses, keeps fashion