Staff Software Engineer (Platform-Data Pipeline):
We are looking for a highly skilled Staff Software Engineer to optimize our data pipelines for improved stability, scalability, and cost efficiency. You will play a critical role in tuning ElasticSearch, Databricks, ScyllaDB, and Kubernetes while collaborating closely with Engineering, DevOps and product teams. Your work will directly impact the performance and efficiency of our infrastructure, ensuring that optimizations align with a superior user experience.
Responsibilities:
- Analyze and enhance data pipeline stability, scalability, and cost efficiency.
- Perform performance tuning of ElasticSearch, Databricks, ScyllaDB, and Kubernetes.
- Collaborate with engineering and product leaders to align optimization efforts with business goals, ensuring no adverse impact on user experience.
Requirements:
- 5+ years of experience in data platform engineering, with a focus on data pipeline optimization.
- Proven expertise in ElasticSearch, Databricks, ScyllaDB, and Kubernetes.
- Experience with AWS cost optimization.
- Solid understanding of distributed systems, databases, and performance tuning.
- Strong analytical skills and a data-driven approach to problem-solving.
- Excellent collaboration and communication skills.
Employee Benefits
Our competitive benefits packages are designed to support our employees' well-being, both at work and at home. Our US based employees enjoy:
- Competitive compensation with equity and 401k
- Comprehensive healthcare with dental and vision coverage
- Flexible paid time off and paid holiday time off
- 12 weeks of new parent or family leave
- Personal and professional development resources
For more details on our US benefits, or for information on our international benefits, please see here.
Pay Transparancy
Please note that the base pay range is a guideline and for candidates who receive an offer, the base pay will vary based on factors such as work location, as well as the knowledge, skills and experience of the candidate. In addition to a competitive base salary, this position is eligible for equity awards and may be eligible for incentive compensation based on factors such as experience, skills, and location.
At Obsidian, we are proud to be an equal-opportunity employer. We value diversity and hire for talent, passion, and compassion. In compliance with federal law, all persons hired will be required to submit satisfactory proof of identity and legal authorization. If you have a need that requires accommodation, please contact [email protected]
Information collected and processed as part of any job applications you choose to submit is subject to Obsidian’s Applicant Privacy Policy.
