The Data Engineer at Butter Payments will architect data systems, ensure high-quality data ingestion and transformation, and collaborate with ML teams to optimize workflows.
About Butter Payments:
At Butter Payments, we’re on a mission to eliminate involuntary churn and make recurring payments seamless. Every year, billions of dollars are lost due to failed payments. Butter leverages machine learning, deep financial data partnerships, and behavioral insights to ensure the right payments go through at the right time—without friction. We're backed by world-class investors like Atomic, Norwest Venture Partners, SpringTride, Transpose Platform, and we're growing fast.
The Problem Statement:
You will work closely with Software Engineering, Machine Learning Engineers and Data Analysts. You help ingest, organize and enable Butter to continue to deliver value on the data we collect. We make sure it arrives in a timely manner, is organized and usable, and is of a high quality. Key to all the work Butter does.
Problem Expanded:
We ingest 3rd-party data from multiple payment providers, such as Stripe, clean it and normalize it for our schema and machine learning pipelines.
We're seeking to build transformation and validation layers as far upstream as possible to ensure a smooth flow of data through our system. The transformation layer will make the data easier to work with for our reporting products and ML models, while the validation layer will ensure the data conforms to our expectations. For example: Is it null, NULL, or 'null'? Is 342 a valid country abbreviation code?
As we expand our product offering and ingest data from additional companies and 3rd-party providers the complexity of the challenge will evolve over time, keeping the problem fresh.
Scope:
You'll get to architect our system and lay the foundation for the future from both a technology and a system design perspective.
No longer will data show up without being tested and structured, as you'll create a system that checks its worst tendencies. You'll work closely with our ML and Eng team to ensure the design meets their requirements and that data properly flows through the system.
Philosophies:
- You strongly believe that action creates information.
- You want to work on a small team and have lots of responsibility.
- You look forward to being scrappy and enjoy overcoming challenges.
Requirements:
- 5+ years of experience delivering value through data at an early stage, high growth startup (ideally within the payments industry)
- Prior experience with cloud environments such as AWS or GCP
- Strong Data Modeling experience, and familiarity with different approaches (Intermediate and up)
- Strong SQL skills
- Strong Python skills
- Prior experience with workflow orchestration tools (Prefectm, Airflow, Dagster)
- Experience with distributed systems workflows (Temporal, AWS Step functions)
- Experience with cloud OLAP providers and optimization (Snowflake, Redshift, BigQuery)
- Experience with Kafka pub/sub patterns and data ingestion
- Experience with data transformation patterns and common tools (dbt)
We are focused on building a diverse and inclusive workforce. If you’re excited about this role, but do not meet 100% of the qualifications listed above, we encourage you to apply.
--------
Butter Payments is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law. Butter considers all qualified applicants in accordance with the San Francisco Fair Chance Ordinance.
Please review our CCPA policies here.
Top Skills
Airflow
AWS
BigQuery
Dagster
Dbt
GCP
Kafka
Prefect
Python
Redshift
Snowflake
SQL
Temporal
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Sr. Director is responsible for developing and executing scientific communication strategies in oncology, collaborating with stakeholders, leading financial management of projects, and ensuring alignment of messaging across teams.
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Customer Success Manager will enhance customers' operations using IoT solutions, facilitate success plans, and collaborate across departments to drive customer satisfaction and efficiency.
Cloud • Security • Software • Cybersecurity • Automation
The Engineering Manager for Fulfillment leads a globally distributed team, developing self-service fulfillment infrastructure, improving buyer experience, and ensuring engineering productivity while maintaining technical fluency.
Top Skills:
CSSHTMLJavaScriptReactRuby On RailsVue
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
