Afresh Logo

Afresh

Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Easy Apply
Hybrid
2 Locations
Senior level
Easy Apply
Hybrid
2 Locations
Senior level
As a Senior Data Engineer at Afresh, you'll improve how customer data is integrated and processed, designing robust ETLs and enhancing platform tools to support scalability and accuracy in handling large datasets.
The summary above was generated by AI

Afresh is on a mission to eliminate food waste and make fresh food accessible to all. Our first A.I.-powered solution optimizes ordering, forecasting, and store operations for fresh food departments in brick-and-mortar grocers. With our Fresh Operating System, regional and national grocery retailers have placed $1.6 billion in produce orders across the US and we've helped our partners prevent 34 million pounds of food from going to waste. Working at Afresh represents a one-of-a-kind opportunity to have massive social impact at scale by leveraging uncommonly impactful software – we hope you'll join us!

About the Role

As a Senior Data Engineer, you’ll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools/improve the platform to make customer integrations faster, more accurate, and more scalable. You’ll also contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution.

What You’ll Do

  • Build tools and frameworks that streamline customer integrations, enabling faster onboarding and better handling of customer data.
  • Create robust ETLs in PySpark and DBT to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.
  • Investigate and implement new technologies into the data platform, focusing on practical solutions that address current pain points and anticipate future needs.
  • Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.
  • Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.
  • Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.
  • Support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback.

What Makes You a Great Fit

We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification.

  • Significant experience designing and maintaining ETLs that process large-scale datasets.
  • Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT.
  • Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
  • A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done.
  • Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them.
  • A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort.
  • Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences.
  • Proven leadership in technical projects, with a willingness to mentor and help others grow.

Why Work Here

  • Join a mission-driven company reducing millions of pounds of food waste in grocery stores per year.
  • Work on challenging, real-world problems that have a direct impact on our customers.
  • Be part of a collaborative, supportive team where your ideas are valued and acted on.
  • Use cutting-edge tools and platforms to solve meaningful data challenges.

We’re looking for someone who thrives on tackling complex data problems and takes pride in building systems that work seamlessly at scale. If that sounds like you, we’d love to hear from you!

About Afresh
Founded in 2017, Afresh is working on the #1 solution to curb climate change: reducing food waste. By combining human insight and transformative technology, we're helping grocers provide fresher food to customers at more affordable prices.
Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals including ICML, and we've raised over $148 million in funding from investors including former co-CEO of Whole Foods Market Walter Robb and Eric Schmidt's Innovation Endeavors.

Fresh is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility.
Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law.

Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, WI. However, there may be key roles that will require a candidate/employee to be local to our San Francisco, CA office. In which case this requirement will be included in the job posting details under "Skills and experience" for reference. 

Top Skills

Databricks
Dbt
Pyspark
Python
Snowflake
SQL

Similar Jobs

22 Hours Ago
In-Office or Remote
Toronto, ON, CAN
Senior level
Senior level
Healthtech • Other • Productivity • Software • Automation
As a Senior Full-Stack Engineer, you'll architect, develop, and maintain scalable systems, mentor junior engineers, and ensure compliance with strict standards.
Top Skills: JavaJavaScriptKafkaNode.jsReactTypescript
6 Hours Ago
In-Office
2 Locations
Senior level
Senior level
Fintech • Payments • Financial Services
The Senior Data Engineer will design, develop, and maintain data repositories, manage data requests, and provide insights to support digital campaigns and reporting.
Top Skills: AWSBitbucketGitJenkinsLambdaPysparkPythonS3SQLStep FunctionsTerraform
6 Days Ago
In-Office
Toronto, ON, CAN
Senior level
Senior level
Transportation
As a Senior Data Engineer, you'll develop scalable data pipelines, evolve data models, and support analytics and machine learning efforts for mapping at Lyft, while mentoring junior engineers and ensuring data quality.
Top Skills: Apache AirflowAWSBashCollibraDbtDynamoDBFlinkGreat ExpectationsHbaseHdfsHiveIcebergKafkaKubernetesMonte CarloMySQLOracleParquetPigPostgresPrestoPythonRubyS3SodaSparkSpark StreamingSqlserver

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account