Lighthouse Logo

Lighthouse

Senior Data Acquisition R&D Engineer

Posted 20 Days Ago
Be an Early Applicant
Metropolitan Area Apt, ON
Senior level
Metropolitan Area Apt, ON
Senior level
As a Senior Data Acquisition R&D Engineer, you'll drive research and development for advanced web data extraction techniques and mentor team members, tackling complex problems in data processing at scale.
The summary above was generated by AI

At Lighthouse, we’re on a mission to disrupt commercial strategy for the hospitality industry. Our innovative commercial platform takes the complexity out of data, empowering businesses with actionable insights, advanced pricing tools, and cutting-edge business intelligence to unlock their full revenue potential.

Backed by $370 million in series C funding and driven by an unwavering passion for growth, we’ve welcomed five companies into our journey and have surpassed $100 million in ARR in 2024. Our 850+ teammates span 35 countries and represent 34 nationalities.

At Lighthouse, we’re more than just a workplace – we’re a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry’s most exciting rocket-ship? 🚀

What you will do

You will join us as a Senior Data Acquisition R&D Engineer, playing a critical role in our data extraction process. With a deep interest for the inner workings of the internet, you will ensure we can reliably extract and process billions of data points every day. You will be a key technical expert, pushing the boundaries of our capabilities and mentoring team members. This role is perfect for someone who loves solving complex technical puzzles and wants to share their passion with the team.

Where you will have impact

  • Drive the research and development of advanced techniques for web data extraction and processing at scale.
  • Leverage your expertise in reverse engineering and browser technologies to push the boundaries of our data acquisition capabilities.
  • Tackle complex web scraping challenges, including user agent emulation, cost-efficient proxy utilisation, and effective load distribution.
  • Act as a subject matter expert, providing mentorship and support to team members while fostering an environment of continuous learning.
  • Collaborate with diverse engineering teams to address challenges and advance initiatives related to data extraction and infrastructure.
  • Contribute to our data extraction infrastructure, ensuring it remains scalable, reliable, and robust.

About our team

Our team is at the helm of our sophisticated data extraction infrastructure. Tasked with the responsibility of acquiring pricing data from over 200 unique data sources, we process nearly 200 million requests each day. The data we collect is the lifeblood of our products. We are committed to ensuring its reliable and timely delivery, thereby powering our diverse product portfolio.

What's in it for you?

  • Flexible working environment: Work from home or at one of our global offices.
  • Flexible time off: Autonomy to manage your work-life balance.
  • Alan Healthy benefits: 160€/month for food, transportation, or nursery.
  • Wellbeing support: Subsidized up to 80% ClassPass subscription.
  • Comprehensive health insurance: 100% Alan coverage for you, your spouse, and dependents.
  • Collaborative team: High-bar, friendly, creative, and passionate colleagues.
  • Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
  • Impactful work: Shape products relied on by 85,000+ users worldwide.
  • Competitive compensation: Proactively maintained to value your work.
  • Referral bonuses: Earn rewards for bringing in new talent.

Who you are

  • Multiple years of experience in at least one of the following areas: networking protocols, browser development, reverse engineering websites or mobile applications, or anti-bot technology.
  • Proficiency in at least one modern programming language.
  • Strong problem-solving and analytical skills, with the ability to identify and troubleshoot complex technical issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
  • Fluency in English.

We welcome

  • Experience or a strong interest in mentoring colleagues on technical topics.
  • A proven track record of technical excellence, such as open-source contributions, technical articles, or conference talks.
  • A keen interest in web security and its application to data acquisition.

Technologies you will work with

Google Cloud, Kubernetes, NodeJS, TypeScript, Scrapy, Python, Rust, Prometheus, Grafana

#LI-Remote

Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. We actively encourage applications from individuals with disabilities and are dedicated to providing reasonable accommodations throughout the recruitment process and during employment to ensure all qualified candidates can participate fully. Our commitment to equality is not just a policy; it's part of our culture.

If you share our passion for innovation and teamwork, we invite you to join us in shaping the future of the hospitality industry. At Lighthouse, our guiding light is to be an equal opportunity employer, and we encourage individuals from all walks of life to apply. Not ticking every box? No problem! We value diverse backgrounds and unique skill sets. If your experience looks a little different from what we've described, but you're passionate about what we do and are a quick learner, we'd love to hear from you.

We value the unique perspective and talents that you bring, and we're excited to see how your light can shine within our team. We can't wait to meet you and explore how we can grow and succeed together, illuminating the path towards a brighter future for the industry. #LI-Hybrid

Top Skills

GCP
Grafana
Kubernetes
Node.js
Prometheus
Python
Rust
Scrapy
Typescript

Similar Jobs

15 Minutes Ago
Easy Apply
Hybrid
Toronto, ON, CAN
Easy Apply
Mid level
Mid level
Big Data • Cloud • Software • Database
This role involves content creation, customer communication, and collaboration across teams to modernize solutions for enterprise clients using MongoDB's platform.
Top Skills: Cloud ProvidersData AnalyticsData ScienceDatabase ProgrammingMongoDB
An Hour Ago
Hybrid
13 Locations
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Lead Varicent implementation projects, leveraging cloud technologies, ensuring timely delivery, coaching teams, and collaborating with clients for successful sales performance solutions.
Top Skills: AWSAzureDatabricksGCPPower BIRedshiftSnowflakeSQLVaricent
An Hour Ago
Easy Apply
Hybrid
Toronto, ON, CAN
Easy Apply
Mid level
Mid level
Artificial Intelligence • Marketing Tech • Software
The Payroll Specialist processes payroll for multiple countries, ensures compliance with laws, handles payroll data auditing, supports employee inquiries, and collaborates with teams for accurate payroll accounting.
Top Skills: AdpGustoPaychexUkgWorkday

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account