Senior Data Engineer (Remote) - job 1 of 2

San FranciscoEngineering /Full-time /Remote

Apply for this job

About AllTrails

AllTrails is the world’s most popular and trusted platform for outdoor exploration. We connect people to the outdoors, help them discover new places, and elevate their experiences on the trail. With the most comprehensive collection of trails in the world, AllTrails supports inclusive access to nature for a global community of millions of trailgoers. Every day, we solve incredibly hard problems to get more people outside, for their wellbeing and the collective care of the natural world. Join us!

This is a U.S.-based remote position. San Francisco Bay Area employees are highly encouraged to come into the office one day a week.

What You’ll Be Doing:

• Work cross-functionally to ensure data scientists have access to clean, reliable, and secure data, the backbone for new algorithmic product features
• Build, deploy, and orchestrate large-scale batch and stream data pipelines to transform and move data to/from our data warehouse and other systems
• Deliver scalable, testable, maintainable, and high-quality code
• Investigate, test-for, monitor, and alert on inconsistencies in our data, data systems, or processing costs
• Create tools to improve data and model discoverability and documentation
• Ensure data collection and storage adheres to GDPR and other privacy and legal compliance requirements
• Uphold best data-quality standards and practices, promoting such knowledge throughout the organization
• Deploy and build systems that enable machine learning and artificial intelligence product solutions
• Mentoring others on best industry practices

Requirements:

• Minimum of 6 years of experience working in data engineering
• Expertise both in using SQL and Python for data cleansing, transformation, modeling, pipelining, etc.
• Proficient in working with other stakeholders and converting requirements into detailed technical specifications; owning and leading projects from inception to completion
• Proficiency in working with high volume datasets in SQL-based warehouses such as BigQuery
• Proficiency with parallelized python-based data processing frameworks such as Google Dataflow (Apache Beam), Apache Spark, etc.
• Experience using ELT tools like Dataform or dbt
• Professional experience maintaining data systems in GCP and AWS
• Deep understanding of data modeling, access, storage, caching, replication, and optimization techniques
• Experienced with orchestrating data pipelines and Kubernetes-based jobs with Apache Airflow
• Understanding of the software development lifecycle and CI/CD
• Monitoring and metrics-gathering (e.g. Datadog, NewRelic, Cloudwatch, etc)
• Willingness to participate in a weekly on-call support rotation - currently the rotation is monthly
• Proficiency with git and working collaboratively in a shared codebase
• Excellent documentation skills
• Self motivation and a deep sense of pride in your work
• Passion for the outdoors
• Comfort with ambiguity, and an instinct for moving quickly
• Humility, empathy and open-mindedness - no egos
• AI Native - You instinctively leverage AI tools to enhance your productivity, creativity, and decision-making. You’re fluent in prompting, comfortable evaluating outputs, and constantly exploring new ways to integrate AI into your workflows.

Bonus Points:

• Experience working in a multi-cloud environment
• Experience with GIS, H3, or other mapping technologies
• Experience with Amplitude
• Experience with infrastructure-as-code, such as Terraform
• Experience with machine learning frameworks and platforms such as VertexAI, SageMaker, MLFlow, or related frameworks

What We Offer:

• A competitive and equitable compensation plan. This is a full-time, salaried position that includes equity
• Physical & mental well-being including health, dental and vision benefits
• Trail Days: No meetings first Friday of each month to go test the app and explore new trails!
• Unlimited PTO
• Flexible parental leave 
• Remote employee equipment stipend to create a great remote work environment
• Annual continuing education stipend
• Discounts on subscription and merchandise for you and your friends & family
• An authentic investment in you as a human being and your career as a professional

$170,000 - $210,000 a year

The successful candidate’s starting salary will be determined based on various factors such as skills, experience, training and credentials, as well as other business purposes or needs. It is not typical for a candidate to be hired at or near the top of the range of their role and compensation decisions are dependent on the factors and circumstances of each case.

Nature celebrates you just the way you are and so do we! At AllTrails we’re passionate about nurturing an inclusive workplace that values diversity. It’s no secret that companies that are diverse in background, age, gender identity, race, sexual orientation, physical or mental ability, ethnicity, and perspective are proven to be more successful. We’re focused on creating an environment where everyone can do their best work and thrive.

AllTrails participates in the E-Verify program for all remote locations.

By submitting my application, I acknowledge and agree to AllTrails' Job Applicant Privacy Notice.