Description
We are looking for a highly technical Senior Software Engineer to join the Compass team and help design, build, deploy, and support production data products and services for precision agriculture.
The Compass team develops software and infrastructure that turns machine, agronomic, geospatial, logistics, and other data into production capabilities. Our work spans backend APIs, event-driven data pipelines, cloud infrastructure, databases, Databricks integrations, monitoring, and operational tooling.
We are looking for someone who is comfortable working across technologies, can independently solve ambiguous technical problems, and can take a capability from initial design through production deployment and support. This role will work closely with software engineers, data scientists, product teams, and partner engineering teams.
Essential Attributes / Experience
- Excellent Python development skills with production software deployment experience
- Strong experience designing and developing REST APIs, backend services, and data-processing applications
- Strong understanding of AWS, including services such as Lambda, API Gateway, IAM, S3, SQS, EventBridge, and RDS/Aurora
- Experience with relational databases, particularly PostgreSQL
- Experience building and maintaining Infrastructure as Code, preferably Terraform
- Experience with CI/CD, automated testing, and Git/GitHub development practices
- Strong troubleshooting skills across application, data, infrastructure, and integration layers
- Ability to independently investigate complex problems, propose solutions, and deliver production-quality implementations
- Strong communication skills and ability to work across engineering, data science, product, and business teams
- Experience improving systems for scalability, reliability, security, performance, and cloud cost efficiency
Preferred Attributes
- Experience with Databricks, Spark, PySpark, SQL, Delta Lake, or similar data platforms
- Experience with event-driven and serverless architectures
- Experience with Docker and containerized applications
- Experience with DBMate, Pydantic, AWS Lambda Powertools, or similar Python frameworks
- Experience with authentication and authorization patterns such as AWS IAM and OAuth/OIDC
- Experience with observability platforms such as Datadog
- Experience processing machine, agricultural, logistics, or other high-volume data
- Experience with GitHub Actions and automated cloud deployments
Example Responsibilities (Including but not limited to)
- Architect and implement new AWS and Databricks-based solutions while improving existing Compass services for scalability, reliability, and maintainability
- Design, build, and maintain Python REST APIs, Lambda functions, backend processes, and event-driven services
- Build pipelines that ingest, transform, process, and persist machine, agronomic, geospatial, logistics, and other data
- Build and maintain AWS infrastructure using Terraform
- Design and support PostgreSQL/Aurora databases, including schemas, migrations, application connectivity, and performance
- Build solutions supporting both real-time/event-driven workloads and scheduled batch processing
- Develop and support Databricks integrations and data-processing workflows as needed by Compass products
- Create and maintain CI/CD pipelines using GitHub Actions, including automated testing and application/infrastructure deployment
- Implement and improve logging, metrics, dashboards, monitoring, and alerts using Datadog
- Troubleshoot production issues across APIs, databases, queues, cloud infrastructure, data-processing jobs, and external integrations
- Identify opportunities to improve system performance, scalability, reliability, and cloud cost