Software Engineer, Operational AI

Engineering at Brex

The Engineering team includes Data, IT, Security, and Software, and is responsible for building innovative products and infrastructure for both internal and external users. We have multiple autonomous and collaborative teams who are eager to learn, teach, and constantly improve how things work. Together, we strive to build robust and scalable systems that enable Brex to grow rapidly and help our customers reach their full potential.

What you’ll do

We are looking for a software engineer to join our new Operational AI team. The Operational AI  team is in charge of the AI projects that keep our business running behind the scenes, such as operational automation. Delivering on these projects requires development on the platform to enable both traditional ML model and generative AI at Brex, with a vision to scale and democratize machine learning and AI to meet the needs of business. You would be collaborating with data scientists and engineers from across all of engineering within Brex to build, maintain and scale our AI systems.

Responsibilities

• Design and develop the infrastructure to provide a cohesive, integrated, and managed development life cycle for traditional ML models and LLMs
•  Architecting, building, and diagnosing production AI/ML systems
• Working closely with AI/ML application teams to design seamless workflows for continuous model training, inference, and monitoring
• Defining and providing strong SLAs and metrics around latency, throughput and resource
• Interfacing with both ML experts and platform engineers to understand workflows, pinpoint and resolve inefficiencies, and inform the next set of features for the platforms
• Troubleshooting and debugging user issues
• Providing operational and user-facing documentation
• You will be responsible for developing, cultivating and nurturing the AI-driven culture within Brex.

Requirements

• 3+ years of professional experience in a software engineering role or equivalent experience
• Experience working with backend programming languages, such as Kotlin, Python, etc
• Experience building custom MLOps platform solutions based in business needs 
• Experience leveraging and integrating industry MLOps solutions, such as AWS Sagemaker, Databricks, etc 
• Experience using LLM technologies such as langchain, LLM AIs 
• Familiarity with software engineering development cycles
• Ability to hold yourself and the team to high standards
• Strong communication and interpersonal skills
• Must be willing to work in office 2 days per week on Wednesday and Thursday.

Bonus points

• Experience driving initiatives at a broader level across an organization or company
• Strong writing skills
• Proactive approach
• You know what prompt engineering is and how to get the most out of an LLM

Compensation

The expected salary range for this role is $152,000 - $190,000. However, the starting base pay will depend on a number of factors including the candidate’s location, skills, experience, market demands, and internal pay parity. Depending on the position offered, equity and other forms of compensation may be provided as part of a total compensation package.