Evaluation Systems Engineer, Autonomous Vehicles

Role:

You will be part of a team that drives systematic and data-driven improvements to the Autonomous Vehicle software by designing, implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve this objective, we are looking for a highly motivated individual with excellent analytical skills to own end to end execution, methodology improvements and insight articulation/communication to ensure high-quality evaluation and release of our End-to-End ML Stack.

In this position, you will work closely with AI/ML Engineers, Simulation Engineers, Systems Engineers, Product Managers to identify, analyze, monitor and prioritize the most important signals to assess performance of our ML based stack leveraging simulation and on-road data and building scalable processes to evaluate compliance to our KPIs.

If you’re interested in having a major impact on accelerating AV Behavioral Evaluation assessment on ML-driven autonomy through creative problem solving, let’s chat!

What You’ll Do:

• Define an AV evaluation process that spans from initial conception through implementation, ensuring it is applied to the release of our end-to-end (E2E) ML stack.
• Provide hands‑on implementation of infrastructure solutions to assess AV performance from ELT tooling at GM from simulation and on‑road data.
• Proactively scope and identify metrics needed to improve our evaluation workflows and devise paths for implementation if not available.
• Contribute to automated triage strategies for AV deficiencies in an End‑to‑End stack architecture and present findings to relevant stakeholders.
• Articulate insights, summaries and recommendations to AV developers and executives based on continuous analysis of AV performance.
• Define and maintain scalable processes to identify, monitor and improve evaluation KPIs as definition of success of evaluation initiatives.
• Map and articulate link between continuous improvement processes with the product safety case and compliance with safety standards.

Your Skills & Abilities:

• Strong Python and SQL programming
• Prior knowledge and implementation of ELT pipelines for product quality analysis
• Strong problem‑solving skills – End to End ownership from problem definition to deriving the desired outcome
• Passionate about robotics/AI complexities
• Proven track record of analytical and systems engineering skills while dealing with complex systems and ambiguous AI functions
• Proven track record of root cause analysis in complex SW/HW systems
• Familiarity with analytical methods for driving behavioral analysis
• Ability to creatively problem solve with limited supervision
• Motivated by a fast paced, challenging environment with high expectations and quick turnarounds
• Strong cross‑functional communication and collaboration skills
• Ability to learn quickly, starting with little information and quickly becoming an expert in your domain
• Proven experience at communicating data‑driven decisions to leadership
• BS, MS or PhD in Engineering or related discipline or equivalent combination education and experience

What Will Give You Competitive Edge:

• Experience with statistical methods for product evaluation and risk assessment
• Experience with developing data‑driven metrics
• Experience with GitHub and Jira or equivalent tools
• Experience with robotics and AV/ADAS systems

Compensation:

The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington.

• The salary range for this role is $125,00 to 191,700. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position.
• Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.

Remote: This role is based remotely but if you live within a 50‑mile radius of Atlanta, Austin, Detroit, Warren, Milford or Mountain View, you are expected to report to that location three times a week, at minimum.

Relocation: This job may be eligible for relocation benefits.