Five AI Limited

A computer system for planning mobile robot trajectories, the computer system comprising: an input configured to receive a set of scenario description parameters describing a scenario and a desired goal for the mobile robot therein; a runtime optimizer configured to compute a final mobile robot trajectory that substantially optimizes a cost function for the scenario, subject to a set of hard constraints that the final mobile robot trajectory is guaranteed to satisfy; and a trained function approximator configured to compute, from the set of scenario description parameters, initialization data defining an initial mobile robot trajectory. The computer system is configured to initialize the runtime optimizer with the initialization data, in order to guide the optimizer from the initial mobile robot trajectory to the final mobile robot trajectory that satisfies the hard constraints, the function approximator having been trained on example sets of scenario description parameters and ground truth initialization data for the example sets of scenario description parameters.

A computer system for rendering a graphical user interface for visualising runs of a driving scenario in which an ego agent navigates a road layout, comprising an input configured to receive a map of the road layout and run data comprising a sequence of timestamped ego agent states and a time-varying numerical score quantifying the performance of the ego agent with respect a set of run evaluation rules; and a rendering component configured to cause a graphical user interface to display, for each rule: a plot of the time-varying numerical score, and a marker denoting a selected time index of the plot, the marker movable along the time axis to change the selected time index; and a scenario visualization comprising a visualization of the run at the selected time index, whereby moving the marker along the time axis causes the scenario visualisation to update as the time index is changed.

A method of predicting trajectories for agents of a scenario, the method comprising, for each agent generating an agent feature vector based on one or more observed past states of the agent, computing a set of pairwise feature vectors, each computed as a combination of the agent feature vector for that agent with a respective agent feature vector generated for each other agent of the scenario, processing the pairwise feature vectors as independent inputs to one or more interaction layers of a trajectory prediction neural network to generate a pairwise output for each pairwise feature vector, aggregating the pairwise outputs over the other agents of the scenario to generate an interaction-based feature representation for each agent, processing the interaction-based feature representation in one or more prediction layers of the trajectory prediction neural network, and generating, based on the output of the one or more prediction layers, at least one predicted trajectory for each agent.

A method for testing performance of a stack for planning ego vehicle trajectories in real or simulated driving scenarios applying driving rules to the scenario ground truth for evaluating the performance of the stack in the scenario, and providing output indicating whether each driving rule has been complied with; wherein the driving rules include at least one ODD-based response rule, wherein applying the ODD-based response rule includes processing the scenario ground truth over multiple time steps, to determine whether the scenario is within the defined ODD at each time step, and thereby detecting a change in the scenario that takes the scenario outside the defined ODD, and processing the internal state data, to determine whether a state change occurred within the stack, within a time interval, the output for the at least one ODD-based response rule indicating whether the state change occurred within the time interval.

A computer-implemented method of generating lane detector outputs, the method comprising receiving a ground truth lane image containing one or more ground truth lane borders, each ground truth lane border comprising multiple border points; and generating a lane detector output image, by applying horizontal perturbations to the multiple border points of each ground truth lane border, the horizontal perturbations determined using a learned perturbation model, the learned perturbation model constructed to impose mutual correlation in the horizontal perturbations between vertically neighbouring border points of each ground truth lane border, and comprising parameters learned by performing a statistical analysis of lane detector errors computed between computed output images of a modelled lane detector and ground truth lane border annotations corresponding to the computed output images.

A method of generating at least one trajectory in scenario comprising an agent navigating a mapped area, the method comprising: receiving an observed state of the agent and map data of the mapped area; generating a set of multiple trajectory basis elements from the observed state of the agent based on the map data; processing one or more scenario inputs in a neural network to generate a set of weights, each weight corresponding to one of the trajectory basis elements; and generating a trajectory for the agent by weighting each trajectory basis element by its corresponding weights and combining the weighted trajectory basis elements.

A computer-implemented method is provided for generating a trajectory for a first agent of a plurality of agents navigating a mapped area, the method comprising: receiving an observed state of each of the plurality of agents, and map data of the mapped area; generating an initial estimated trajectory for each of the plurality of agents based on the observed state of each agent and the map data; performing a first collision assessment to determine a likelihood of collision between the first agent and each other agent, based on the initial estimated trajectory for the first agent and the initial estimated trajectory for each other agent; and generating a second estimated trajectory for the first agent based on the observed states of each of the plurality of agents, the map data, and the results of the first collision assessment.

A computer-implemented method for assessing autonomous vehicle performance comprising receiving, at an input, performance data of at least one autonomous driving run, the performance data comprising at least one time series of perception errors and at least one time series of driving performance results; and generating, at a rendering component, rendering data for rendering a graphical user interface, the graphical user interface for visualizing the performance data and comprising: a perception error timeline, and a driving assessment timeline, wherein the timelines are aligned in time, and divided into multiple time steps of the at least one driving run, wherein, for each time step: the perception timeline comprises a visual indication of whether a perception error occurred at that time step, and the driving assessment timeline comprises a visual indication of driving performance at that time step.

A computer system for rendering a graphical user interface for visualising runs of a driving scenario in which an ego agent navigates a road layout, comprising an input configured to receive a map of the road layout and run data comprising a sequence of timestamped ego agent states and a time-varying numerical score quantifying the performance of the ego agent with respect a set of run evaluation rules; and a rendering component configured to cause a graphical user interface to display, for each rule: a plot of the time-varying numerical score, and a marker denoting a selected time index of the plot, the marker movable along the time axis to change the selected time index; and a scenario visualization comprising a visualization of the run at the selected time index, whereby moving the marker along the time axis causes the scenario visualisation to update as the time index is changed.

A computer-implemented method of planning ego actions for a mobile robot in the presence of at least one agent, comprising: searching for an optimal ego action in multiple search steps, each comprising: selecting an ego action from a set of possible ego actions, selecting an agent behaviour from a set of possible agent behaviours, running a simulation based on the selected ego action and agent behaviour, determining a possible outcome, and assigning a reward to the selected ego action, based on a reward metric, wherein selection of the ego action in later search steps is biased towards higher reward ego action(s) but selection of the agent behaviour in later search steps is biased towards riskier agent behaviour(s), a risky agent behaviour being, according to earlier search steps, more likely to result in a lower reward outcome and choosing an ego action based on the rewards computed in the search steps.