Evaluation on the public CARLA Leaderboard #76
Description
hello! first thank you for releasing this codebase. I would like to ask how the evaluation indicators are calculated?
The article notes that route Completion is the percentage of the route completed by the autonomous agent. Infraction Score measures the number of infractions made along the route, with pedestrians, vehicles, road layouts, red lights, and etc. Driving Score is the main metric which is the product of Route Completion and Infraction Score.
Values based on Route Completion and Infraction Score are not equal to Driving Score. I am genuinely asking for advice as I have been studying this section recently and these are very important to my learning.
And is it possible to work out data such as Table2 in the text directly in the code?
Thank you!