Meeting minutes:
- Performance measurement
- Erik says that there are different and biased performance test benchmarks for DDS floating around.
-
Static executor
- Bosch and Nobleo are running the experiments and also measuring the performance with this code:
- testbench Generator: https://github.com/micro-ROS/rcl_executor/tree/feature/testbench/rcl_executor_testbench
- testbench for the static rclcpp executor (nobleo): https://github.com/nobleo/rclcpp_executor_testbench
- With above packages you can: split up benchmark, configure the number of publishers, subscribers, essentially it is a benchmark generator, simple way to generate test cases & can see overhead in DDS, rmw, …
- Bosch and Nobleo are running the experiments and also measuring the performance with this code:
- Different contributors to the ROS 2 ecosystem use benchmarks & tools that are either all different - and thus cannot be compared - or simply provide invalid results.
- ADLINK
- benchmark for Cyclone DDS
- eProsima
- benchmark for Fast-RTPS
- Bosch & Nobleo
- benchmarks/analyses for:
- Static executor
- LET
rcl
executor
- using:
-
ros2_tracing
+tracetools_analysis
(instrumentation, tracing, and analysis/visualization)
-
- benchmarks/analyses for:
- New ROS 2 real-time inverted pendulum demo (from Carlos)
- looking at memory allocation, page faults, context switches, etc.
- using
ros2_tracing
+tracetools_analysis
(instrumentation, tracing, and analysis/visualization)
- ADLINK
- LET rcl executor
- Single-process, real-time rmw
- @eboasson writing of GitHub issues
- https://github.com/ros2-realtime-demo/pendulum => @carlossv and @christophebedard discussed inclusion of LTTng tracing
Recordings
- https://drive.google.com/file/d/1pXmoj1KZhb4vD7-bZ_jDIFWFHDBJa8mS/view?usp=sharing
- https://drive.google.com/file/d/1Yo4PNUNi8CRBh6hA9sLGrnpHpVQgkW8_/view?usp=sharing
Action items:
- AI: Dejan to write a longer Discourse post on how to measure performance correctly
- AI2: Silexica to implement their Performance Testing Platform for ROS community
- AI3: @eboasson to finalize the issues for single-process, real-time rmw
Agenda for next week:
- @ralph-lange LET executor: ROS2 Real-time Working Group Online Meeting 5 - Nov 13, 2019, 7AM PDT (UTC-7)
- @eboasson single-process, real-time rmw