If you do write data to disk PLEASE use a format for which readers are already common. It would be good to be able to directly read using R or Python without fitst needing to import anything connected with ROS.
The goal should be to leverage a large ecosystem of data analysis tools that are already in common use in other industries (such as data science)
I/O performance should be a concern too.