This is a summary of the last meeting that took place on the 4th of December 2020.
In my opinion, even if everyone the registered on the doodle didn’t show up, the meeting was a success and gave birth to nice discussion and conclusions.
Thanks to the participants.
We have subdivided the project into multiple smaller parts :
I.Validation data :
The first subject we discusses was to agree on testing datasets, for this, we chose one developed by the university of Bonn, as it is already segmented, the goal would be to get synthetic data that, once trained would as good as the real life one.
II.Synthetic data generation :
To get the synthetic data, we have multiple ways, we will focus on mainly two :
1.To get it from photogrammetry(using meshroom or other tools like blender), meaning a 3D scan from pictures, a 3D model of a small simple plant(with a simple sample video) is available on the git-hub account of the project linked further-down.
2.To model leaves (from a picture), then, using a mathematical model, “program” a 3D model of the plant.
Here is a link of a paper using this technic : https://arxiv.org/abs/1612.03019
III.Data augmentation :
The synthetic data is usually too noiseless to be usable as is. For this we need to augment the data.
For this, we have decided to focus on the BlenderProc objects, developed by the DLR :
We also have to test if we need to simulate a soil background or should we completely randomize the background.
IV. Miscellaneous :
Another thing we could think of is, maybe have a neural network detect leaves only (so not plants as a whole) and then have another machine learning algorithm cluster the different leaves into plants.
Here is a link to the git-hub project, You will find a Kanban of the project, feel free to work on a task or add your own:
Please, if you work on this project, share your results, whether they are positive or negative, you will still help the community and probably get feedback.
V. Conclusion :
Improvements ideas for the next meetings :
- Change the meeting time.
- Notify the participant a bit more in advance.
- Switch to Jitsi or BigBlueButton
- Ask if a recording is necessary or are these summaries sufficient.
Thank you again to all the participants for attending the meeting and putting links in the post. Hope to read updates from you soon !
Have a nice week.