People and other dynamic objects create faulty spatial meshes (ghost meshes). We hope that semantic segmentation and spatial meshing could be combined so that people etc are excluded from the meshing process. Or ideally, the meshing would be updated super fast but I guess that is not possible yet.
Hi! Please put this in the feature requests 
Hi Jelmer, Thanks for letting me know this feature would be helpful to you. I’m sending this to the dev team to see what we can do about getting this into a future release.