ZoeDepth #123
Replies: 2 comments 8 replies
-
|
Just an example from zoeDepth (The contours are from downsampling to 8-bit their 16-bit seems was only outputting black images). I think you might have been onto something when you suggested ZoeDepth was the repo used in those other examples. Because I think this would be really high quality with 16-bit depth. zoe_n (indoor version zoe_k is outdoor) The thing that seems really cool is they appear to be calibrated depth which should mean that depth scaling is no longer needed. Although you still need might need full scene scaling. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for sharing this example. This is really good ! Could it be then that the division by 255 I read about on Reddit was part of the ZoeDepth code? Time to use the code search function on that repo ! |
Beta Was this translation helpful? Give feedback.
-
|
Here are the lines I found that had a division by 255 That one is different, but interesting: it seems to transform float16 into 8bpc for depth image EDIT: do you know why the code corresponding to each line is not appearing ? Is it because it references code from a different repo ? Or did I forget some kind of formatting flag ? |
Beta Was this translation helpful? Give feedback.
-
|
@AugmentedRealityCat @graemeniedermayer |
Beta Was this translation helpful? Give feedback.
-
|
I will add the mesh generation code from the zoedepth repo later too, it's a very clean and fast implementation that can also remove the occluded edges.. yes, wavefront obj .. |
Beta Was this translation helpful? Give feedback.
-
|
I was really impressed by the 3d panorama feature as it's exactly what I was doing manually using your code for depth estimation and cinema4d for the 3d extraction, but just faster, cleaner and better. The 3d meshes produced with the Zoe-Depth code are also much cleaner, with none of the intersecting cross-triangulation problems I had with the 3d-photo-inpainting generated meshes. No need to remesh point clouds anymore to get proper topology for texture and lighting. |
Beta Was this translation helpful? Give feedback.
-
|
Yes the ZoeDepth output is quite amazing, definitely another step up. The mesh generation code is really beautiful and runs pretty fast too. |
Beta Was this translation helpful? Give feedback.
-
|
One shortcoming of the current Zoe-Depth extension is that it doesn't do a seamless wrapping when creating 3d panoramas: there is a cut in the sphere, right at the frontier of the depthmap. This could be solved by generating depth maps that would tile seamlessly on X-axis, exactly like @Ladypoly was asking for in another thread. I've done it manually in photoshop and it works. |
Beta Was this translation helpful? Give feedback.
-
|
Tiling support is on the list. The mesh generation has been added. |
Beta Was this translation helpful? Give feedback.
-
Can the code from this new ZoeDepth monocular depth estimation research be adapted to work with the depth map extension ?
https://github.com/isl-org/ZoeDepth
Beta Was this translation helpful? Give feedback.
All reactions