Advanced Techniques for Creating 3D Point Clouds: Using Stereo Vision in OpenCV Python

22,266
0
Published 2021-09-21
If you’re looking for courses and to extend your knowledge even more, check out this link here:
👉 www.nicos-school.com/ ➡️ get 20% OFF with the code: YOUTUBE

In this Computer Vision and OpenCV Video 📝 we are going to see How To Create Point Clouds with Stereo Vision in OpenCV Python. I'll provide the Python scripts with the images on my GitHub. You can just copy-paste everything and run it on your own computer. We will talk about stereo vision and how we can use it to create disparity maps that we can reproject out in the 3D world again. We will also take a look at the OpenCV documentation. At the end of the video, we will go through the code and create a point cloud and visualize it.

If you enjoyed this video, be sure to press the 👍 button so that I know what content you guys like to see.

_______________________________________________________________

⚒️Freelance Work: www.nicolai-nielsen.com/nncode
_______________________________________________________________

🧑🏻‍💻 My AI and Computer Vision Courses⭐:
🤖 Enroll in CustomGPT Implementation Course: www.nicos-school.com/p/customgpt-course
📚 Research Paper Implementation Course: www.nicos-school.com/p/research-paper-implementati…
📕 Object Detection Course:https:www.nicos-school.com/p/yolov7-custom-object-detect…
📗 OpenCV GPU Course:https:www.nicos-school.com/p/opencv-gpu-course
📘 SegFormer Course: www.nicos-school.com/p/transformer-and-segmentatio…
📙 Object Tracking Course: www.nicos-school.com/p/yolov8-object-tracking-cour…

🦾 Online Courses with Job Guarantee on Springboard (Save $1000 with: "NICOLAINIELSEN") www.springboard.com/landing/influencer/nicolainiel…

_______________________________________________________________

📞 Connect with Me:
🌍 My Website: www.nicolai-nielsen.com/
🤖 GitHub: github.com/niconielsen32
👉 LinkedIn: www.linkedin.com/in/nicolai-h…
🐦 Twitter: twitter.com/NielsenCV_AI

_______________________________________________________________


Tags for the video:
#PointClouds #StereoVision #ComputerVision #OpenCV

All Comments (21)
  • @CyrilPreiss0
    Hi thank you very much. What should i do if i want to use more than 2 cameras positions ? I use a robotic arm so i can take many pictures knowing the camera position each time.
  • Hi, do you know why I happen to have some coordinates in the .ply file with values as 'Inf' or '-Inf'? And if yes, do you know how to solve the problem? With those values i can not read the .ply file with open3D
  • @guansze8114
    Could you tell me the kind of camera you are using as without a stereovision webcam I cannot run the code and I am not sure where to acquire one myself?
  • @SpOOnySk
    Hello, is it possible to get Q matrix from mononuclear camera?
  • @resoluation345
    Hey everyone, just a quick one for anyone who need, in the video the two cameras are in a simple stereo setting- , no rotation only translation between two camera. Then, StereoRectify work fine. However if your stereo setting have each camera having rotation compared to the other, then you must use StereoRectifyUncalibrated otherwise it wont work well
  • @newupdates88
    Really appreciate it so much, dude! @Nicolai. As you mentioned, comparably active method has higher precision for depth map, likewise the goal is to merge these stereo vision and one from the triangular-based approach, which is One shot structured Light. Is it possible to get greater precision than utilising solely stereo vision? If so, could you just give it a shot for us?
  • Hello another great content! with the monocular camera videos you use deep learning algorithms to gain depth maps and say it's more accurate. If we use stereo camera without deep learning, dnn or ml will it be as accurate as monocular with deep learning or am I missing the videos of stereovision with deep learning?
  • @guansze7940
    Could you tell me what type of camera you are using and where I might acquire one as I cannot run the code properly with a monocular camera?
  • Hi great video!! If I would like to make a real time 3d reconstruction using video stream instead of saved images do you think it’s possible with Open3D? I know it is similar to what is done in this video but i’m struggling with adding the new captured points to the previously created ply file and updating the visualization. Any help or guide is appreciated :). Thanks
  • @guansze7940
    Do you also need a software to connect the two monocular webcams to create a stereovision?
  • @watch4aid584
    Which kind of lenses and sensor did you use for this case?
  • @a7medrafat31
    how do i convert the point cloud to a grid to do path planning?
  • @guansze61
    Did you build this by connecting two webcams or did the webcam itself have two lenses? If so how did you build the camera?
  • @moaz2836
    How can you get this Q matrix right I dont seem to be able to reconstruct using the reprojection matrix the output is mostly gibberish
  • Hello, i have run the code provided on github using images captured by my own binocular camera system. However, I found that the point cloud generated contain a lot of infs, and the xyz coordinates are either extremely big or small. Can you give me some advice on why this could happen and how to solve it? Thanks in advance.