[PYTHON] I tried to easily create a high-precision 3D image with one photo [3]. MiDaS of feat. Intel-isl only depth without permission.

First output

** Arbitrarily depth only feat. Intel-isl. The result of **.

Here, the following two github outputs are mixed. For the former, only the calculation of depth is replaced with the latter. There is no deep meaning. I expected to get good results, For the time being, ** not much good has happened. ** **

Division of roles github
Other than depth https://github.com/vt-vl-lab/3d-photo-inpainting
You can create a 3D image from one photo
depth https://github.com/intel-isl/MiDaS
Depth can be calculated from one photo

Overview

** One photo ** ** High-precision 3D image ↓ Easy creation **.

I tried to easily create a high-precision 3D image with one photo [1]. (Depth can now be edited in PNG.) See the article.

here,

The depth can be changed instead of using the original processing.
intel-Created using isl's github (PNG)And tried to adopt it

(↑ This is all the procedure)

⇒ ** Collaboration without permission ** ⇒⇒ ** I wonder if I can do it **

Below is the original paper and github.

https://arxiv.org/pdf/2004.04727.pdf Paper "3D Photography using Context-aware Layered Depth Inpainting" Meng-Li Shih1 and others

github is below. https://github.com/vt-vl-lab/3d-photo-inpainting

** Used to create depth information (PNG) ** The github of intel-isl is below. https://github.com/intel-isl/MiDaS

result

The first thing shown above is the ** result **. The original (= not replaced with MiDaS of intel-isl) is I tried to easily create a high-precision 3D image with one photo [1]. (Depth can now be edited in PNG.) See the article.

Is the condition a little off? ** Not good ** ** However, there are some areas that have improved. ** I feel.

from now on

I would like to consider it a little more carefully. Simple, I don't know the following two.

If you have any comments, please let us know.

reference. I tried to easily create a high-precision 3D image with one photo [2]. (Try processing depth with numpy) It is described above, but just in case ↓ I tried to easily create a high-precision 3D image with one photo [1]. (Depth can now be edited in PNG.)

Recommended Posts

I tried to easily create a high-precision 3D image with one photo [3]. MiDaS of feat. Intel-isl only depth without permission.
I tried to easily create a high-precision 3D image with one photo [2]. (Try processing depth with numpy)
I tried to easily create a high-precision 3D image with one photo [1]. (Depth can now be edited in PNG.)
I tried to easily create a high-precision 3D image with one photo [-1]. (Is the hidden area really visible?)
I tried to easily create a high-precision 3D image with one photo [0]. (Confirmed how to capture the space, put a net)
I tried using PI Fu to generate a 3D model of a person from one image
I tried to create a list of prime numbers with python
I tried to easily create a fully automatic attendance system with Selenium + Python
I tried to create a model with the sample of Amazon SageMaker Autopilot
I came up with a way to create a 3D model from a photo Part 02 Image loading and vertex drawing
[Python] I tried to automatically create a daily report of YWT with Outlook mail
Creating a highly accurate 3D image easily with one photo! (You can now edit the depth in PNG.) [1-E]
I tried to find the entropy of the image with python
I tried to automatically create a report with Markov chain
I came up with a way to create a 3D model from a photo Part 01 Creating an environment
I tried to create Bulls and Cows with a shell program
I tried to make a mechanism of exclusive control with Go
How to easily create a CG image like a toy photo "Ubuntu / Linux" ・ Photo realistic rendering with LeoCAD & Blender
I tried to make a thumbnail image of the best avoidance flag-chan! With RGB values ​​[Histogram] [Visualization]
I tried to create a program to convert hexadecimal numbers to decimal numbers with python
I came up with a way to make a 3D model from a photo.
I tried to create a plug-in with HULFT IoT Edge Streaming [Development] (2/3)
I tried to create a plug-in with HULFT IoT Edge Streaming [Execution] (3/3)
[Outlook] I tried to automatically create a daily report email with Python
I tried to create a plug-in with HULFT IoT Edge Streaming [Setup] (1/3)
I tried to create a linebot (implementation)
I tried to create a linebot (preparation)
I tried 3D detection of a car
I want to display only different lines of a text file with diff
I tried to make a simple mail sending application with tkinter of Python
I tried to create a class that can easily serialize Json in Python
[Patent analysis] I tried to make a patent map with Python without spending money
When I tried to create a virtual environment with Python, it didn't work
I tried to easily visualize the tweets of JAWS DAYS 2017 with Python + ELK
[Azure] I tried to create a Linux virtual machine in Azure of Microsoft Learn
I tried to extract a line art from an image with Deep Learning
I tried to create a button for Slack with Raspberry Pi + Tact Switch
I tried to make a simple image recognition API with Fast API and Tensorflow
I tried image recognition of CIFAR-10 with Keras-Learning-
I want to easily create a Noise Model
I tried image recognition of CIFAR-10 with Keras-Image recognition-
I tried to correct the keystone of the image
I want to collect a lot of images, so I tried using "google image download"
I tried to create a reinforcement learning environment for Othello with Open AI gym
I came up with a way to make a 3D model from a photo. 0 Projection to 3D space
Image processing with Python (I tried binarizing it into a mosaic art of 0 and 1)
I tried to create a class to search files with Python's Glob method in VBA
I tried scraping food recall information with Python to create a pandas data frame
I tried to extract features with SIFT of OpenCV
I tried to draw a route map with Python
I tried to automatically generate a password with Python3
I want to manually create a legend with matplotlib
[Python] How to create a 2D histogram with Matplotlib
I tried to automatically generate OGP of a blog made with Hugo with tcardgen made by Go
[Python] I want to make a 3D scatter plot of the epicenter with Cartopy + Matplotlib!
Matching app I tried to take statistics of strong people & tried to create a machine learning model
I tried to create a Python script to get the value of a cell in Microsoft Excel
Create a 2D array by adding a row to the end of an empty array with numpy
I wrote a doctest in "I tried to simulate the probability of a bingo game with Python"
[Graph drawing] I tried to write a bar graph of multiple series with matplotlib and seaborn
A person who wants to clear the D problem with ABC of AtCoder tried to scratch