未登录,请登录后再发表信息
最新评论 (0)
播放视频

从照片生成3D户型图

Instant 3D Floorplans From Your Photos | Two Minute Papers

学霸们 大家好 这里是Károly Zsolnai-Fehér为您呈现的2分钟papers
Dear Fellow Scholars, this is Two Minute Papers with Károly Zsolnai-Fehér.
在这篇文章里 我们感兴趣的是如何给一个公寓创造一个三维的虚拟漫游
In this piece of work, we are interested in creating a 3D virtual tour for an apartment.
但是 在这件公寓中 并没有可用的三维数据 相反 这个算法的输入数据
However, for this apartment, no 3D information is available – instead, the input for the
是一些我们能够十分容易获取的东西 在这里 是一个二维的平面户型图和一组
algorithm is something that we can obtain easily, in this case, a 2D floorplan and a
在公寓中拍摄的图像
set of images that we shot in the apartment.
有了这些信息 我们想创造一个三维的户型图而且它不仅符合真实
From this information, we would create a 3D floorplan that is not only faithful to the
的几何 而且真实的图片也被映射到
real one in terms of geometry, but the photos with the correct viewpoints are also to be
对应的墙面上
assigned to the correct walls.
为了达到这种效果 我们必须解决一系列挑战性的问题
In order to accomplish this, one has to overcome a series of challenging problems.
比如 我们必须估计出每个房间的布局 并且恢复出
For instance, we have to estimate the layout of each room and find the location of the
摄像机在每幅照片中的位置
camera in each of these images.
此外 为了得到高质量的结果 我们需要从输入数据中提取
Also, to obtain high-quality solutions, the goal is to extract as much information from
尽量多的信息
the inputs as possible.
文章作者意识到二维平面图提供了远超我们所想的
The authors recognized that the floorplans provide way more information than we take
信息量
for granted.
例如 平面图不仅仅显示是各个房间的几何位置关系 还可以被用来
For instance, beyond showing the geometric relation of the rooms, it can also be used
获得每个房间的长宽比
to find out the aspect ratios of the floor for each room.
窗户和墙的比例也可以从照片和平面图中估计和匹配出来
The window-to-wall ratios can also be approximated and matched between the photos and the floorplan.
这些额外信息变得非常有用 尤其当我们想要找出哪个房间
This additional information is super useful when trying to find out which room is to be
在3D户型图的哪个位置
assigned to which part of the 3D floorplan.
相比于只考虑图像 我们还有一大堆机器学习算法可用
Beyond just looking at the photos, we also have access to a large swath of learning algorithms
这些算法可以可靠地分辨出照片里是浴室还是卧室
that can reliably classify whether we’re looking at a bathroom or a living room.
甚至还有更多的约束可以被添加到算法中 进而大幅削减
There are even more constraints to adhere to in order to aggressively reduce the number
实际的组合数目 你一定要看看这篇文章 里面
of physical configurations, make sure to have a look at the paper for details, there are
有很多很酷的技巧
lots of cool tricks described there.
和以前一样 文章链接在本视频的描述信息中
As always, there is a link to it in the video description.
例如 由于可行解的参数空间很大 一种分支限界算法
For instance, since the space of possible solutions is still too vast, a branch and
被用来减少需要考察的可行解
bound type algorithm is proposed to further decimate the number of potential solutions
的数目
to evaluate.
在视频中你可以看到 在和参考规划图的比较的时候
And as you can see here, the comparisons against ground truth floorplans reveal that these
算法得到的结果还是比较忠实于现实的
solutions are indeed quite faithful to reality.
文章作者还为我们提供了一个数据库 其中有超过200个完整公寓
The authors also kindly provided a dataset with more than 200 full apartments with well
的上千张已标注的照片 这也方便了将来的相关研究工作
over a thousand photos and annotations for future use in followup research works.
制作并且发表一个这么大的数据库是十分费时费力的 甚至单就这一个数据库就可以
Creating such a dataset and publishing it is incredibly laborious, and could easily
很容易地发一篇文章 而这里 作者不仅提供了数据库还提供了一个非常好的算法去解
be a paper on its own, and here, we also get an excellent solution for this problem as
这类问题
well.
在另一项工作中 他们还发表了这个问题的另一个应用
In a separate work, the authors also published a different version of this problem formulation
就是用同样的方式重建建筑的外型
that reconstructs the exteriors of buildings in a similar manner.
文章中还有更多的东西值得探索 文章链接已经附到视频信息里了
There is so much to explore, the links are available in the video description, make sure
你一定要去看看
to have a look!
也许你还在犹豫 但这项工作真的非常值得一看
In case you’re wondering, it’s still considered a crime not doing that.
希望你喜欢这次的视频 我真的非常高兴
I hope you have enjoyed this episode, and I find it so delightful to see this unbelievably
本频道的涨粉速度如此之快
rapid growth on the channel.
最初我觉得粉丝翻倍已经很震惊了 结果现在有整整8倍的粉丝
Earlier I thought that even 2 would be amazing, but now, we have exactly 8 times as many subscribers
相比于去年
as one year ago.
我真的兴奋地无以言表 当我给这么一大群听众讲解这些令人激动的工作
Words fail me to describe the joy of showing these amazing works to such a rapidly growing
的时候
audience.
这就是为啥我总要在视频结束的时候说一句
This is why I always say at the end of every episode…
十分感谢大家的观看和捧场 下次见咯
Thanks for watching and for your generous support, and I’ll see you next time!

发表评论

译制信息
视频概述

本视频介绍了一项从照片生成3D户型图的工作,相比于从3D数据出发,这篇文章使用2D户型图和真实照片作为输入,生成了非常可靠和真实的3D户型图,非常值得一看

听录译者

收集自网络

翻译译者

GraphiCon-origamidance

审核员

知易行难

视频来源

https://www.youtube.com/watch?v=UBORpapdAfU

相关推荐