VR Realism: How to Build a Real VR Scene

Measuring the key indicators of the VR system, in addition to good immersive and human-human interaction, there is a real sense of confusion. The realism of the VR system is first and foremost visually realistic. Many small partners should be curious about how the VR system is produced. If the VR system is likened to a play, then what you need to do before the show is to set up a stage. To be able to build a good stage, numerous technical and data engineers have set foot in the air. Kung Fu, this section of Ping Shu describes the construction of the VR scene. The first type, the most extensive construction method - generic modeling software build We have to mention a great 3DS Max product. At present, most of the application scenarios we see are built using this software. 3DS Max was developed by Autodesk's subsidiary (Auto CAD was also developed by Autodesk), and the company basically monopolized the general 2D and 3D design tools. 3DS Max is a 3D design tool with powerful functions, simple operation (relative to many other design software), data format compatibility, and exquisite effects. It has many users all over the world. Currently, 19 major versions have been updated. Accomplishment. This software also has fatal flaws. As a general modeling software, modeling efficiency for some highly-regulated industries is too low. Another weakness is the high demand for modeling engineers, especially for real-time rendering VR scenarios. There are also many gods in the modeling industry. These big cows have even higher salaries than the programmers. The scenes built by these big cows are exquisite and the amount of data is small. The more faces the model is, the more realistic it is. In order to be more realistic, many models do more than a few tens of thousands of faces. This is why the rendering of a drawing needs several hours of rendering. The reason is that there are too many triangular faces and too much data. Such model data cannot be used in a real-time rendering VR system. Therefore, a rigorous data production process is constructed for the scene of the VR system. The ultimate goal of this process is to pursue the most perfect balance between data volume and effect. Ping Shu's team has formulated a very detailed "Data Collection Specification" and "Model Making Specification" on this aspect. The second type, the most targeted construction method - professional software tool construction Such software is specialized in modeling a certain business, such as 3D modeling software for the construction industry: sketch master, PKPM, etc.; for the industrial field: PDMS, SP3D, AutoPLANT Piping, etc.; for the home improvement industry: cool Family music, conductor, costumer, etc.; for the film and television industry: Maya, Poser (animal and human modeling). There are also many companies that have developed their own scene-building tools to meet special scene constructions. For example, many game companies will develop map editors. These software tools are deeply plowing a certain industry. The design tools often have specific business algorithms and attribute information. The efficiency of building scenes in this field is much more efficient than general modeling tools. The users of such tools are generally designers of the industry. The model built is for specific business services. Therefore, the data format is not open, and other users cannot reuse. Here is a simple example and a pain point that Ping Shu had tried hard to solve. The current 3D design of the construction industry is already very common, that is to say, as long as the design institute will give their 3D design data to the builder, the owner, and the property company. , decoration companies, intermediary companies, etc., these companies actually do not need to draw floor plans, floor plans, can be used directly, but because the format of the design software is not open, resulting in the follow-up of all these companies have to re-electronic again, do Obviously there is no point in repetitive labor. The third category, the most accurate construction method - 3D laser scanning The development of three-dimensional laser scanning technology has been more than two decades. At present, it has developed into the third generation of products. The technologies and solutions are very mature. There are sophisticated solutions from cup-sized objects to the entire city. Scanning equipment is set up on airplanes, cars, trains, and bicycles. Hand-held devices are now commonplace. The three-dimensional laser scanning modeling technology has many advantages such as high speed, high precision, low cost, and no contact, but it also has a fatal weakness, and the data volume is particularly large. The data scanned by the three-dimensional laser is called point cloud data. At present, the third-generation scanning equipment can reach an accuracy level of 0.1 mm, which means that the area scanned by one square meter is 10000*10000=1 billion, if a building is scanned This amount of data can be imagined how big, point cloud data is usually in units of T, so that the amount of data is difficult to run in the VR system, so the general three-dimensional scanner manufacturers in addition to equipment that will A bit of cloud data processing software, the main function of this kind of software is to reduce the amount of data of point cloud data through image algorithms, there are some intelligent identification functions, the common cable, pipeline and other objects are identified as a whole object, in general, this kind of The software identification process requires human-assisted intervention to be able to form the scene data that can be used. Another disadvantage of the large-area scanning modeling is that it requires a relatively high level of operator requirements and generally requires the use of a mapping device such as a total station. The fourth category, the most real scene construction method - panorama shooting Panorama shooting is the lowest cost way to build a virtual scene, and it is also a VR video shooting method. Especially in the AV industry, the current progress is rapid. Many people say that VR can not be quickly popularized to see the speed of growth of such applications. Panorama shooting will take the lead in VR tourism, VR film and video, VR live broadcast. This technology threshold is lower than other scene construction methods, equipment costs are not high, I believe that these companies will soon be the first to go public. At present, the development of this piece is very rapid and chaotic. There is no standard format for shooting, and the editing software and playback software are not very powerful. The playing software is still in the stage of exploration. The entrepreneurial partner can pay more attention to it. The current panoramic video can not be regarded as VR video. One of the most important principles of true VR video is the ability to move the position for viewing. Such a lens is called time still. The "Matrix" has such a scene. Everyone can imagine watching a little movie while looking at it, looking sideways, and lying down... what a cool thing! One of the development constraints of panoramic video is the large amount of data, which places high demands on network transmission and machine performance. Video is usually only viewed without interaction. Now there are companies that add interactive links in VR video to combine virtual objects with panoramic video. For example, adding a three-dimensional animal to a panoramic video with the background of a primeval forest, the behavior of the animal can be Interacting, such technology will take the lead in the use of theme park scenes. The fifth category, the most efficient scene construction method - shooting modeling This is the most popular way of modeling. Recently, Jingdong has engaged in a “natural work plan”. The purpose of this project is how to solve the rapid product modeling. VR shopping is the future trend. To achieve VR shopping, we must first solve the rapid modeling of massive goods. Last year, Taobao issued a promotional video for VR shopping. At that time, it was said that the system was on-line in July of the year. The first reaction from Ping Shu was Jack Ma, and the technology spike of Taobao. Amazon.com. Quietly became! Afterwards, it was impossible to think about this carefully. The current technology couldn't reach it. Later, we were stunned by Ma Yun. Jingdong's “Heavenly Worker Project” is a real action to implement VR shopping. There are several award-winning vendors that are modeling modeling companies. Shooting modeling has many features such as low cost, good effect, high speed, simple operation, and small amount of data. It is said that an Israeli company participating in the "Tranquil Project" can realize the millimeter-level modeling of products based on only two photographs before and after the product. Such equipment is too convenient, and ordinary merchants can complete the three-dimensional modeling of the products themselves. There are several VR startups that get investment this month, and they are all start-up companies in this direction. This also proves that Jingdong’s vision is indeed unique. This piece is indeed the cornerstone of VR applications. It is a technical difficulty that urgently requires public relations. I believe there will be more such venture companies to gain capital favor. There are many contents of shooting modeling. Ping Shu will be the subject of introduction in the next chapter. The contents include: the basic principles of shooting modeling, hot areas, representatives of manufacturers, and typical products. We will not go into detail here. Sixth, Future Scene Construction - Building VR Scenes with VR At present, most of the various scene construction techniques are based on three-dimensional reconstruction of real objects. However, in the VR world, more situations are not real scenes, such as games and movies. Currently, such scenes are basically software tools. Designed, the design process is probably: creative, hand-drawn sketches, 3D modeling, rendering, discussion, modification, rendering. . . Such a design method is obviously inefficient, and the best way to work is to complete the construction of the scene in WYSIWYG in the virtual world. After the completion of the construction, the scene is directly used in the application system without rendering, data conversion, and compression. Building a VR scene in a VR system started with the attention of major companies. When Vive Consumer Edition was released, the typical application of HTC listed three, including Google’s Tilt Brush. This software was called by everyone. PS for VR World. After Google introduced VR graphics software, Until and UE4 have launched their own VR scene construction tools. Many startups that focus on such applications have also won the favor of capital. Ping Shu believes that there will be many such applications in the future, and many traditional design software giants will be subverted. It is a pity that Ping Shu has not found any domestic companies with such applications. China is very backward in the field of scene construction. No matter if it is general design software or industrial design software, there is no product that can be used with European and American companies PK, and the import dependence is very high. The three-dimensional design software has developed in European and American developed countries for more than 40 years. It has just been proposed that computer graphics technology people begin research and practice. With so many years of continuous iterative development, the technology gap is getting bigger and bigger, and we think that there is no chance for Shanzhai. Because of the professionalism and rigor of design tools, designers often dare not use less-sophisticated software tools for designing. Domestic companies do not have the opportunity to try even wrongly. At this stage, the VR design tool has just started. Although some European and American companies have accumulated, but after all, they are all starting from scratch. The gap is not great. The user habits and groups are also from scratch, and everyone has the opportunity. There are small partners who are determined to make software such as Autodesk (3Ds Max, Maya), Adobe (PS), google sketchup, AVEVA (PDMS) in the future and are now catching up. The above are the six ways to construct the scene at this stage. These types of methods will coexist and develop in the future for a long time. Some methods will die out, and some methods will be widely used. Ping Shu is here to imagine what the future scene construction should look like. In the future, VR design software will be widely used and all products in the industrial field will be VR-designed. The three-dimensional data before production will be used for advertising and appearance patent applications, and samples will be produced using 3D printing. The information the consumer sees will be three-dimensional. In the field of architecture, the design, landscape modeling and decoration of the building all adopt VR design. After the design company completes the design, the design data of the building will be shared with the construction company, decoration company, sales company, government, etc., and the relevant personnel can obtain the housing of the VR system. Appearance and internal information. In the field of games and movies, a large number of war scenes and ancient palaces will be constructed and used using VR. There are many other applications and many, see everyone here should be able to feel the power of change brought about by VR, which is why Ping Shu is so optimistic about the prospects for VR. This article is the original author of No. 1 and must not be reproduced without authorization.