Lei Feng network (search "Lei Feng network" public concern) by: The author of this article Xing Jia (WeChat public number: Xing Jia is a small person), the current virtual reality industry practitioners engaged in new media, virtual reality, augmented reality and other research.

If you haven't read the MR tutorial developed by the team and the teammates: "How to build HTC Vive virtual studio live MR video at low cost? 》Be sure to click here to see what we’ve worked so hard for a long time.

Attached to the extra section: "Finally, the success of the panoramic video live broadcast, but some problems ...", a few months ago on the panoramic video broadcast technology sharing, of course, has recently made new progress.

Will share some of the non-core technical content after the time is ripe (we will share with you how to make money and support the research team?). We obviously can see that the live broadcasting giant has also begun to spend time on the technology of panoramic broadcast, such as fighting. The fish has already been included in the live broadcast of the panoramic video. Huajiao is also trying to walk the way of live broadcasting. We will wait and see that the giant can support the new technology as soon as possible and bring us new possibilities...

Well, next time we enter the dry goods time, we must explain to you what is the real MR real-time video before this, those who say that the US green screen, CG synthesis, AE post-processing what is not discussed in this article Although it is not too difficult to realize from the current mature technology level, but look at the perspective relationship in the MR results video to see the real-time interaction between the entity handle and the virtual world object, if you really think it is easy Can only say that you are too young...

Http://v.qq.com/page/x/o/u/s0311urlhq7.html

The official stunning videos have so far been MR video masterpieces

Funny and funny, at first I found a friend who had taken a movie and vowed to do it. Too young too naive, I think there is a green screen + camera + HTC Vive can easily solve, never expected, actually It took so long to toss it out to get results...

What is MR (Mixed Reality) video?

Can understand this picture to master the essence of MR

Mixed Reality video is a VR video + human video synthesis video. Compared to ordinary VR video recorded on computer screen game screens and real-time video recording by players, Mixed Reality video is more suitable for live games and production of virtual reality application promotional videos, such as the well-known Google Tilt Bursh painting program (please Click here to view the video below. Actually, I am trying hard to realize that all future virtual reality applications will make it appear to others that they are able to feel immersive.

It must be said that the following two kinds of keying images often appearing in the so-called VR live broadcast of the live broadcasting platform have to be questioned. What does it mean to engage in a VR live broadcast with a green screen? Is it really possible for consumers to popularize "universal virtual reality"? It will only look more in the fog...

The experiencer doesn't have a synchronous map appearing in the game screen at all, but only looking at the game screen. The bystanders don't understand exactly what the players are doing, right?

Let's take a look at the MR promotional video that Google gave to Tilt Bursh:

http://player.youku.com/embed/XMTU1NzQ3NDQ0NA

This is the real MR video, is it cool?

Me and my team buddies have already achieved this, paying attention to the mapping of the handle, the proportion of the characters in the real physical space, the perspective of the scene in the virtual application, and the relationship between the screen occlusion.

Here are the results of our team (please ignore the guilt due to the venue and funds):

Http://v.qq.com/page/x/o/u/j0313sceedw.html

Explore some of the feelings of MR video:

1, to achieve the program (Details of the operation process please refer to the previous document):

Hardware section: At least 55 green screens and even lighting, Canon SLR or Logitech camera, third HTC handle, USB extension cable and bracket.


The software part: First of all, open source software OBS is needed to do layer composition and live streaming functions. With the help of several Unity engines, it can successfully open the quarter-screen mode by adapting virtual reality content with a fixed perspective. (The cfg configuration file that needs to be adjusted for a long time is Content root help.)

2, also need to improve some of the places:

Due to local office restrictions, the green screen space is not up to the ideal standard, and the light is also not uniform because it is indeed poor. Therefore, the results are not clean and worn. Just want to call on local tycoons to sponsor green and big enough venues to let us play our talents.


We are exploring the possibility of mobile seats. On the one hand, due to the small venue, in addition to moving the camera and the third mapping handle tied to it, we have to purchase a giant expensive Steinecam, so the mobile lens is solved. The plan had to be temporarily grounded. Of course, there are few models that can support multi-camera and mobile virtual cameras at present. Welcome to recommend.


This method is currently only applicable to games developed by the Unity engine. Everyone is waiting for the UE4 engine to provide the interface with the SteamVR's bottom layer. After trying, some screens can be used to make the quad screen, in other words, successfully It is indeed not too far from the success of the quarter-screen, but it is a pity that we lack sufficient technical capabilities and we have to continue to work hard on the underlying interface. We hope to find the predecessors willing to cooperate in the industry to make an integrated fool. The type of software, to the greatest degree to liberate MR technology in the configuration parameters of all kinds of trouble. In addition, the immediate imperative is to find a professional software that is better than OBS. It can do better in real-time imaging and layer overlay and resolution loss. Well, in fact, there is still a lack of support for 4K resolution split screen display...


At present, many game applications have built-in virtual cameras that do not support mobile. In other words, we really hope that after the development of virtual reality game application developers can directly plan a good virtual camera, and even consider the built-in multi-camera The virtual camera is convenient for one-touch switching between the highest quality field of view and viewing angle while doing MR video and live broadcasting.


In the final analysis, it is still poor, so there is no way to talk about feelings. On the one hand, we hope that Unity and UE4 officials can open the interface of MR as early as possible, and also give developers of virtual reality content some DEMO project files developed by relevant MR virtual cameras. Learning, together with the first batch of practitioners in the industry to eat crabs, has brought virtual reality to the homes of ordinary people sooner, more comprehensively and completely.

Let's talk about feelings...

As for why it took so much energy to study MR virtual reality hybrid video production technology, people who understand should be self-evident, especially those owners who have already opened the offline experience hall will certainly be able to understand the commercial value , in addition to saving every Outside of the teaching hours of the new players, you can also give the passing bystanders a good real-time presentation. After they see it, they understand what the group of people with glasses and handles are walking around.

In addition , it has brought more new possibilities to various commercial applications in the industry . For example, teachers’ teaching of real people in virtual content environments, multi-person immersive interactive displays, and industrial applications such as popular science content will be displayed more easily. friendly.

Of course, the fastest way to make money quickly is to use the live video game and video game production services on the distribution platforms such as Steam and Viveport. After all, as a practitioner, we have a responsibility to give those who are tired of using the spectacles behind the box and use them to virtual reality. The obvious reason is to try to convince those pessimists to buy a true virtual reality device to experience true virtual reality, instead of a few hundred blocks of knock-off boxes , through a large amount of quality gamer- created MR videos.

Finally, I would like to say that as the industry practitioners of the earliest domestic virtual reality practitioners, we should grow in groups to make this market large enough to surprise the insiders with virtual reality. The understanding.

Dash Cam for Toyota

Dash Cam For Toyota,Dashboard Camera With Gps,Toyota Integrated Dashcam,Toyota Dash Cam Front And Rear

SHENZHEN ROSOTO TECHNOLOGY CO., LTD. , https://www.rdtkdashcam.com