KR101457529B1 - Video Live Broadcasting System Based on Spatial Information Using Smart Phone and Operating Method thereof - Google Patents

Abstract

Disclosed are a real-time video live broadcast system based on space information using a smartphone and an operating method thereof. A space information generating method which is applied to the real-time video live broadcast system according to an embodiment of the present invention includes the following steps in which: an authority control server receives image information including image data, position data, and direction data from a mobile terminal; the authority control server confirms that the mobile terminal has authority to transmit the image information; the authority control server transmits the image information to a space information operation server if authority for the mobile terminal is confirmed; and the space information operation server calculates space information corresponding to image data based on the image data, position data, and direction data of the image information and outputs the space information.

Description

TECHNICAL FIELD [0001] The present invention relates to a live video streaming system using a smart phone,

The present invention relates to a live video live-broadcast system and a method of operating the live-video live-broadcast system, and more particularly, to a system and method for operating live- And to a method for operating the same.

Image information for an arbitrary space is collected from a plurality of closed-circuit television (CCTV) and the like installed outside, so that an event or accident occurring in a space included in an arbitrary radius of a closed- Space information for management of the system can be generated.

However, it may not be easy to collect image information on the basis of generation of spatial information for an area where a closed circuit television is not installed. In addition, there may be a lack of management of events or accidents that may occur in areas where closed-circuit television is difficult to install. Further, according to the closed circuit television, since the image information is collected only in a predetermined manner at a fixed position, adaptive information for an arbitrary event or accident is missed in the image information, and uncertain spatial information can be generated.

The present disclosure provides a live moving picture live streaming system and a method of operating the same that can efficiently and accurately generate spatial information.

According to an embodiment of the present disclosure, there is provided a method of generating spatial information according to an embodiment of the present disclosure, comprising: receiving, from a mobile terminal, video information including video data, position data, and direction data; Confirming whether the rights control server has an authority to transmit the image information; Transmitting the video information to the spatial information management server when the authority control server confirms the authority for the mobile terminal; And the spatial information management server calculates space information corresponding to the video data based on the video data, the position data, and the direction data of the video information, and outputs the space information.

A spatial information generation system according to an embodiment of the present disclosure receives image information including image data, position data, and direction data generated by execution of an application downloaded to a mobile terminal, and the mobile terminal transmits the image information An authority control server for confirming whether the user has authority to transmit the image information and outputting the image information; And a spatial information operation server for calculating spatial information corresponding to the image data based on the image data, the position data, and the direction data of the image information, and outputting the spatial information.

According to the live moving picture live streaming system and its operating method according to an embodiment, by using image information of a certain space acquired from a smart phone, a tablet PC, or the like, an efficient and accurate response to an event generated in an arbitrary space Can be generated.

For example, according to the live moving picture live streaming system and its operating method according to an embodiment, it is possible to easily collect image information about a region where a closed circuit television is not installed. In addition, according to the live moving picture live streaming system and the operation method thereof according to the embodiment, it is possible to easily collect the image information about the area where the closed circuit television is difficult to install. In addition, according to the live moving picture live streaming system and the method of operating the live moving picture broadcasting system according to an embodiment, accurate and efficient management of events or accidents occurring in an arbitrary space is performed by collecting adaptive image information for an arbitrary event or accident There are advantages to be able to.

1 is a flowchart illustrating a method of generating spatial information according to an embodiment.
2 is a diagram illustrating a spatial information generating system according to an embodiment.
3 is a flowchart illustrating a method of generating spatial information according to an embodiment.
4 is a diagram showing an example of an application executed in a mobile terminal according to an embodiment.
5 is a diagram illustrating an example in which an execution result of an application is displayed in a mobile terminal according to an embodiment.
6 is a flowchart illustrating a method of generating spatial information according to an embodiment.
7 is a diagram illustrating a spatial information generation system according to an embodiment.
8 and 9 are diagrams illustrating an example in which spatial information is transmitted to a related authority by the mobile terminal and the rights restriction server in the spatial information generation system according to an embodiment.

In order to fully understand the present invention, operational advantages of the present invention, and objects achieved by the practice of the present invention, reference should be made to the accompanying drawings and the accompanying drawings which illustrate preferred embodiments of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the preferred embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

Prior to the description, it is noted that the spatial information generation system and the spatial information generation method described below can be applied to a spatial information based real time moving picture live streaming system and its operation method. For example, in generating the spatial information, the spatial information generating system described below can be real-time broadcasted on the spatial information operating system as spatial information.

FIG. 1 is a flowchart showing a spatial information generating method according to an embodiment of the present disclosure, and FIG. 2 is a diagram showing a spatial information generating system according to an embodiment of the present disclosure.

Referring to FIGS. 1 and 2, a spatial information generation system 200 according to an embodiment of the present disclosure includes a rights control server 220 and a spatial information operation server 240. The rights control server 220 receives the image information I_inf including the image data IMG, the position data POS and the direction data DIR generated by the execution of the application downloaded to the mobile terminal MDV, Confirms whether the mobile terminal MDV has the authority AUT for transmitting the image information I_inf, and outputs the image information I_inf. The spatial information management server 240 calculates spatial information S_inf corresponding to the image information I_inf based on the image data IMG of the image information I_inf, the position data POS, and the direction data DIR , And spatial information S_inf.

In detail, the method 100 of generating spatial information in the spatial information generation system 200 according to an embodiment of the present disclosure includes the steps of (1) receiving the video information from the MDV by the rights control server 220 S120), the authority control server 220 confirms whether the mobile terminal MDV has the authority AUT to transmit the image information I_inf (S140), the authority to the mobile terminal (MDV) The authority control server 220 transmits the image information I_inf to the spatial information management server 240 in step S160 and the spatial information management server 240 transmits the spatial information S_inf corresponding to the image information I_inf (Step S180).

The rights control server 220 may include an image information receiving unit 222, an authority checking unit 224, and an image information transmitting unit 226, for example. The image information receiving unit 222 receives the image information I_inf from the mobile terminal (MDV) (S120). The mobile terminal (MDV) may be a smart phone or a tablet computer. However, the present invention is not limited thereto, and the mobile terminal (MDV) may be various devices in which an application to be described later can be executed. The image information I_inf may be received by the image information receiving unit 222 through the first network NT1. The first network NT1 may be various wireless networks such as 3G, 4G, Wi-Fi, WiBro and LTE (Long Term Evolution).

The image information I_inf includes the image data IMG, the position data POS, and the direction data DIR, as described above. The image data IMG is image data IMG photographed by the camera of the mobile terminal MDV. Therefore, the image data IMG may be a still image or a moving image for a space that can be photographed by a user of the mobile terminal MDV. The image data (IMG) may include, for example, images of conditions such as fire, natural disaster and facilities. The location data (POS) may include Global Positioning System (GPS) information of the mobile terminal (MDV). The mobile terminal (MDV) may include a GPS chip capable of communicating with the GPS satellite.

The direction data DIR includes information on the shooting direction of the video data IMG of the mobile terminal MDV sensed from the motion recognition sensor (not shown) of the mobile terminal MDV. For example, the tilt or motion of the mobile terminal (MDV) is sensed by a gyro sensor built in the mobile terminal (MDV), and the direction data DIR) may be generated. For example, when a user of a mobile terminal (MDV) photographs the north-west or photographs a 30-degree direction from the horizon, the information (northwest or 30 degrees) is sensed by a gyro sensor or the like to be generated as direction data DIR .

The mobile terminal (MDV) can generate the image information (I_inf) by executing the application downloaded to the mobile terminal (MDV). We will examine this.

3 is a method for generating a spatial image according to an embodiment of the present disclosure. 2 and 3, a spatial image generation method 300 according to an embodiment of the present disclosure is a method of generating spatial image 100 of FIG. 1 in which an authority control server 220 acquires image information I_inf A step S110 of generating an image data IMG, position data POS and direction data DIR by executing an application downloaded from the mobile terminal MDV and transmitting it as image information, As shown in FIG.

4 is a diagram showing an example of an application executed in a mobile terminal according to an embodiment of the present disclosure; 2 to 4, in the mobile terminal (MDV) according to an embodiment of the present disclosure, in order to generate image information I_inf and transmit it to the rights control server 220, the image data generation unit 310, An application APP including the location data generator 320, the direction data generator 330, the image information generator 340, and the interface unit 350 may be downloaded and executed. When the user of the mobile terminal MDV executes the application APP, the enable signal XEN can be activated. The image data generation unit 310, the position data generation unit 320, the direction data generation unit 330, the image information generation unit 340 and the interface unit 350 are activated in response to the activation of the enable signal XEN. .

The image data generation unit 310 may generate the image data IMG using a camera included in the mobile terminal MDV. The location data generator 320 may generate location data POS including the location (address or geographical coordinates) of the mobile terminal (MDV) from the GPS chip included in the mobile terminal (MDV). The direction data generation unit 330 includes direction data DIR for a photographing direction of the image data IMG of the mobile terminal MDV sensed by the motion recognition sensor of the mobile terminal MDV.

The image information generating unit 340 receives the image data IMG, the position data POS, and the direction data DIR and combines them to generate the image information I_inf. For example, the image information generating unit 340 may generate image information I_inf including position data POS and direction data DIR for each frame of the image data IMG. Or the image information generating unit 340 may generate the image information I_inf by including the position data POS and the direction data DIR in an arbitrary frame among frame groups including an arbitrary number of frames of the image data IMG Can be generated.

The interface unit 350 may receive the video information I_inf from the video information generating unit 340 and transmit the video information I_inf to the rights control server 220. The application (APP) executed in the mobile terminal (MDV) described above can share all or a part of the hardware or software of another application of the mobile terminal (MDV) and the mobile terminal (MDV) have. The interface unit 350 may also display the image information on the display screen of the mobile terminal.

FIG. 5 is a diagram showing an example of displaying an application on the mobile terminal when the application shown in FIG. 4 is executed. 2, 4, and 5, the image data IMG is displayed on the display screen of the mobile terminal MDV and overlaps with a part of the image data IMG to generate position data POS, Directional data (DIR) can be displayed. However, the present invention is not limited thereto. At least one of the position data (POS) and the direction data (DIR) may not be displayed in the mobile terminal (MDV). The application (APP) of the mobile terminal (MDV) displays the image information (I_inf) and transmits it to the rights control server (220) as described above.

1 and 2, when the image information receiving unit 222 receives the image information I_inf, the authority checking unit 224 of the authority control server 220 transmits the image information I_inf, (MDV) with authorization (AUT) (S140). For example, when the second mobile terminal MDV2 transmits the image information I_inf, the authority checking unit 224 determines whether the second mobile terminal MDV2 has the authority AUT to transmit the image information I_inf Check. For example, the authority checking unit 224 can check whether or not the authority is AUT based on the identifier (NPH) of the mobile terminal (MDV). The identifier (NPH) of the mobile terminal (MDV) may be an identifier provided from the first network (NT1) to the image information receiving unit (222) when receiving the image information (I_inf).

The authority verifying unit 224 can determine whether or not the authorization of the mobile terminal MDV is AUT in response to the first control signal XCON1 for the identifier (NPH) of the mobile terminal (MDV). For example, the authority checking unit 224 outputs the identifier (NPH) of the mobile terminal (MDV) to the outside, and performs a first control including information on whether the authority (AUT) for the identifier (NPH) By receiving the signal XCON1, it is possible to judge whether or not the authority (AUT) of the mobile terminal (MDV) is authorized. For example, the first control signal XCON1 may be generated by the administrator of the rights control server 220. [

Alternatively, the authority checking unit 224 may determine whether the authority (AUT) of the mobile terminal (MDV) is valid by checking whether the identifier (NPH) of the authorized mobile terminal (MDV) is set in the authorization control server have. For example, the authority checking unit 224 receives the authority (AUT) information from the authority setting unit 228, which may be further provided to the authority control server 220, and transmits the authority AUT of the mobile terminal (MDV) Can be determined. The authority setting unit 228 may store a list of identifiers (NPH) of authorized mobile terminals (MDV) in the form of a table or the like. For example, the table of the authority setting unit 228 may be managed by the second control signal XCON2. For example, the second control signal XCON2 may be generated by the administrator of the rights control server 220.

The mobile terminal MDV authorized by the first control signal XCON1 or the second control signal XCON2 receives the image data IMG to manage an event or an incident corresponding to the image data IMG, May be a mobile terminal (MDV) of the user who is authorized to take a picture. For example, a user of an Authorized Mobile Terminal (MDV) may be a forest monitoring agent, a user entrusted with managing events or incidents that may occur in forests.

The authority checking unit 224 transmits the permission signal ALO to the video information receiving unit 222 when the authority AUT of the identifier (NPH) of the mobile terminal (MDV) is confirmed. The image information receiving unit 222 outputs the image information I_inf in response to the permission signal ALO (S160).

The access to the spatial information administration server 240 is limited and managed by the authority control server 220, so that the stable operation of the spatial information administration server 240 can be assured. As will be described later, since the event is managed or controlled by the spatial information management server 240, stable operation in the spatial information management server 240 is important. For example, the spatial information management server 240 may provide space information on the fire occurrence to the fire department, thereby effectively protecting the fire or the property by replacing it with fire suppression. If the false image information I_inf by the unauthorized person is transmitted to the spatial information management server 240, the damage due to an event or an accident can be increased.

1 and 2, when the image information I_inf output from the authority control server 220 is transmitted to the spatial information operation server 240 through the second network NT2, the spatial information operation server 240 generates spatial information S_inf based on the image information I_inf (S180). The second network NT2 may be a public network such as the first network NT1 described above or may be a private network connecting between the rights control server 220 and the spatial information operations server 240. [

The spatial information management server 240 may include an image information collection unit 242, an item extraction unit 244, a spatial information generation unit 246, and a display unit 248. The image information collecting unit 242 receives the image information I_inf. The item extracting unit 244 extracts the image data IMG, the position data POS, and the direction data DIR from the image information I_inf. The extracted image data IMG, position data POS and direction data DIR may be displayed on the display screen of the control system in which the spatial information management server 240 is included. At this time, the image data (IMG), the position data (POS), and the direction data (DIR) extracted from the item extracting unit 244 may be displayed on the display screen. Alternatively, the image data IMG, the position data POS, and the direction data DIR extracted from the item extracting unit 244 may be edited and displayed on the display screen. In this case, for example, a lot number or a building name corresponding to the image data (IMG), the position data (POS), or the direction data (DIR) may be displayed on the display screen. For example, the position data POS indicating the position of the user of the mobile terminal MDV indicates the first position, the building on which the fire occurred on the image data IMG indicates the building, and the direction data DIR indicates the northwest In this case, displayed on the display screen may include at least one of image data (IMG), position data (POS) and direction data (DIR) together with information on the address and the floor of the building where the fire occurred. Also, as will be described later, the spatial information S_inf including the event type value EVA can be displayed.

The spatial information generation unit 246 receives the image data IMG, the position data POS and the direction data DIR from the item extraction unit 244 and generates spatial information S_inf corresponding to the image information I_inf do. The spatial information S_inf may include an event type value EVA indicating a type of an event corresponding to the image data IMG. For example, if the image data IMG is related to a fire, the spatial information S_inf includes an event type value EVA as a first value, and the spatial information S_inf as a first value Event type value EVA.

The event type value EVA may be automatically recognized from the image data IMG or set in response to the third control signal XCON3. The third control signal XCON3 may be generated by the manager of the spatial information management server 240. [ For example, the spatial information generating unit 246 can recognize the image related to fire in the image data IMG and set the event type value EVA to the first value. Alternatively, the administrator of the spatial information management server 240 can check the display screen to confirm whether or not the garbage is stolen and set the event type value EVA to the second value.

The spatial information S_inf may also include image data IMG, position data POS and direction data DIR. At this time, the image data IMG, POS, and direction data DIR included in the spatial information S_inf are obtained from the image data IMG, position data POS, and direction May be the same as or different from the data (DIR). For example, the spatial information S_inf may additionally include an event type value EVA in the image data IMG, the position data POS, and the direction data DIR extracted by the item extracting unit 244. [ Or information on the address and the floor of the building where the fire occurred based on the image data IMG, the POS data, and the direction data DIR, as described above.

An editing tool for generating the spatial information S_inf based on the image data IMG, the position data POS and the direction data DIR may be included in the spatial information management server 240. [ A communication tool for receiving the source (data) required by the editing tool to generate the spatial information S_inf from another external server, a database, or the like may be included in the spatial information management server 240. Or a database storing the source (data) required for the editing tool to generate the spatial information S_inf may be included in the spatial information management server 240.

According to the event type value EVA, the spatial information S_inf can be transmitted to the related authority processing the event. For example, if the event type value EVA indicates the occurrence of a fire, the spatial information S_inf may be transmitted to the fire department.

As described above, according to the spatial information generation system and the spatial information generation method according to the embodiment of the present disclosure, by using the image information for an arbitrary space acquired from a smartphone tablet PC or the like, It is possible to generate spatial information capable of performing efficient and accurate correspondence. For example, the spatial information generation system and the operation method thereof according to an embodiment can easily acquire image information about an area where a closed circuit television is not installed, and can easily acquire image information of a closed circuit television It is also possible to easily collect image information for areas that are difficult to install. Furthermore, according to the spatial information generation system and the operation method thereof according to an embodiment, accurate and efficient management of events or accidents occurring in an arbitrary space is performed by collecting adaptive image information for an arbitrary event or accident . For example, when a fire is transferred from a first building to a second building in a high-rise building, when a user uses a mobile terminal (MDV), adaptive shooting of the transition progress can provide efficient information on the fire suppression have.

FIG. 6 is a flowchart showing a spatial information generating method according to an embodiment of the present disclosure, and FIG. 7 is a diagram showing a spatial information generating system according to an embodiment of the present disclosure. 6 and 7, a method 600 of generating spatial information in the spatial information generation system 200 according to an embodiment of the present invention includes the steps of: From the mobile terminal (MDV) (S120), the authority control server 220 confirms whether the mobile terminal (MDV) has the authority (AUT) for transmitting the video information I_inf (S140) When the authority for the terminal (MDV) is confirmed (S160), the authority control server 220 transmits the image information I_inf to the spatial information operation server 240 (S160) and the spatial information operation server 240 (S1inf) corresponding to the information (I_inf) and outputting it (S180).

If additional data is required in the spatial information S_inf (YES in S190), the image data including at least one of the image data IMG, the position data POS, and the direction data DIR The spatial information generation unit 246 of the spatial information management server 240 may request (REQ) the information (I_inf) from the authority control server 220 (S192). For example, when it is difficult to confirm the number of floors of the building where the fire occurred, the spatial information management server 240 transmits the image (image data) about the building that is closer to the image information to the image information request unit 229 of the authority control server 220, (REQ). ≪ / RTI > In this case, the video information requesting unit 229 can deliver the request (REQ) to the mobile terminal (MDV).

The mobile terminal (MDV) may receive the request (REQ) and transmit the video information (I_inf) corresponding to the request (REQ) again. To this end, the application (APP) of FIG. 4 may further comprise a configuration (not shown) capable of performing a display for a request (REQ). If no additional data is required in the spatial information S_inf (NO in S190), the rights control server 220 or the spatial information operating server 240 can wait for generation of new image information in the standby mode (S194) ).

In the foregoing, an example has been described in which the spatial information management server 240 transmits the spatial information S_inf to a related entity that processes the event. However, the present invention is not limited thereto.

8 and 9 are views showing an example in which spatial information is transmitted to the concerned institution by the mobile terminal and the rights restriction server in the spatial information generation system according to the embodiment of the present disclosure. Referring to FIGS. 2 and 8, the application (APP) of the mobile terminal (MDV) further includes an event type determination unit 360 as compared to the application (APP) of FIG. The event type determination unit 360 generates an event type value EVA indicating a type of an event corresponding to the image data IMG. The event type value EVA may be as described above. As described above, the event type determination unit 360 determines the type of the event automatically from the image data IMG to set the event type value EVA, or displays the image of the user of the mobile terminal MDV The event type value EVA can be set from the data IMG or the image information I_inf.

The image information generating unit 340 generates image information I_inf further including the event type value EVA and the interface unit 350 transmits the image information I_inf to the authority control server 220 , The event type value (EVA) may be sent to the relevant authority processing the event.

9, the rights control server 220 includes an event type value extracting unit 227 for extracting an event type value EVA from the video information I_inf as compared with the rights control server 220 of FIG. 2, As shown in FIG. The authority control server 220 transmits the video information I_inf received from the mobile terminal MDV to the spatial information operation server 240 and transmits the event type value EVA to the related authority processing the event .

Thus, the agency processing the event can respond to the event more quickly. 8 and 9 illustrate an example in which only the event type value EVA is transmitted to the related authority. However, the present invention is not limited to this, and the image data IMG may be transmitted to the related organization.

Although the spatial information generation system 200 according to the embodiment of the present invention has been described as having only one rights control server 220 and one spatial information operation server 240 in the above description, The spatial information generation method 100 of FIG. 1 can be performed simultaneously. In addition, the rights control server 220 and the spatial information management server 240 may support various database systems (DBMS) such as SDE, MS_SQL, PostreSQL, Altibase, and Tibero. Although not shown, the authority control server 220 and the spatial information administration server 240 may be connected to a database for image information I_inf and spatial information S_inf or a database Of course. Furthermore, the rights control server 220 and the spatial information management server 240 may include tools for displaying various edits, outputs, statistics, and the like for the image information I_inf and the spatial information S_inf .

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

200: Spatial information generation system
220: Authorization control server
240: Spatial information management server

Claims (10)

The rights control server receiving video information including video data, position data, and direction data from a mobile terminal;
Confirming whether the rights control server has an authority to transmit the image information;
Transmitting the video information to the spatial information management server when the authority control server confirms the authority for the mobile terminal;
The spatial information management server calculates space information corresponding to the video data based on the video data, the position data, and the direction data of the video information, and outputs the space information; And
And requesting, by the spatial information management server, the authorization control server, image information including additional data for at least one of the image data, the position data, and the direction data. Generation method. The method according to claim 1,
Wherein the image data is image data photographed by a camera of the mobile terminal,
The location data includes GPS (Global Positioning System) information of the mobile terminal,
Wherein the direction data includes information on a shooting direction of the video data of the mobile terminal sensed by the motion recognition sensor of the mobile terminal. The method according to claim 1,
And generating the image data, the position data, and the direction data by executing the application downloaded to the mobile terminal, and transmitting the generated image data, the position data, and the direction data to the image information. The method according to claim 1,
Wherein the mobile terminal is a smart phone or a tablet computer. The method according to claim 1,
Wherein the spatial information management server extracts the image data, the position data, and the direction data from the image data, and transmits the image data, the position data, and the direction data to the control system On the display screen of the display device. delete The method according to claim 1,
Wherein the image information received by the rights control server further includes an event type value indicating a type of an event corresponding to the image data,
The rights control server further comprises a step of transmitting the video information received from the mobile terminal to the spatial information management server and transmitting the event type value to an entity processing the event. To generate spatial information. The method according to claim 1,
Wherein the image information received by the rights control server further includes an event type value indicating a type of an event corresponding to the image data,
Wherein the mobile terminal transmits the video information to the rights control server and further transmits the event type value to a related authority processing the event. The method according to claim 1,
Wherein the checking whether the mobile terminal has the authority to transmit the image information comprises checking whether an identifier of the mobile terminal is set in the rights control server. Receiving image information including image data, position data, and direction data generated by execution of an application downloaded to the mobile terminal, confirming whether the mobile terminal has the right to transmit the image information, and outputting the image information A rights control server; And
And a spatial information operation server for calculating spatial information corresponding to the video data based on the video data, the position data, and the direction data of the video information, and outputting the spatial information,
Wherein the spatial information management server requests image information including additional data on at least one of the image data, the position data, and the direction data to the rights control server.

Images