CN105407409B - Carry out the method and system of long-range instant messaging - Google Patents
Carry out the method and system of long-range instant messaging Download PDFInfo
- Publication number
- CN105407409B CN105407409B CN201410461686.4A CN201410461686A CN105407409B CN 105407409 B CN105407409 B CN 105407409B CN 201410461686 A CN201410461686 A CN 201410461686A CN 105407409 B CN105407409 B CN 105407409B
- Authority
- CN
- China
- Prior art keywords
- data
- instant
- instant data
- video
- host
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000012544 monitoring process Methods 0.000 claims abstract description 93
- 238000004891 communication Methods 0.000 claims description 21
- 230000008569 process Effects 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 14
- 230000015572 biosynthetic process Effects 0.000 claims description 6
- 238000003786 synthesis reaction Methods 0.000 claims description 6
- 238000002789 length control Methods 0.000 claims description 2
- 241001622623 Coeliadinae Species 0.000 description 29
- 238000007726 management method Methods 0.000 description 23
- 238000011156 evaluation Methods 0.000 description 5
- 238000003780 insertion Methods 0.000 description 5
- 230000037431 insertion Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 239000003814 drug Substances 0.000 description 3
- 229940079593 drug Drugs 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 239000002131 composite material Substances 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 210000001503 joint Anatomy 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention discloses the method and system for carrying out long-range instant messaging, wherein this method comprises: video, which meets with host and monitors client, establishes connection, also establishes connection with Terminal Server Client；Video meets with the instant data that host obtains local terminal acquisition, is expressed as the first instant data, the first instant data are sent to Terminal Server Client and are shown；And the instant data from Terminal Server Client are received, the second instant data are expressed as, local display device is sent to and is shown；Video meets with host and is combined the first instant data and the second instant data, obtains data splitting, and data splitting is sent to monitoring client and is shown, and sends storage medium for data splitting and stores.The present invention program can quickly and conveniently obtain the information of long-range instant messaging.
Description
Technical Field
The present invention relates to instant messaging technologies, and in particular, to a method and system for performing remote instant messaging.
Background
In some scenarios, two-way remote instant messaging over the internet is required. For example, in public security systems, such as guard houses, detention houses, drug rehabilitation houses, prisons and drug rehabilitation houses for housing education and judicial systems, two-way online remote video conference is often performed between criminals, detention persons, drug rehabilitation persons or education students (referred to as "escort persons") and their families.
At present, more and more supervision sites are built, being built and to be built for remote video interviews. However, through field research, it is found that the supervision places of the remote video interview which are built or are being built all adopt the QQ chat tool to realize the remote video interview, and the policemen need to add the QQ number of the family as the friend first and then realize the remote video interview of the family and the escort personnel; meanwhile, each escort meeting seat needs a policeman to monitor and monitor beside the seat on the spot, simple screen recording software is adopted for recording and recording the sound in the meeting process, stored data are scattered and cannot be searched efficiently, and meanwhile, the system is complex in operation, and the configuration of police force is greatly increased.
In summary, the existing mode of using the QQ chat tool for remote meeting requires the policeman to monitor and monitor nearby in the field, which takes up much manpower; and the screen video recording software is required to be independently set for video recording, the acquisition of communication information is complicated, the storage is dispersed, and the management is inconvenient. With the continuous promotion of information construction of public security supervision and judicial supervision, the mode can not meet the actual requirements.
Disclosure of Invention
The invention provides a method for carrying out remote instant messaging, which can more conveniently acquire information of the remote instant messaging.
The invention provides a system for carrying out remote instant messaging, which can more conveniently acquire information of the remote instant messaging.
A method of remote instant messaging, the method comprising:
the video meeting host establishes connection with the monitoring client and also establishes connection with the remote client;
the video meeting host acquires instant data collected by a home terminal, represents the instant data as first instant data, and sends the first instant data to a remote client for displaying; receiving instant data from a remote client, representing the instant data as second instant data, and sending the second instant data to local display equipment for displaying;
the video meeting host combines the first instant data and the second instant data to obtain combined data, sends the combined data to the monitoring client for display, and sends the combined data to a storage medium for storage.
A system for carrying on the long-range instant messaging, the system includes the video meet host computer, data acquisition equipment, display device, storage medium and monitors the customer end;
the video meeting host establishes connection with the monitoring client and also establishes connection with the remote client; the video meeting host acquires instant data from the data acquisition equipment, represents the instant data as first instant data, and sends the first instant data to the remote client for displaying; receiving instant data from a remote client, representing as second instant data, and sending to the display device; combining the first instant data and the second instant data to obtain combined data, sending the combined data to the monitoring client, and sending the combined data to a storage medium for storage;
the display equipment receives and displays first instant data from the video meeting host;
the remote client acquires locally acquired second instant data and sends the second instant data to the video meeting host; receiving first instant data from a video meeting host for displaying;
and the monitoring client receives the combined data from the video meeting host for display.
According to the scheme, the video conference system comprises a video conference host, a remote client and a monitoring client, wherein the video conference host is connected with the monitoring client and is also connected with the remote client; the video meeting host acquires first instant data acquired by a home terminal and sends the first instant data to a remote client for displaying; receiving second instant data from the remote client, and sending the second instant data to the local display equipment for displaying; the video meeting host combines the first instant data and the second instant data to obtain combined data, sends the combined data to the monitoring client for display, and sends the combined data to a storage medium for storage. By adopting the scheme of the invention, detailed and complete information of both communication parties can be obtained by monitoring the display of the client, so that the remote monitoring of both communication parties is realized, and the communication information of both communication parties is stored in a storage medium, so that the communication is more integrated and perfect; therefore, exclusive personnel do not need to be arranged to monitor and monitor on the spot, and screen recording software does not need to be independently set for recording, so that the labor is saved, and the information of remote instant messaging is more conveniently acquired.
Drawings
FIG. 1 is a schematic flow chart of a method for performing remote instant messaging according to the present invention;
FIG. 2 is a schematic diagram illustrating an example of an application scenario for performing remote instant messaging according to the present invention;
FIG. 3 is a first example of a meeting process for performing remote instant messaging according to the present invention;
FIG. 4 is a second example of a meeting process for performing remote instant messaging according to the present invention;
FIG. 5 is an example of a topology for a remote meeting according to the present invention;
FIG. 6 is a flowchart illustrating a first embodiment of a method for performing remote instant messaging according to the present invention;
fig. 7 is a flowchart of a second embodiment of a method for performing remote instant messaging according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the following embodiments and the accompanying drawings.
In the prior art, a QQ chat tool is adopted for remote meeting, and the mode needs to arrange exclusive personnel beside for on-site monitoring and supervision, so that more manpower is occupied; and the screen video recording software is required to be independently set for video recording, the acquisition of communication information is complicated, the storage is dispersed, and the management is inconvenient. In order to solve the technical problem, the video conference host, the remote client and the monitoring client are arranged, remote conference of the video conference host and the remote client is realized through the cooperative work of the video conference host, the remote client and the monitoring client, and communication information is stored in a storage medium; therefore, no special personnel is required to be arranged beside for on-site monitoring and monitoring, and no screen recording software is required to be arranged independently for recording.
Referring to fig. 1, a schematic flow chart of the method for performing remote instant messaging according to the present invention includes the following steps:
step 101, the video meeting host establishes a connection with the monitoring client and also establishes a connection with the remote client.
The invention is provided with a video meeting host, a monitoring client and a remote client. Taking application scenes such as a public security system, a judicial system and the like as examples, the escorting staff checks the communication content at the video meeting host side, the family members check the communication content at the remote client side, and the monitoring staff checks the communication content at the monitoring client side.
After respective address information is obtained, the connection among the video meeting host, the monitoring client and the remote client can be established. The remote meeting management platform server can be used for managing the remote meeting and providing various meeting services; the video meeting host, the monitoring client and the remote client can access the remote meeting management platform server according to self needs so as to acquire opposite-end information and establish connection. There are various specific implementation manners for establishing connection through the remote meeting management platform server, for example:
the remote client accesses the remote meeting management platform server, the remote meeting management platform server authenticates the remote meeting management platform server, and after the authentication is passed, the remote meeting management platform server is allowed to establish connection with the video meeting host and the monitoring client; and the video meeting host can also access the remote meeting management platform server, acquire the address information of the monitoring client and establish connection.
In order to further improve security, the authentication of the remote client may be implemented in combination with the face image, specifically:
the remote client accesses the remote meeting management platform server and uploads a face image currently shot by the remote client;
the remote meeting management platform server reads a face image stored in advance, compares the face image with a currently received face image for identification, and feeds back matching success information to the remote meeting management platform server if the face image is matched with the currently received face image;
and the remote meeting management platform server acquires that the matching is successful and establishes the connection between the remote client and the video meeting host.
The face image pre-stored by the face comparison server is the face image uploaded when the meeting appointment is performed before the remote client, and is used for comparison authentication when meeting connection is performed.
102, the video meeting host acquires instant data collected by a local terminal, represents the instant data as first instant data, and sends the first instant data to a remote client for displaying; and receiving instant data from the remote client, representing as second instant data, and sending to the local display device for display.
Taking application scenes such as a public security system, a judicial system and the like as examples, the data collected by the local terminal is instant data about escort personnel, and the data from the remote client terminal is instant data about family members.
And 103, combining the first instant data and the second instant data by the video conference host to obtain combined data, sending the combined data to the monitoring client for displaying, and sending the combined data to a storage medium for storage.
In this step, the combined data is sent to a storage medium for unified storage, which is convenient for checking and managing. The storage medium is, for example, a disk array.
The specific content contained in the instant data is set according to the need, such as audio data, image data, or both audio data and image data. The following is a detailed description:
when the instant data is image data:
the video meeting host computer obtains the instant data collected by the local terminal, and the instant data comprises the following steps: the host side data acquisition equipment shoots pictures and sends shot image data to the video meeting host;
the video meeting host receiving the instant data from the remote client comprises: the remote client side shoots pictures and sends shot image data to the video meeting host;
the video conference host combining the first instant data and the second instant data comprises: and the video meeting host carries out image picture synthesis processing according to the first instant data and the second instant data to obtain combined data related to the synthesized picture. The composite picture simultaneously presents images of both parties of the communication.
When the instant data is audio data:
the video meeting host computer obtains the instant data collected by the local terminal, and the instant data comprises the following steps: the data acquisition equipment acquires audio frequency and sends the acquired audio frequency data to the video meeting host;
the video meeting host receiving the instant data from the remote client comprises: the remote client acquires audio and sends acquired audio data to the video meeting host;
the video conference host combining the first instant data and the second instant data comprises: and the video conference host carries out sound mixing processing according to the first instant data and the second instant data to obtain mixed audio data, namely the combined data.
When the real-time data includes both audio data and image data, the processing method of the audio data and the image data is included at the same time, which is not described herein again.
Therefore, the situation of both communication parties can be known by looking up the monitoring client side without arranging special personnel to watch the escort for on-site monitoring and supervision; moreover, the meeting process can be managed by monitoring the client, for example, operations such as marking, inserting, cutting, and controlling the meeting duration can be performed, which are described below.
Operation one, marking:
the monitoring client side obtains marking information and records the marking information corresponding to the marking time;
the method also comprises a hearing process, specifically:
the monitoring client receives a re-listening instruction containing the description identification, reads data corresponding to the description identification from the storage medium, and reads the mark information corresponding to the description identification;
monitoring the read data played by the client, and displaying the marking information when the marking moment comes. The description identifier is, for example, the name of the escorting person and a specified time period, and after the monitoring client receives the reply listening instruction, the monitoring client searches data related to the escorting person from a storage medium and reads the data corresponding to the specified time period. After the related data is found according to the name of the escort, the data meeting the requirement is read from the marking information for playing; for example, if the mark information is "important", the corresponding mark time is determined, and the subsequent data from the mark time is read and played.
During the monitoring process, the staff can mark the meeting, such as the emphasis, the additional description and the like; during the subsequent listening again, the pre-mark will be displayed accordingly. In addition, in the process of listening again, the remote video meeting condition can be evaluated, the time point needing evaluation in the instant data is determined, and evaluation is recorded corresponding to the time point.
Operation II, forced insertion:
the video meeting host receives a break-in instruction containing third instant data, wherein the third instant data is audio data; the video meeting host inserts third instant data into the currently received first instant data and second instant data, and the third instant data covers audio data corresponding to the time period of the third instant data in the first instant data and the second instant data;
correspondingly, the combined data sent to the storage medium for storage also comprises third instant data for mixing processing with the first instant data and the second instant data. At this time, the combined data is obtained by mixing the first instant data, the second instant data and the third instant data.
When the forced insertion operation is carried out, the escort personnel and the family members can only listen to the inserted speech of the monitoring personnel, and the opposite party can continue to listen to the speech after the inserted speech is finished. The break-in instruction may be from the monitoring client or from the video conference host side and is input by a monitoring person through an audio device such as a microphone.
Operation three, forced disconnection:
the monitoring client sends a forced disconnection instruction to the video meeting host, and the video meeting host stops sending data to the remote client and the local display equipment.
And fourthly, controlling meeting duration:
and the monitoring client sends a time length control instruction containing the updated time length to the video meeting host, and the video meeting host adjusts the locally set communication time length according to the updated time length. For example, the talk length is extended by 10 minutes.
In the invention, a video meeting host, a remote client and a monitoring client are arranged, wherein the video meeting host is connected with the monitoring client and is also connected with the remote client; the video meeting host acquires first instant data acquired by a home terminal and sends the first instant data to a remote client for displaying; receiving second instant data from the remote client, and sending the second instant data to the local display equipment for displaying; the video meeting host combines the first instant data and the second instant data to obtain combined data, sends the combined data to the monitoring client for display, and sends the combined data to a storage medium for storage. By adopting the scheme of the invention, detailed and complete information of both communication parties can be obtained by monitoring the display of the client, so that the remote monitoring of both communication parties is realized, and the communication information of both communication parties is stored in a storage medium, so that the communication is more integrated and perfect; therefore, exclusive personnel do not need to be arranged to monitor and monitor on the spot, and screen recording software does not need to be independently set for recording, so that the labor is saved, and the information of remote instant messaging is more conveniently acquired.
The invention also provides a system for remote instant messaging, which comprises a video meeting host, data acquisition equipment, display equipment, a storage medium and a monitoring client;
the video meeting host establishes connection with the monitoring client and also establishes connection with the remote client; the video meeting host acquires instant data from the data acquisition equipment, represents the instant data as first instant data, and sends the first instant data to the remote client for displaying; receiving instant data from a remote client, representing as second instant data, and sending to the display device; combining the first instant data and the second instant data to obtain combined data, sending the combined data to the monitoring client, and sending the combined data to a storage medium for storage;
the display equipment receives and displays first instant data from the video meeting host;
the remote client acquires locally acquired second instant data and sends the second instant data to the video meeting host; receiving first instant data from a video meeting host for displaying;
and the monitoring client receives the combined data from the video meeting host for display.
The remote client is specifically a personal computer, a smart phone and the like, and the monitoring client is specifically a PC and the like.
Further, when the instant data is image data:
the data acquisition equipment is used for shooting pictures and sending the shot image data to the video meeting host;
the remote client side shoots pictures and sends shot image data to the video meeting host;
and the video meeting host carries out image picture synthesis processing according to the first instant data and the second instant data to obtain combined data related to a synthesized picture.
Further, when the instant data is audio data:
the data acquisition equipment is used for acquiring audio and sending the acquired audio data to the video meeting host;
the remote client acquires audio and sends acquired audio data to the video meeting host;
and the video conference host carries out sound mixing processing according to the first instant data and the second instant data to obtain mixed audio data, namely the combined data.
The system may further include a remote meeting management platform server and a face comparison server, and the applications of the remote meeting management platform and the face comparison server are described in the above. Fig. 2 is a schematic diagram of an example of an application scenario for performing remote instant messaging according to the present invention, in which a remote client side outside a supervision place, i.e., a family member, is located; in the video meeting room of the escorting personnel, the data acquisition equipment acquires instant data about the escorting personnel and sends the data to the video meeting host computer for processing; the video meeting host is connected with the remote client through the Internet or government affair network; the video conference host and the remote client are also connected with the monitoring client, the storage medium and the remote conference management platform server through the Internet or government affair network; the monitoring client, the remote meeting management platform server, the face comparison server and the storage medium in the figure are positioned in a monitoring room and a device room.
With the continuous promotion of information construction of public security supervision and judicial prisoners, the existing mode of adopting a QQ chat tool to conduct remote meeting cannot meet the actual requirements. The invention provides a set of remote familiarity meeting management system which integrates the functions of remote meeting application reservation, remote meeting approval, remote video chat, network monitoring control, picture synthesis recording and video recording, and replay evaluation, and can inquire news of prison, law enforcement disclosure, prison guide, policy and regulation, and the like, so as to meet the urgent requirements of public security supervision and judicial supervision.
The remote familiarity meeting system of the supervision place is a set of business system, the business process of the system comprises two entrances of 'family application' and 'escort application', and the following description is respectively given:
1. fig. 3 shows a schematic flow of a remote video conference service with a portal as "family application", which includes the following contents:
the method comprises the following steps: meeting application: the family members fill in an online video meeting application form on a portal website of a supervision place through a computer, wherein the online video meeting application form comprises information such as applicant name, identity card number, name of a person to be met, relation between the person to be met and contact way and the like, a scene face photo is captured, and the scene face photo is uploaded to the website. Family members can access a portal website provided by the remote meeting management platform through a computer to fill in information; and a mobile phone client (APP) can be installed on a mobile terminal such as a mobile phone, and a video conference process is performed through the APP, wherein the APP is the client for realizing the video conference process provided by the invention.
Step two: meeting and approval: after the family members submit the meeting application, the supervision place carries out auditing according to the meeting rule of the escorting personnel, and the supervision place leads the supervision place to carry out remote video meeting examination and approval.
Step three: meeting notification: after the meeting approval is passed, the system can automatically send a short message to inform the family members that the remote video meeting application is passed, the remote video meeting time is required to be reserved within 5 days, the remote video meeting time needs to be reapplied after the appointment, and the mobile phone client downloads the address: https:// xxxxxxxxxx ". (the content of the message can be modified)
Step four: meeting appointment: after receiving the notification that the meeting application passes, the family members can submit the appointment reservation remote video meeting time on a portal website or a mobile phone client (APP) of the supervision place. The system directly presents the vacant remote video meeting seats of the escorting personnel when a certain day is available in the form of a chart.
Step five: reservation acceptance: after the family members reserve the remote video meeting date, the policemen confirm and arrange meeting batches, meeting seats and the like.
Step six: automatic reminding: on the appointed remote video meeting day, when the escorting personnel are closed, out of the residence, hospitalizing and the like, the system sends a short message in advance to inform the family members that the meeting cannot be carried out; when the appointed remote video conference date comes, the system can send a short message in advance to remind family members of carrying out remote video conference when, and automatically display a list of escorting personnel who need to carry out remote video conference on escorting policemen places (all in public security supervision grounds), a supervision room (all in judicial supervision grounds), a client side of a labor room and an LED display screen (or a large screen), at the moment, the administrative policemen prepares the escorting personnel who need remote video conference, and the escorting policemen (still being a supervised policemen in the judicial supervision grounds) holds the escorting list to the labor places or prison (all in judicial supervision grounds) and escorting the escorting personnel. And for the condition that the escorting personnel do not want to meet, the escorting personnel directly inform the family members of the reasons and reasons of the non-meeting through the short message after confirmation on the client.
Step seven: meeting and waiting: and the escorting policemen escort the escorting personnel to wait for the meeting notice after arriving at the door of the remote video meeting room.
Step eight: meeting notification: when the escorting personnel meet, the system can automatically display the information of the name, the seat and the like of the escorting personnel on an LED display screen (or a large screen) at the door of the remote video meeting room.
Step nine: identity verification: before the escorting personnel and the family members meet in a remote video mode, the identity of the family members needs to be verified, and the system automatically verifies the identity of the family members by comparing the video of the family members, the pictures when meeting is applied, the backup pictures of the system and the like.
Step ten: video meeting: after the family identity is verified, the family can conduct remote video interview with the escorting personnel. At the moment, the system can automatically record the video of the family members and the escorting personnel.
During concrete realization, family's side mountable controlling part, customer end data package etc. if mobile device is like the cell-phone, still can install APP to carry out long-range instant messaging, include: the audio and video data are sent to the video meeting host computer, and meanwhile, the audio and video data from the video meeting host computer are received and displayed; the control, the client data packet, the APP and the like have the function of realizing the remote instant messaging.
Step eleven: monitoring: the monitoring policeman can monitor the remote video conference in the monitoring room or the remote video conference room, and can perform operations such as marking, evaluating, inserting, cutting off and controlling the conference duration on the remote video conference in the monitoring room; in addition, the supervision leader can also monitor the remote video conference in the office. In the specific implementation, a remote meeting management platform of a supervision place provides an entrance for monitoring policemen to perform monitoring operation; monitoring the input operation information of a policeman in a corresponding entry bar of the remote meeting management platform when needed, and executing corresponding processes by corresponding operation controls of each operation entry; for example: monitoring the entrance of a policeman into a marking sub-interface in the monitoring process, inputting marking information, recording the marking information at the corresponding marking time after the marking control acquires the marking information, wherein the recorded position can be set as required; for another example, in the monitoring process, a monitoring policeman clicks a hard-break button on a video meeting page, and a hard-break control acquires a hard-break instruction and sends the instruction to the video meeting host.
Step twelve: and (3) hearing evaluation: after the long-distance video meeting is finished, the policeman can perform the replay of the recorded and recorded audio and video data and evaluate the long-distance video meeting condition. Meanwhile, the recording video file which is not listened again (replayed) as required reminds the policeman in various modes such as popup window, short message and the like.
2. The schematic flow of the remote video conference service for entrance "pledge application" is shown in fig. 4, which includes the following contents:
the method comprises the following steps: meeting application: the escort personnel can apply for the remote video meeting on the touch screen terminal in the prison room and can select the family members who want to meet.
Step two: meeting and approval: after the escorting personnel submit the meeting application, the supervision place audits according to the meeting rule of the escorting personnel, and the supervision place leads the supervision place to carry out remote video meeting examination and approval.
Step three: meeting notification: after the interview approval is passed, the system can automatically send a short message to inform the family members that' someone wants to conduct remote video interview with you, please reserve the remote video interview time on a portal website of a supervision place within 5 days, the remote video interview time is regarded as not wanted to be interviewed after overdue reservation, the interview can be interviewed only by applying again, and a mobile phone client downloads an address: https:// xxxxxxxxxx ".
Step four: meeting appointment: after the family members receive the notification of meeting appointment, the family members can submit the appointment reservation remote video meeting time on a portal website or a mobile phone client (APP) of the supervision place. The system directly presents the vacant remote video meeting seats of the escorting personnel when a certain day is available in the form of a chart.
Step five: reservation acceptance: after the family members reserve the remote video meeting date, the policemen confirm and arrange meeting batches, meeting seats and the like.
Step six: automatic reminding: on the appointed remote video meeting day, when the escorting personnel are closed, out of the residence, hospitalizing and the like, the system sends a short message in advance to inform the family members that the meeting cannot be carried out; when the appointed remote video conference date comes, the system can send a short message in advance to remind family members of carrying out remote video conference when, and automatically display a list of escorting personnel who need to carry out remote video conference on escorting policemen places (all in public security supervision grounds), a supervision room (all in judicial supervision grounds), a client side of a labor room and an LED display screen (or a large screen), at the moment, the administrative policemen prepares the escorting personnel who need remote video conference, and the escorting policemen (still being a supervised policemen in the judicial supervision grounds) holds the escorting list to the labor places or prison (all in judicial supervision grounds) and escorting the escorting personnel. And for the condition that the escorting personnel do not want to meet, the escorting personnel directly inform the family members of the reasons and reasons of the non-meeting through the short message after confirmation on the client.
Step seven: meeting and waiting: and the escorting policemen escort the escorting personnel to wait for the meeting notice after arriving at the door of the remote video meeting room.
Step eight: meeting notification: when the escorting personnel meet, the system can automatically display the information of the name, the seat and the like of the escorting personnel on an LED display screen (or a large screen) at the door of the remote video meeting room.
Step nine: identity verification: before the escorting personnel and the family members meet in a remote video mode, the identity of the family members needs to be verified, and the system automatically verifies the identity of the family members by comparing the video of the family members, the pictures when meeting is applied, the backup pictures of the system and the like.
Step ten: video meeting: after the family identity is verified, the family can conduct remote video interview with the escorting personnel. At the moment, the system can automatically record the video of the family members and the escorting personnel.
Step eleven: monitoring: the monitoring policeman can monitor the remote video conference in the monitoring room or the remote video conference room, and can perform operations such as marking, break and forced disconnection on the remote video conference in the monitoring room and controlling the conference duration; in addition, the leader can also monitor the remote video conference in the office.
Step twelve: and (3) hearing evaluation: after the long-distance video meeting is finished, the policeman can perform the replay of the recorded and recorded audio and video data and evaluate the long-distance video meeting condition. Meanwhile, the recording video file which is not listened again (replayed) as required reminds the policeman in various modes such as popup window, short message and the like.
According to the meeting business process and in combination with the actual application scenario, a system topology structure diagram can be drawn, as shown in fig. 5.
After the remote video conference service flow and the topology structure are mastered, the system design adopts a mode of 'family client computer or mobile phone (APP) + remote video conference host + monitoring client computer + remote conference platform software' to realize remote video conference, as an example shown in fig. 2.
The family members and the escorting personnel view the video pictures of the other party through respective display terminals and carry out conversation and communication. The video composite picture of the family members and the escorting personnel is stored in the remote video meeting host and the storage medium through the remote video meeting host and is presented on a monitoring client for monitoring policemen. Meanwhile, the monitoring policeman can also perform monitoring, marking, forced insertion, forced disconnection, time duration control and other operations besides monitoring the meeting process of the family members and the escort personnel, and can also evaluate the meeting condition.
Referring to fig. 6, a video stream flow in a remote video conference includes:
1) establishing a call remote video meeting: after logging in a portal website of a supervision place, family members download a control or log in a mobile phone client (APP), actively register on the remote video meeting host, and establish a conversation with the remote video meeting host.
2) The family video stream is that the video picture of the family is shot by a USB camera (or a camera carried by a computer) or a mobile phone camera and then transmitted to a remote video meeting host through the Internet network (or a government affair network if the government affair network cannot use a mobile phone client), and then is displayed on a display through the local output of the remote video meeting host, or the video stream is transmitted to a PC end through the remote video meeting host and displayed to the escorting personnel, wherein the video stream flows to ① → ② → ③ in the figure.
3) The video stream of the escorting personnel is transmitted to the computer or the mobile phone of the family end through the Internet (or a government affairs network) after the video picture of the escorting personnel is shot by the IP camera and passes through the remote video meeting host computer, and is presented to the family, the video stream flows to ④ → ⑤ in the figure, in the example, the video acquisition equipment is the IP camera, and can acquire audio and images.
4) The video images of the family members and the escorting personnel are synthesized into a one-to-one synthesized image on the remote video meeting host, the synthesized image video stream is locally stored on the remote video meeting host, the synthesized image video stream is transmitted to a monitoring client of the monitoring policeman end through the Internet (or a government affair network) to be presented to the monitoring policeman and is transmitted to a storage medium to be stored for a long time, and the video stream flows to ⑥ and ⑦ in the figure.
Referring to fig. 7, an audio stream flow in a remote video conference includes:
1) establishing a call remote video meeting: after logging in a portal website of a supervision place, family members download a control or log in a mobile phone client (APP), actively register on the remote video meeting host, and establish a conversation with the remote video meeting host.
2) The family audio stream is that the speaking content of the family is collected by a microphone, passes through a computer or a mobile phone of the family end, is transmitted to a remote video meeting host computer through the Internet (or a government affair network), and is transmitted to an IP camera through the network to be played for the escort personnel to listen, and the audio stream flows to ① → ② → ③ in the figure.
The audio stream of the escorting personnel flows to ④ → ⑤ → ⑥ in the figure, the video meeting host can also receive the speech information of the escorting personnel through a microphone connected with the video meeting host, the microphone can also be connected with the IP camera, the IP camera is further connected with the video meeting host, the speech content of the escorting personnel is transmitted to the video meeting host through the microphone and the IP camera, the microphone can also be connected with the PC end, the PC end is further connected with the video meeting host, and the speech content of the escorting personnel is transmitted to the video meeting host through the microphone and the PC.
3) Audio streaming of policemen: the call insertion content of the policemen is collected by the headset and transmitted to the remote video meeting host through the monitoring client computer, and then the remote video meeting host distributes the call insertion content of the policemen to the computer or the mobile phone of the family end and the IP camera for the family and the escort personnel to listen. Audio stream from policemen to family members flows as in the above figureOr(local policemen), audio streaming of policemen to escort personnel flows as in the above figureOr. The call-inserting content of the policemen can also be transmitted to the video meeting host through a local microphone directly connected with the video meeting host.
4) After the audio of the family and the escort is transmitted to the remote video conference host, the remote video conference host mixes the audio of the family with the audio of the escort and then monitors the police, the monitoring room monitors the audio mixing audio flow of the police to flow to ⑧ → ⑨ in the figure, and the on-site monitors the audio mixing audio flow of the police to flow to ⑦ in the figure.
5) After the audio of the family members, the escorting personnel and the policemen is transmitted to the remote video conference host, the remote video conference host can mix the audio of the family members, the audio of the escorting personnel and the audio of the policemen, then the audio of the family members, the audio of the escorting personnel and the audio of the policemen are locally stored on the remote video conference host all the way, and the audio of the escorting personnel and the policemen is stored in a storage medium all the way for long time, wherein the flow direction of the audio of the mixing of the family members, the escorting personnel and the policemen is ⑩ in the figure.
Compared with the original mode of 'family client computer + escort personnel client computer + QQ chatting tool + screen video recording software + field monitoring', the invention adopts the mode of 'family client computer or mobile phone (APP) + remote video conference host + monitoring client computer + remote conference platform software', and has the following advantages:
1) the QQ chat tool is adopted, and for the situation that the family members and the escorting personnel have talking cases, use secret language conversation and the like and do not comply with the meeting system, the monitoring policeman can only carry out the operations of warning or closing the QQ and the like on site.
2) The QQ chat tool is adopted, the monitoring policemen can only monitor on site, and cannot monitor and monitor in the background through a network.
3) The QQ chat tool is adopted, direct recording and video recording cannot be achieved, recording and video recording are required to be conducted on remote video interviews by means of screen video software, screen video software is required to be opened once every remote video interview by a policeman, searching is complicated afterwards and is required to be searched one by one, in the invention, the remote video interview host is adopted to conduct picture synthesis and audio mixing and then recording and video recording, in order to facilitate long-term storage, centralized storage is supported by a system, operation is not required in the whole process, meanwhile, the system supports inquiry in various modes such as family names, names of escorting personnel, interview application numbers, interview application time, interview day time, marks and the like, fuzzy inquiry is supported, and serial connection and statistics can be conducted on the historical interview information and the recording and video recording data of the escorting personnel and the families.
4) The QQ chat tool is adopted, family members are required to be added in advance as QQ friends, the escort personnel meet different family members once, the operation is complicated, the conversation is established in a mode that the family members actively register to the remote video meeting host, and the adding operation is not required.
5) The QQ chat tool is adopted, so that the risks of number stealing, wiretapping and the like exist, and the audio and video input of the family end is not encrypted and is encrypted, so that the data security is ensured.
6) The functions of applying for meeting and reserving meeting of the smart phone are achieved, and news of prison, law enforcement disclosure, prison guide and policy and regulation are inquired.
7) The automatic verification of the family identity is realized, manual comparison by policemen is not needed, and after the system is in butt joint with a supervision information system, a supervision transformation system or a prison and political management system, basic information, social relations, grade change, whether escorting personnel are emphasized, prison reward and punishment, examination reward and punishment and other basic data of the escorting personnel can be directly called, so that the inaccuracy of the remote video interview system on data identification caused by the asynchronous data is reduced (for example, different meetings are generated when the escorting personnel have grade change, team change and reward and punishment change).
8) In addition, the system can be in butt joint with a prevention and control system, so that the comparison between the family members and the escaped personnel is realized, and the function of deeply digging crimes is realized.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (9)
1. A method for performing remote instant messaging, the method comprising:
the video meeting host establishes connection with the monitoring client and also establishes connection with the remote client;
the video meeting host acquires instant data collected by a home terminal, represents the instant data as first instant data, and sends the first instant data to a remote client for displaying; receiving instant data from a remote client, representing the instant data as second instant data, and sending the second instant data to local equipment for displaying;
the video meeting host combines the first instant data and the second instant data to obtain combined data, sends the combined data to the monitoring client for display, and sends the combined data to a storage medium for storage;
the video meeting host receives a break-in instruction containing third instant data, wherein the third instant data is audio data; the video meeting host inserts third instant data into the currently received first instant data and second instant data, and the third instant data covers audio data corresponding to the time period of the third instant data in the first instant data and the second instant data;
the combined data sent to the storage medium for storage also comprises third instant data for mixing processing with the first instant data and the second instant data.
2. The method of claim 1, wherein the first instant data and the second instant data comprise audio data and image data:
the video meeting host computer obtains the instant data collected by the local terminal, and the instant data comprises the following steps: the host side carries out picture shooting and audio acquisition and sends shot image data and acquired audio data to the video meeting host;
the video meeting host receiving the instant data from the remote client comprises: the remote client side carries out picture shooting and audio acquisition and sends shot image data and acquired audio data to the video meeting host;
the video conference host combining the first instant data and the second instant data comprises: and the video meeting host carries out image picture synthesis processing according to the image data in the first instant data and the second instant data, and carries out sound mixing processing on the audio data in the first instant data and the second instant data to obtain the combined data.
3. The method of claim 1, wherein when the instant data is audio data:
the video meeting host computer obtains the instant data collected by the local terminal, and the instant data comprises the following steps: carrying out audio acquisition, and sending acquired audio data to the video meeting host;
the video meeting host receiving the instant data from the remote client comprises: the remote client acquires audio and sends acquired audio data to the video meeting host;
the video conference host combining the first instant data and the second instant data comprises: and the video conference host carries out sound mixing processing according to the first instant data and the second instant data to obtain mixed audio data, namely the combined data.
4. The method of any of claims 1-3, wherein prior to the video conference host establishing a connection with a remote client, the method further comprises:
the remote client accesses the remote meeting management platform server and uploads a face image currently shot by the remote client;
the remote meeting management platform server reads a face image stored in advance, compares the face image with a currently received face image for identification, and feeds back matching success information to the remote meeting management platform server if the face image is matched with the currently received face image;
and the remote meeting management platform server acquires that the matching is successful and establishes the connection between the remote client and the video meeting host.
5. A method according to any one of claims 1 to 3, characterized in that the method further comprises:
the monitoring client sends a forced disconnection instruction to the video meeting host, and the video meeting host stops sending data to the remote client and the local equipment; or,
and the monitoring client sends a time length control instruction containing the updated time length to the video meeting host, and the video meeting host adjusts the locally set communication time length according to the updated time length.
6. A method according to claim 2 or 3, characterized in that the method further comprises: the monitoring client side obtains marking information and records the marking information corresponding to the marking time;
the method also comprises a hearing process, specifically:
the monitoring client receives a re-listening instruction containing the description identification, reads data corresponding to the description identification from the storage medium, and reads the mark information corresponding to the description identification;
monitoring the read data played by the client, and displaying the marking information when the marking moment comes.
7. A system for carrying on the long-range instant messaging, wherein the system includes the video meets the host computer, data acquisition equipment, local device, storage medium and monitors the customer end;
the video meeting host establishes connection with the monitoring client and also establishes connection with the remote client; the video meeting host acquires instant data from the data acquisition equipment, represents the instant data as first instant data, and sends the first instant data to the remote client for displaying; receiving instant data from a remote client, representing second instant data, and sending the second instant data to the local equipment; combining the first instant data and the second instant data to obtain combined data, sending the combined data to the monitoring client, and sending the combined data to a storage medium for storage;
the local equipment receives and displays first instant data from the video meeting host;
the monitoring client receives the combined data from the video meeting host and displays the combined data;
the video meeting host receives a break-in instruction containing third instant data, wherein the third instant data is audio data; the video meeting host inserts third instant data into the currently received first instant data and second instant data, and the third instant data covers audio data corresponding to the time period of the third instant data in the first instant data and the second instant data; the combined data sent to the storage medium for storage also comprises third instant data for mixing processing with the first instant data and the second instant data.
8. The system of claim 7, wherein the first instant data and the second instant data comprise audio data and image data:
the data acquisition equipment is used for shooting pictures and acquiring audio, and sending shot image data and acquired audio data to the video meeting host;
and the video conference host carries out image picture synthesis processing according to the image data in the first instant data and the second instant data, and carries out sound mixing processing on the audio data in the first instant data and the second instant data to obtain the combined data.
9. The system of claim 7, wherein when the instant data is audio data:
the data acquisition equipment is used for acquiring audio and sending the acquired audio data to the video meeting host;
and the video conference host carries out sound mixing processing according to the first instant data and the second instant data to obtain mixed audio data, namely the combined data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410461686.4A CN105407409B (en) | 2014-09-11 | 2014-09-11 | Carry out the method and system of long-range instant messaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410461686.4A CN105407409B (en) | 2014-09-11 | 2014-09-11 | Carry out the method and system of long-range instant messaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105407409A CN105407409A (en) | 2016-03-16 |
| CN105407409B true CN105407409B (en) | 2019-05-28 |
Family
ID=55472612
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410461686.4A Active CN105407409B (en) | 2014-09-11 | 2014-09-11 | Carry out the method and system of long-range instant messaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105407409B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107105027A (en) * | 2017-04-18 | 2017-08-29 | 成都仁通融合信息技术有限公司 | Mobile communication electronic remote visits system |
| CN107613241A (en) * | 2017-10-09 | 2018-01-19 | 褚云霞 | Visit method, apparatus and system in prison strange land |
| CN111586334B (en) * | 2020-04-29 | 2022-02-08 | 从法信息科技有限公司 | Remote meeting method, device and system, electronic equipment and storage medium |
| CN111556272A (en) * | 2020-05-21 | 2020-08-18 | 广州畅驿智能科技有限公司 | Video communication monitoring method and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101626490A (en) * | 2008-11-19 | 2010-01-13 | 辛敬福 | Embedded visiting device and system |
| CN101950383A (en) * | 2010-09-08 | 2011-01-19 | 山东中磁远程视讯技术有限公司 | Social assistance and education system for prisoner and realization method thereof |
| CN101950384A (en) * | 2010-09-08 | 2011-01-19 | 山东中磁远程视讯技术有限公司 | Implementation method of psychological consulting system for social help and education of prisoners |
| US9288439B2 (en) * | 2012-12-21 | 2016-03-15 | Tw Vending, Inc. | Audio-video remote visitation telecommunications technology |
-
2014
- 2014-09-11 CN CN201410461686.4A patent/CN105407409B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105407409A (en) | 2016-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10397785B2 (en) | Handheld video visitation | |
| US11985268B2 (en) | Community safety, security, health communication and emergency notification system providing emergency source tracking | |
| US20020106998A1 (en) | Wireless rich media conferencing | |
| US9154740B2 (en) | System and method for real time video streaming from a mobile device or other sources through a server to a designated group and to enable responses from those recipients | |
| US8548423B2 (en) | Mobile based neighborhood watch system capable of group interactions, anonymous messages and observation reports | |
| CN102594793B (en) | Generate the method and system of the cooperation timeline of the application workpiece illustrated in situation | |
| US20030211856A1 (en) | System and method for facilitating interactive presentations using wireless messaging | |
| US20160261648A1 (en) | Communication system and method of using the same | |
| US20020123883A1 (en) | Remote deposition system and method | |
| US11871073B2 (en) | Controlled environment media and communication system | |
| EP1427211A1 (en) | Multimedia information communication service system, user terminal program, and recording medium | |
| US10448212B2 (en) | Community safety, security, health communication and emergency notification system with common short code SMS communication capabilities | |
| CN105407409B (en) | Carry out the method and system of long-range instant messaging | |
| CN104933508A (en) | Mobile prosecutorial office affairs handling system and method | |
| US20200213319A1 (en) | Managing user access to restricted content through intelligent content redaction | |
| US20140059582A1 (en) | Participation system and method | |
| CN106331582A (en) | Remote video court session opening method and device | |
| US20090016496A1 (en) | Communication system | |
| Mulcahy et al. | Exploring the case for virtual jury trials during the COVID-19 crisis: An evaluation of a pilot study conducted by JUSTICE | |
| CN112838979A (en) | Case discussion information interaction method and system | |
| CN100418157C (en) | Video-audio system | |
| US20140280630A1 (en) | Method and system for efficient review of exchanged content | |
| JP2007265369A (en) | Recruitment/application support system using cellular phone with moving picture function and tv phone function | |
| CN111405244A (en) | Online remote video wisdom community correction system | |
| CN110278549B (en) | Network conference method, network conference system and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |