WO2020211437A1

WO2020211437A1 - Screen casting method, multi-screen interaction device, and system

Info

Publication number: WO2020211437A1
Application number: PCT/CN2019/127769
Authority: WO
Inventors: 苏章岳
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2019-04-15
Filing date: 2019-12-24
Publication date: 2020-10-22
Also published as: CN110087126A

Abstract

Disclosed in embodiments of the present invention are a screen casting method, a multi-screen interaction device, and a system. The screen casting method comprises the following steps: acquiring, by means of a data connection with a first terminal apparatus, first screen data output by the first terminal apparatus; acquiring locally displayed second screen data according to the first screen data; displaying the second screen data; and sending, by means of a data connection with a second terminal apparatus, the second screen data, in whole or in part, to the second terminal apparatus for display.

Description

Screen transfer method and multi-screen interactive device and system

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office with application number 201910301467.2 on April 15, 2019. The entire content of this application is incorporated into this application by reference.

Technical field

The embodiments of the present application relate to the field of screen interaction, for example, to a screen transfer method and a multi-screen interactive device and system.

Background technique

Wireless screen transfer refers to the transfer of multimedia content from a portable terminal to other devices via a wireless network. For example, taking a conference scene as an example, the multimedia content of a mobile phone or PC can be transferred to a large-screen device with a larger screen through the conference LAN In order to realize a multi-person meeting; taking the podium teaching scene as an example, the files on the mobile phone or PC can be transferred to the large-screen equipment in the classroom through the classroom LAN, so as to realize the switch from small screen to large screen.

However, the wireless screen transfer solutions existing in related technologies are only screen transfer between two screens, and the related technology has not yet proposed a solution for screen transfer between multiple screens.

Summary of the invention

This application provides a multi-screen interaction method to realize screen transfer between multiple screens.

In a first aspect, an embodiment of the present application provides a multi-screen interaction method, including: obtaining first screen data output by the first terminal device through a data connection with a first terminal device; obtaining first screen data output according to the first screen data Locally displayed second screen data; display the second screen data; through a data connection with the second terminal device, all or part of the second screen data is sent to the second terminal device for display.

The multi-screen interaction method provided by the embodiments of the present application builds a data connection network for screen transmission between the local and the first terminal device and the second terminal device through the local data connection with the first terminal device and the second terminal device; In addition, the locally displayed second screen data is obtained from the first screen data output by the first terminal device, and the second terminal device displays all or part of the second screen data, so that the local connection between the first terminal device and the second terminal device The content displayed on the two screens is consistent, and the content displayed on the first terminal device is transmitted to the local and third terminal devices for display based on the content displayed on the first terminal device, and the same content is displayed on the three screens.

In an embodiment, the step of obtaining locally displayed second screen data according to the first screen data includes: obtaining the first screen data as the second screen data; or obtaining an editing operation input by a local input device Instructions, and generate second screen data according to the editing operation instruction and the first screen data.

In an embodiment, the step of acquiring an editing operation instruction input by a local input device, and generating second screen data according to the editing operation instruction and the first screen data includes: acquiring an annotation operation instruction input by the local touch input device, Obtain corresponding annotation data according to the annotation operation instruction, and generate second screen data according to the first screen data and the annotation data.

In many cases, especially in conferences and classroom teaching scenarios, annotating and editing screen data locally will cause changes in the display interface, such as drawing the focus of the presentation file with a circle or underline, etc. . In the embodiment of this application, the annotations, the edited content, that is, the annotation data are also intercepted to synthesize the second screen data, and the screen is transferred to the second terminal device for display, so that the local annotation operation is simultaneously displayed to the second terminal equipment.

In the screen transfer mode, only a screenshot of the screen display content of the first terminal device is sent to the second terminal device for display. In order to realize the page turning operation of a multi-page presentation file, in one embodiment, the first terminal device is acquired The step of outputting the first screen data further includes: acquiring the control instruction input by the local input device; transmitting the control instruction back to the first terminal device through the data connection with the first terminal device; receiving the first terminal device The first screen data output by the device after switching according to the control instruction.

In an embodiment, after acquiring the first screen data output by the first terminal device, the method further includes the following steps: saving the first screen data to a local first buffer area; according to the editing operation instruction and the After the first screen data generates the second screen data, the method further includes the following step: storing the second screen data in a local second buffer area.

The storage of the first screen data and the second screen data in different local cache areas facilitates data management.

In an embodiment, the step of sending the second screen data to the second terminal device for display includes: controlling the second terminal device to synchronously display the second screen data locally.

In an embodiment, the second screen data includes first area screen data and second area screen data, and the step of displaying the second screen data includes: displaying the first area screen data and the second area screen data The step of sending all or part of the second screen data to the second terminal device for display includes: sending the first area screen data to the second terminal device for display.

In one embodiment, the screen of the third terminal device is used as a local extended screen to implement sub-regional extended display of local second screen data, only display the first region screen data, and receive a trigger input from the local touch input device The screen data of the second area is displayed after the instruction. It is suitable for presentations, conferences, or teaching scenarios, where files are presented to multiple people through the third terminal, and only remarks, presentations, etc. are displayed locally.

In an embodiment, the first area screen data includes remark data, and the second area screen data includes remark data.

In an embodiment, the data connection with the first terminal device and the data connection with the second terminal device are respectively established by using a time division multiplexing method for the local routing module.

In an embodiment, the embodiment of the present application further includes the following steps: obtaining the first audio data output by the first terminal device through a data connection with the first terminal device; or receiving the second audio data input through the audio input device Audio data; sending at least one of the first audio data and the second audio data to the second terminal device for playback through a U-segment communication connection with the second terminal device.

In an application scenario, the first terminal device is a data source device, and the second terminal device is a large-screen display device.

On the other hand, an embodiment of the present application also provides a multi-screen interactive device, including: a data receiving module configured to obtain first screen data output by the first terminal device through a data connection with the first terminal device; data The generating module is configured to obtain locally displayed second screen data according to the first screen data; the display module is configured to display the second screen data; the data output module is configured to connect to the second terminal device through data, Send all or part of the second screen data to the second terminal device for display.

The multi-screen interactive device in the embodiment of the present application establishes a data connection network for screen transmission between the local device, the first terminal device and the second terminal device by establishing a local data connection with the first terminal device and the second terminal device; In addition, the locally displayed second screen data is obtained from the first screen data output by the first terminal device, and the second terminal device displays all or part of the second screen data, so that the local connection between the first terminal device and the second terminal device The contents displayed on the two screens are consistent. They are all based on the content displayed by the first terminal device and transmitted to the local and third terminal devices for display. The three screens display the same content; and in some cases, through the input device The annotations formed by the input editing operations are also sent to the second terminal device for display simultaneously; by returning the control instructions input by the input device, the display content can be switched locally; and the second area screen data can be displayed by time-sharing trigger to achieve selectivity The local screen display content is displayed regionally.

In another aspect, an embodiment of the present application also provides a multi-screen interactive device, including a display device, a display processor, a data transmission module, and a system processor; the display device is electrically connected to the display processor, and the data transmission The modules are respectively electrically connected to the system processor and the display processor; the data transmission module is configured to establish a data connection between the multi-screen interactive device and the first terminal device to obtain the output of the first terminal device And send the first screen data to the display processor; also set to establish a data connection between the multi-screen interactive device and the second terminal device, obtain the second screen data output by the display processor, and send the second All or part of the screen data is sent to the second terminal device for display; the display processor is configured to obtain locally displayed second screen data according to the first screen data, and output the second screen data to the display device And a data transmission module; the display device is configured to display the second screen data decoded by the display processor.

In an embodiment, the data transmission module includes a routing module, the routing module is connected to the system processor, and the system processor is configured to control the routing module to use a time division multiplexing method to separately transmit data from the first terminal device. Receiving the first screen data and sending the second screen data to a second terminal device.

In an embodiment, the data transmission module further includes an internal screen transfer device connected to the routing module, and the internal screen transfer device is used to obtain second screen data and send it to the dual-mode router.

In one embodiment, it further includes an input device; the input device is electrically connected to the display processor; the input device is used to input an annotation operation instruction, and the display processor is used to obtain a corresponding instruction according to the annotation operation instruction. The annotation data of the first screen data is combined with the first screen data to generate the second screen data; or, the annotation layer is created on the display layer of the first screen data, and the The annotation data is displayed on the annotation layer, and the second screen data is generated.

In an embodiment, the input device is also used to input control instructions, and the data transmission module is used to transmit the control instructions back to the first terminal device and receive the first terminal device according to the control The first screen data output after the instruction is switched.

In an embodiment, it further includes a memory, which is electrically connected to the data transmission module;

The memory includes a first buffer area and a second buffer area. The first buffer area is used to store the first screen data, and the second buffer area is used to store the second screen data.

The multi-screen interactive device in this embodiment of the application establishes a data connection with the first terminal device and the second terminal device through the data transmission device, and establishes a data connection for screen transmission between the local, the first terminal device and the second terminal device Network; and, the locally displayed second screen data is obtained from the first screen data output by the first terminal device, and the second terminal device displays all or part of the second screen data, thereby locally communicating with the first terminal device and the second terminal The contents displayed on the three screens of the device are consistent. They are all based on the content displayed by the first terminal device and transmitted to the local and third terminal devices for display. The three screens display the same content; and in some cases, through The annotation formed by the editing operation input by the input device is also synchronously sent to the second terminal device for display; by returning the control instruction input by the input device, the display content can be switched locally; and the second area screen data can be displayed by time-sharing trigger Select and sub-regionally display local screen content.

In addition, an embodiment of the present application also provides a multi-screen interactive system, including a wireless screen transfer device, the above-mentioned multi-screen interactive device and a data receiving device; the wireless screen transfer device is connected to the first terminal device and is set to obtain The first screen data of the first terminal device is also set to establish a wireless communication connection with the multi-screen interactive device, and send the first screen data to the multi-screen interactive device; the data receiving device is set to communicate with the first The second terminal equipment is connected, and is also configured to establish a wireless communication connection with the multi-screen interactive device, and receive second screen data sent by the multi-screen interactive device; the multi-screen interactive device is configured to communicate with the wireless screen transmission device To obtain the first screen data output by the first terminal device; obtain the locally displayed second screen data according to the first screen data; display the second screen data; through the wireless communication with the data receiving device Communication connection, sending all or part of the second screen data to the second terminal device for display.

In an embodiment, the wireless screen transfer device includes a TypeC receiving port, a wireless module, a first data conversion chip, and a microprocessor; the TypeC receiving port is connected to the first data conversion chip, and the A data conversion chip is connected to the TypeC receiving port and a microprocessor, and the microprocessor is connected to the wireless module; the TypeC receiving port is used to receive the first screen data of the first terminal device; A screen data is media data in the DP protocol format, the media data is the media content displayed on the screen of the first terminal device; the first data conversion chip and the microprocessor are used to receive the first data from the TypeC receiving port The screen data is used for data format conversion of the first screen data; the wireless module is used for sending the first screen data after the data format conversion to the multi-screen interactive device.

In one embodiment, the data receiving device includes: a receiving routing module, which is used to establish a wireless communication connection with the multi-screen interactive device; a first interface, which is used to connect with a second terminal device; The routing module is connected to the first interface for wireless communication connection with the multi-screen interactive device, receives second screen data sent by the multi-screen interactive device, and passes the second screen data through the The first interface is transmitted to the second terminal device.

For a better understanding and implementation, the application will be described in detail below with reference to the drawings.

Description of the drawings

FIG. 1 is a flowchart of the screen transfer method according to the first embodiment of this application;

FIG. 2 is a schematic structural diagram of a screen transfer device according to a second embodiment of this application;

FIG. 3 is a schematic structural diagram of a multi-screen interactive device of an exemplary solution of the second embodiment of the application;

4 is a schematic structural diagram of a multi-screen interactive device according to a third embodiment of this application;

5 is a circuit block diagram of an implementation manner of the multi-screen interactive device according to the third embodiment of this application;

6 is a schematic structural diagram of a multi-screen interactive system according to a fourth embodiment of this application;

FIG. 7 is a schematic structural diagram of a wireless screen transmission device according to a fourth embodiment of this application;

FIG. 8 is a schematic structural diagram of a data receiving device according to a fourth embodiment of this application.

detailed description

The exemplary embodiments of the present application will be described below with reference to the accompanying drawings. Unless otherwise specified, the implementation manners described in the following exemplary embodiments do not limit the present application. Those of ordinary skill in the art make the following according to these implementation manners. The structure, method, or function transformation of is included in the protection scope of this application.

The terms used in the embodiments of the present application are only used to describe the various embodiments, and are not intended to limit the present application. It should be understood that although the terms first, second, third, etc. may be used in this application to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first terminal may also be referred to as the second terminal, and similarly, the second terminal may also be referred to as the first terminal. It depends on the context.

The embodiment of the present application provides a screen transfer method, which can be executed by a multi-screen interactive device to realize mutual transfer and interaction of screen content between multiple display terminals. The multi-screen interactive device may be implemented by software and/or hardware, and may be composed of two or more physical entities, or may be composed of one physical entity.

The multi-screen interactive device may be a functional module of an all-in-one computer subordinate to a computer, a tablet, an intelligent interactive tablet, or an intelligent platform, or it may be an all-in-one computer, a tablet computer, an intelligent interactive tablet, or an intelligent platform.

In this embodiment, the multi-screen interactive device is an integrated computer with a smart platform or a functional module of the integrated computer with the smart platform as an example for description.

Wherein, the computer all-in-one computer of the smart platform can be an integrated device that controls, annotates, and implements human-computer interactive operations on the content displayed on the display screen through touch technology, and has data receiving and transmission functions, which can be integrated One or more functions such as stylus, microphone, data hotspot, etc.

It can be connected with the stand of the smart podium to form a podium structure, which can control, mark and realize human-computer interaction with the content displayed on the display, and have the functions of data receiving and transmission, and screen transmission. .

In an embodiment, the integrated computer of the smart platform can establish a data connection with at least one data source terminal. The data source terminal may include, but is not limited to: mobile phones, notebook computers, tablet computers, desktop computers, servers, etc. It may also be a mobile phone, a notebook computer, a tablet computer, a desktop computer and a server through a multi-screen interactive device to establish a connection with the computer integrated machine of the intelligent platform.

The integrated computer of the smart platform can also establish a data connection with at least one external display terminal at the same time. The external display terminal may be a large-screen display device, TV or projection screen with data receiving and decoding functions, or a large-screen display device, TV or projection screen connected to a data receiving and decoding device. To receive the display data transmitted by the integrated computer of the intelligent platform, and show it to the audience of the platform.

This embodiment does not limit the data connection and communication methods between the integrated computer of the smart podium and the data source terminal and the external display terminal. The communication methods may include but are not limited to wired or wireless communication methods, such as: USB connection, Internet, LAN, Bluetooth, WIFI or Zifeng protocol (ZigBee).

In one embodiment, the all-in-one computer of the smart platform may be installed with a screen transfer application software, and the screen transfer application software is used to obtain the first terminal device outputted by the first terminal device through a data connection. A screen data; obtain locally displayed second screen data according to the first screen data; display the second screen data; send all or part of the second screen data to the data connection with the second terminal device The second terminal device displays.

As shown in FIG. 1, FIG. 1 is a flowchart of the screen transfer method according to the first embodiment of the present application.

The screen transfer method of this embodiment includes:

S102: Acquire first screen data output by the first terminal device through a data connection with the first terminal device;

S104: Obtain locally displayed second screen data according to the first screen data;

S106: Display the second screen data;

S108: Send all or part of the second screen data to the second terminal device for display through the data connection with the second terminal device.

Wherein, the first terminal device is the data source terminal. In the application environment of the smart platform, it can be a laptop computer, a tablet computer, a desktop computer, or other devices. The first terminal device at least includes a storage, an integrated data transmission device or an external data transmission device, a controller and/or a display controller, and a display. The storage can store data files, and the controller and/or display controller are used to obtain the stored data files from the storage, open the data files and generate first screen data, according to the first screen data Control the display on the display screen, and output the first screen data through the integrated data transmission device or the external data transmission device.

The first screen data may be automatically obtained from the first terminal device after the first terminal device opens the data file and establishes a data connection with the integrated computer of the smart platform; it may also be obtained in the first terminal device. Get it when the device or its externally connected multi-screen interactive device triggers the screen transfer function.

The first screen data is the display data after the first terminal device opens the corresponding data file, which may include only the data content corresponding to the data file, or may include the data content corresponding to the data file and the The system content of the first terminal device, such as the system desktop, function menu, etc. The data files can be presentations, text files, and other text editing software data files, or media stream data, such as pictures, videos, etc.

In one embodiment, the all-in-one computer of the smart platform is allowed to perform reverse operation control on the first terminal device.

The step of obtaining the first screen data output by the first terminal device further includes:

Acquiring a control command input by a local input device;

Transmitting the control instruction back to the first terminal device through a data connection with the first terminal device;

Receiving first screen data output by the first terminal device after switching according to the control instruction.

The control instruction may be opening a file, closing a file, moving cursor, page up, page down, scroll or move, etc.

The all-in-one computer of the smart platform receives the user's control instruction through its input device (such as a touch screen, etc.), and returns the control instruction to the first terminal device, and the first terminal device executes the control instruction, Perform operations such as opening files, closing files, moving cursor, page up, page down, scrolling or moving, etc., to generate new first screen data, and transmit the new first screen data to the smart platform through the data connection All-in-one computer.

By returning the control command, the integrated computer of the intelligent platform can be allowed to perform simple operation and control on the first terminal device, without requiring the operator to walk back and forth between the two devices for operation, which is more convenient.

In an embodiment, the step of obtaining locally displayed second screen data according to the first screen data includes:

Acquiring the first screen data as the second screen data;

Or, acquiring an editing operation instruction input by a local input device, and generating second screen data according to the editing operation instruction and the first screen data.

The first screen data obtained from the first terminal device is stored in the storage, and the first screen data can be directly obtained as the second screen data, so that the first terminal device and the smart The all-in-one computer on the podium displays the same content.

Or, according to the editing operation instructions input by the user through the input device (such as a touch screen) of the integrated computer of the smart platform, such as labeling and/or graffiti. Obtain corresponding annotation and/or graffiti data according to the editing operation instruction, and generate the second screen data according to the first screen data and the annotation and/or graffiti data.

When generating the second screen data, a labeling layer can be created on the display layer of the first screen data to display the labeling and/or graffiti data on the labeling layer. Or, through calculation, the first screen data is synthesized with the annotation and/or graffiti data to generate the second screen data.

In one embodiment, after obtaining the first screen data output by the first terminal device, the first screen data is saved in the local first buffer area of the integrated computer of the smart platform; and according to the editing After the operation instruction and the first screen data generate the second screen data, the second screen data is stored in the local second buffer area of the integrated computer of the smart platform.

The first buffer area is used to buffer the received first screen data, and the second buffer area is used to buffer the second screen data to be sent. The two are independent of each other, which can improve the efficiency of receiving and sending, and avoid data writing and reading errors or mutual influence.

The second screen data is output to the display device of the integrated computer of the smart platform for display, and at the same time through the data connection between the integrated computer of the smart platform and the second terminal device, all the second screen data Or partly sent to the second terminal device for display.

The transmission of the second screen data can be actively triggered and executed by the computer integrated machine of the smart platform receiving the screen transfer instruction input by the user, or it can be established on the computer integrated machine of the smart platform to establish a connection with the second terminal device. The execution is triggered automatically after data connection.

In one embodiment, the second terminal device is a large-screen display device, which can be set on the side of the smart platform to show the second screen data to the audience.

The synchronous display can control the multi-screen interactive device and the second terminal device to synchronously display the same second screen data by adding a synchronous display timing instruction when sending the second screen data.

The synchronized display can keep the interface viewed by the operator consistent with the interface viewed by the audience. When the operator demonstrates, the audience will not feel that their voices are out of sync.

In an embodiment, the second screen data includes first area screen data and second area screen data; the step of displaying the second screen data includes:

Displaying the first area screen data and the second area screen data;

The step of sending all or part of the second screen data to the second terminal device for display includes:

The first area screen data is sent to the second terminal device for display.

During the presentation of the integrated computer of the smart platform, the operator can choose not to show part of the content to the audience, such as the pre-set remarks in the presentation. By dividing the second screen data into the first area screen data and the second area screen data; different data contents can be added to the two areas respectively, and the computer integrated machine of the intelligent platform is locally for the first area Both the area screen data and the second area screen data are displayed, so that the operator can see all the content, but only a part of the area, such as the first area screen data, is sent to the second terminal device for display, so that the audience can see the remaining second area screen The data is not visible and it is more convenient to operate.

In one embodiment, the first area screen data and the second area screen data respectively correspond to the first area and the second area of the second screen data displayed by the integrated computer of the smart podium, in the first area Both users in the second area and users in the second area can add annotations, but only the annotation content added in the first area is sent to the second terminal device for display as part of the screen data of the first area.

The all-in-one computer of the smart platform can handle the reception of the first screen data and the transmission of the second screen data by separately setting independent data transmission devices. However, as an exemplary embodiment, a routing module is provided in the computer integrated machine of the smart platform, and the routing module is controlled to receive the first screen data and send the first screen data from the first terminal device in a time division multiplexing manner. Two screen data to the second terminal device. Through time division multiplexing, the number of hardware settings in the integrated computer of the intelligent podium can be reduced, the space occupied by the device is reduced, the volume is reduced, and the integration level is improved.

In one embodiment, audio data can also be transmitted between the first terminal device, the integrated computer of the smart platform and the second terminal device. Therefore, the screen transfer method further includes the following steps:

Obtain the first audio data output by the first terminal device through the data connection with the first terminal device; or, receive the second audio data input through the audio input device;

Through the U-segment communication connection with the second terminal device, at least one of the first audio data and the second audio data is sent to the second terminal device for playback.

The audio data is sent through the U-segment communication connection, which can improve the transmission efficiency, reduce the resources occupied by the transmission of the audio data, affect the transmission of the screen data, and improve the screen transmission effect.

As shown in FIG. 2, FIG. 2 is a schematic structural diagram of a multi-screen interactive device according to a second embodiment of the present application.

In this embodiment, the multi-screen interactive device 10 of this embodiment includes:

The data receiving module 12 is configured to obtain the first screen data output by the first terminal device through a data connection with the first terminal device;

The data generating module 14 is configured to obtain locally displayed second screen data according to the first screen data;

The display module 16 is used to display the second screen data;

The data output module 18 is configured to send all or part of the second screen data to the second terminal device for display through the data connection with the second terminal device.

In one embodiment, the multi-screen interactive device 10 is allowed to perform reverse operation control on the first terminal device.

The multi-screen interactive device 10 also includes an instruction return module 13, which is used to obtain a control instruction input by a local input device, and return the control instruction to the first terminal device through a data connection. First terminal equipment;

The data receiving module 12 receives the first screen data output by the first terminal device after switching according to the control instruction.

The multi-screen interactive device 10 receives a user's control instruction through an input device (such as a touch screen, etc.), and transmits the control instruction back to the first terminal device, and the first terminal device executes the control instruction to open a file, Operations such as closing the file, moving the cursor, turning the page up, turning the page down, scrolling or moving, etc., generate new first screen data, and transmit the new first screen data to the multi-screen interactive device 10 through a data connection.

By returning a control command, the multi-screen interactive device 10 may be allowed to perform simple operation control on the first terminal device, without requiring an operator to walk back and forth between the two devices for operation, which is more convenient.

In one embodiment, the data generating module 14 obtains the first screen data as the second screen data;

In another embodiment, the data generating module 14 obtains an editing operation instruction input by a local input device, and generates second screen data according to the editing operation instruction and the first screen data.

The first screen data acquired from the first terminal device is stored in a memory, and the first screen data can be directly acquired as the second screen data, so that the first terminal device and the multiple The screen interactive device 10 displays the same content.

Or, an editing operation instruction input by the user through an input device (such as a touch screen), such as annotation and/or graffiti. The multi-screen interactive device 10 obtains corresponding annotation and/or graffiti data according to the editing operation instruction, and generates the second screen data according to the first screen data and the annotation and/or graffiti data.

When the data generating module 14 generates the second screen data, it can display the annotation and/or graffiti data on the annotation layer by creating a label layer on the display layer of the first screen data. Layer. Or, through calculation, the first screen data is synthesized with the annotation and/or graffiti data to generate the second screen data.

In an embodiment, after the data receiving module 12 obtains the first screen data output by the first terminal device, it saves the first screen data in the first buffer area; and the data generating module 14 After the editing operation instruction and the first screen data generate second screen data, the second screen data is stored in the second buffer area.

The second screen data is output to the local display device for display, and at the same time, all or part of the second screen data is sent to the second terminal device for display through the data connection with the second terminal device.

The transmission of the second screen data by the data output module 18 may be actively triggered to be executed upon receiving a screen transfer instruction input by the user, or may be automatically triggered to be executed after the data connection with the second terminal device is established.

The second terminal device is a large-screen display device, which can be set on the side of the smart platform to display the second screen data to the audience.

In one embodiment, the data output module 18 controls the second terminal device to synchronously display the second screen data locally.

Synchronous display can be realized by adding a synchronous display timing instruction when sending the second screen data to control the multi-screen interactive device and the second terminal device to synchronously display the same second screen data.

In one embodiment, the second screen data includes first area screen data and second area screen data. The display module 16 displays the first area screen data and the second area screen data; the data output module 18 sends the first area screen data to the second terminal device for display.

In the multi-screen interactive device 10, the operator can choose not to show part of the content to the audience, such as pre-set remarks in the presentation. By dividing the second screen data into the first area screen data and the second area screen data; different data contents can be added to the two areas respectively, and the first area screen data and the second area screen data can be locally processed. The data is displayed, so that the operator is visible to all content, but only part of the area, such as the screen data of the first area, is sent to the second terminal device for display, so that the audience is invisible to the remaining second area screen data, which is more convenient to operate .

In one embodiment, the first area screen data and the second area screen data respectively correspond to the first area and the second area of the displayed second screen data, and the user can perform in both the first area and the second area. An annotation is added, but only the annotation content added in the first area is sent to the second terminal device for display as part of the screen data of the first area.

In one embodiment, the receiving of the first screen data and the sending of the second screen data may be processed by independent data transmission devices. However, as an exemplary embodiment, the multi-screen interactive device 10 controls a routing module to separately receive the first screen data from the first terminal device and send the second screen data to the second terminal in a time division multiplexing manner. equipment. The time division multiplexing method can reduce the number of hardware settings, reduce the space occupied by the device, reduce the volume, and improve the integration.

Referring to FIG. 3, in one embodiment, audio data transmission may also be performed between the first terminal device, the multi-screen interactive device 10, and the second terminal device. Therefore, the multi-screen interactive device 10 further includes:

The audio receiving module 17 is configured to obtain the first audio data output by the first terminal device through a data connection with the first terminal device; or, receive the second audio data input through the audio input device;

The audio sending module 19 sends at least one of the first audio data and the second audio data to the second terminal device for playback through the U-segment communication connection with the second terminal device.

Please refer to FIG. 4, which is a structural block diagram of a multi-screen interactive device according to a third embodiment of the present application. This embodiment provides a multi-screen interactive device, the multi-screen interactive device is a computer integrated machine, including a system processor 21, a data transmission module 22, a display processor 23, and a display device 24; the display device 24 and the The display processor 23 is electrically connected, and the data transmission module 22 is electrically connected to the system processor 21 and the display processor 23 respectively.

The data transmission module 22 is used to establish a data connection between the multi-screen interactive device and the first terminal device, obtain the first screen data output by the first terminal device and send it to the system processor; and is also used to establish The data connection between the multi-screen interactive device and the second terminal device acquires the second screen data output by the display processor 23, and sends all or part of the second screen data to the second terminal device for display.

Wherein, the data transmission module 22 includes a routing module 221, which is connected to the system processor 21, and the system processor 21 is used to control the routing module 221 to use time division multiplexing. The data connection between the multi-screen interactive device and the first terminal device and the data connection with the second terminal device. The connection mode between the routing module 221 and the system processor 21 may be a network cable connection.

In an embodiment, the data transmission module 22 further includes a wireless communication module 222 for accessing a wireless communication network, the wireless communication module 222 is connected to the system processor 21, and the system processor 21 is used for Control the wireless module to receive the third screen data in the wireless communication network. The wireless communication module includes a WiFi module, a Bluetooth module, or a ZigBee module, which are currently widely used in short-distance local area network communication.

The data transmission module 22 also includes a data conversion module 223. The data conversion module 223 is connected to the routing module 221. The data conversion module 20 is used to convert the data format of the received first screen data and convert it into an HDMI signal, Audio and video data formats that can be decoded and output without compression such as VGA signal or DP data format. The data transmission module 22 is provided with a video signal output interface, and the video signal output interface includes an HDMI interface, a VGA interface, or a DP interface. Therefore, the first screen data and the third screen data received by the data conversion module 20 through the routing module 221 and the wireless communication module 222 are converted into the data format by the data conversion module 223, and output from the video signal output interface to the Display processor 23.

The data transmission module 22 also includes an internal screen transfer device 224 connected to the routing module, and the internal screen transfer device 224 is used to obtain second screen data and send it to the dual-mode router 21. The internal screen transfer device 224 may be a wireless screen transfer device, or a device that uses the data conversion module 223 to connect the output terminal of the display processor 23 and the routing module 221 through a wired connection. The data conversion module 223 converts the data format of the second screen data output by the display processor 23 and sends it to the third terminal device through the routing module 21.

The display processor 23 is configured to obtain locally displayed second screen data according to the first screen data, and output the second screen data to the display device 24 and the data transmission module 22. In an embodiment, the display processor 23 is connected to the data transmission module 22 through a video signal interface, and the video signal interface includes an HDMI interface, a VGA interface, or a DP interface. The display processor 23 is configured to decode the first screen data or the third screen data, and output it to the display device 24 for display.

The display device 24 is used to display the second screen data decoded by the display processor 23.

In an embodiment, it further includes an input device 25; the input device 25 is electrically connected to the display processor 23; the input device 25 further includes an input device; the input device 25 is electrically connected to the display processor 23 The input device 25 is used to input annotation operation instructions, and the display processor 23 is used to obtain corresponding annotation data according to the annotation operation instructions, and combine the annotation data with the first screen data after processing Generating the second screen data; or, creating a labeling layer on the display layer of the first screen data, displaying the labeling data on the labeling layer, and generating the second screen data.

As an exemplary embodiment, in order to realize that the integrated computer of the intelligent platform can perform reverse operation control on the first terminal device, the input device 25 is also used for inputting control instructions, and the data transmission module 22 is used for Transmitting the control instruction back to the first terminal device and receiving the first screen data output by the first terminal device after switching according to the control instruction. Wherein, when the input device 25 is a touch screen, the control instructions may be operations such as opening a file, closing a file, moving a cursor, turning up a page, turning a page down, scrolling or moving. The data transmission module 22 sends the control instruction back to the first terminal device and sends it to the first terminal device through the internal screen transfer device 224 and the routing module 221 in turn, and receives the first terminal device. The first screen data output by the device after switching according to the control instruction is received and converted by the routing module 221 and the data conversion module 223 after the first screen data output by the first terminal device is switched according to the control instruction. The display processor 23 decodes and outputs to the display device 24 for display.

In an embodiment, it further includes a memory 26, and the memory 26 is electrically connected to the data transmission module 22;

The memory includes a first buffer area 261 and a second buffer area 262. The first buffer area 261 is used to store the first screen data, and the second buffer area 262 is used to store the second screen data. Buffering the first screen data and the second screen data in regions is beneficial to data management, reducing data conflicts and facilitating time division multiplexing of the routing module 221.

In an embodiment, it further includes an audio input device, the audio input device is a microphone, the data transmission module 22 further includes a microphone DSP chip 225 and a U-segment signal transmitting module 226, the microphone DSP chip 225 and U-segment signal The transmitting module 226 is electrically connected, and the microphone DSP chip is electrically connected to the audio input device. The audio signal input through the microphone can be sent through the U-segment signal transmitting module 226 to other terminal devices provided with a U-segment signal receiving module for playback.

In addition, the multi-screen interactive device may also include other peripheral devices, such as buttons, a mouse, and a keyboard.

Please refer to FIG. 5, which is a circuit block diagram of an implementation manner of the multi-screen interactive device according to the third embodiment of the present application. Wherein, the system processor 21 is a PC motherboard MT42, and the data transmission module 22 includes a routing module, a wifi module, a microphone DSP chip, a U-segment signal transmission module, and a data conversion module (not shown); the routing module, The wifi module is connected to the PC mainboard MT42; the microphone DSP chip is connected to an external microphone to receive voice analog signals, and is also connected to the PC mainboard MT42 and the U-segment signal transmitting module; the display processor 23 is a TV mainboard, and the display processor 23 is connected with The data transmission device 20 is connected via HDMI and USB, and the TV motherboard is connected to an external speaker for playing audio data. The display device 24 is a HDX capacitive electromagnetic screen, which is connected to the TV main board LVDS, and is used to display the video data output by the TV main board. It also includes a touch HUB small board, which is connected to the TV main board via USB.

The multi-screen interactive device in the embodiment of the application establishes a data connection with the first terminal device and the second terminal device through the data transmission module, and establishes a data connection for screen transmission between the local device, the first terminal device and the second terminal device Network; and, the locally displayed second screen data is obtained from the first screen data output by the first terminal device, and the second terminal device displays all or part of the second screen data, thereby locally communicating with the first terminal device and the second terminal The contents displayed on the three screens of the device are consistent. They are all based on the content displayed by the first terminal device and transmitted to the local and third terminal devices for display. The three screens display the same content; and in some cases, through The annotation formed by the editing operation input by the input device is also synchronously sent to the second terminal device for display; by returning the control instruction input by the input device, the display content can be switched locally; and the second area screen data can be displayed by time-sharing trigger Select and sub-regionally display local screen content.

In another aspect, the fourth embodiment of the present application also provides a multi-screen interactive system. Please refer to FIG. 6, which includes a wireless screen transfer device 200, the above-mentioned multi-screen interactive device and a data receiving device 300; The device 200 is connected with the first terminal device, and is used to obtain the first screen data of the first terminal device, and is also used to establish a wireless communication connection with the multi-screen interactive device, and send the first screen data to the multi-screen interactive device ；

The data receiving device 300 is used to connect with the second terminal device, and is also used to establish a wireless communication connection with the multi-screen interactive device, and receive second screen data sent by the multi-screen interactive device;

The multi-screen interactive device is used to obtain the first screen data output by the first terminal device through the wireless communication connection with the wireless screen transfer device 200; to obtain the locally displayed second screen according to the first screen data Data; display the second screen data; send all or part of the second screen data to a second terminal device for display through a wireless communication connection with the data receiving device 100.

In one embodiment, referring to FIG. 7, the wireless screen transfer device 200 includes a TypeC receiving port 201, a wireless module 202, a first data conversion chip 203, and a microprocessor 204; the TypeC receiving port 201 and the The first data conversion chip 203 is connected, the first data conversion chip 203 is connected with the TypeC receiving port 201 and the microprocessor 204, and the microprocessor 204 is connected with the wireless module 202;

The TypeC receiving port 201 is used to receive first screen data of a first terminal device; the first screen data is media data in DP protocol format, and the media data is media content displayed on the screen of the terminal device;

The first data conversion chip 203 receives the first screen data sent by the TypeC receiving port 201, and converts the first screen data into first format data;

The microprocessor is configured to receive the first format data, and compress and encode the first format data into second format data;

The wireless module 202 is used to send the second format data to the multi-screen interactive device.

In an embodiment, the microprocessor 204 is further configured to provide a second operating system to realize the pairing management of the WiFi module. The multi-screen interactive device converts the data format of the second format data to restore the first screen data through its internal data transmission module, and also compresses and encodes the second screen data through its internal data transmission module and sends it to The data receiving device.

In an embodiment, referring to FIG. 8, the data receiving apparatus 300 includes:

The receiving routing module 301 is used to establish a wireless communication connection with the multi-screen interactive device;

The first interface 303 is used to connect with the second terminal device;

The main controller 302 is connected to the receiving routing module 301 and the first interface 302, and is used for wireless communication connection with the multi-screen interactive device, receives the second screen data sent by the multi-screen interactive device, and The second screen data is transmitted to the second terminal device through the first interface 303.

The multi-screen interactive system in the embodiment of the present application includes the multi-screen interactive device provided in any embodiment of the present application, and therefore has corresponding functions.

Claims

A screen transfer method includes:

Acquiring the first screen data output by the first terminal device through a data connection with the first terminal device;

Obtaining locally displayed second screen data according to the first screen data;

Displaying the second screen data;

Through the data connection with the second terminal device, all or part of the second screen data is sent to the second terminal device for display.
The screen transfer method according to claim 1, wherein obtaining the locally displayed second screen data according to the first screen data comprises:

Acquiring the first screen data as the second screen data;

Or, acquiring an editing operation instruction input by a local input device, and generating second screen data according to the editing operation instruction and the first screen data.
The screen transfer method according to claim 2, wherein obtaining an editing operation instruction input by a local input device and generating second screen data according to the editing operation instruction and the first screen data comprises:

Obtain the annotation operation instruction input by the local touch input device, obtain the corresponding annotation data according to the annotation operation instruction, combine the annotation data with the first screen data, and generate the second screen data; or Create a label layer on the display layer of the first screen data, display the label data on the label layer, and generate the second screen data.
The screen transfer method according to claim 1, wherein acquiring the first screen data output by the first terminal device further comprises:

Acquiring a control command input by a local input device;

Transmitting the control instruction back to the first terminal device through a data connection with the first terminal device;

Receiving first screen data output by the first terminal device after switching according to the control instruction.
The screen transfer method according to claim 1, after obtaining the first screen data output by the first terminal device, further comprising:

Saving the first screen data to a local first buffer area;

After generating the second screen data according to the editing operation instruction and the first screen data, the method further includes the following steps:

The second screen data is stored in the local second buffer area.
The screen transfer method according to claim 1, wherein sending the second screen data to a second terminal device for display comprises:

Controlling the second terminal device to synchronously display the second screen data locally.
The screen transfer method according to claim 1, wherein the second screen data includes first area screen data and second area screen data;

The step of displaying the second screen data includes:

Displaying the first area screen data and the second area screen data;

The step of sending all or part of the second screen data to the second terminal device for display includes:

The first area screen data is sent to the second terminal device for display.
The screen transfer method according to claim 1, wherein the controlling a routing module adopts a time division multiplexing manner to respectively receive the first screen data from the first terminal device and send the second screen data to the second terminal device.
The screen transfer method according to claim 1, further comprising:

Obtain the first audio data output by the first terminal device through the data connection with the first terminal device; or, receive the second audio data input through the audio input device;

Through the U-segment communication connection with the second terminal device, at least one of the first audio data and the second audio data is sent to the second terminal device for playback.
The screen transfer method according to claim 1, wherein the first terminal device is a data source terminal device, and the second terminal device is a large-screen display device.
A multi-screen interactive device, including:

A data receiving module configured to obtain the first screen data output by the first terminal device through a data connection with the first terminal device;

A data generation module, configured to obtain locally displayed second screen data according to the first screen data;

A display module, configured to display the second screen data;

The data output module is configured to send all or part of the second screen data to the second terminal device for display through the data connection with the second terminal device.
A multi-screen interactive device, including a display device, a display processor, a data transmission module and a system processor;

The display device is electrically connected to the display processor, and the data transmission module is electrically connected to the system processor and the display processor, respectively;

The data transmission module is configured to establish a data connection between the multi-screen interactive device and the first terminal device, obtain the first screen data output by the first terminal device and send it to the display processor; The data connection between the multi-screen interactive device and the second terminal device, obtain the second screen data output by the display processor, and send all or part of the second screen data to the second terminal device for display;

The display processor is configured to obtain locally displayed second screen data according to the first screen data, and output the second screen data to the display device and the data transmission module;

The display device is configured to display the second screen data decoded by the display processor.
The multi-screen interactive device according to claim 12, wherein the data transmission module comprises a routing module, the routing module is connected to the system processor, and the system processor is configured to control the routing module to use time division multiplexing Receiving the first screen data from the first terminal device and sending the second screen data to the second terminal device respectively.
The multi-screen interactive device according to claim 12, wherein the data transmission module further comprises an internal screen transmission device connected to the routing module, and the internal screen transmission device is configured to obtain the second screen data and send it To the dual-mode router.
The multi-screen interactive device according to claim 12, further comprising an input device; the input device is electrically connected to the display processor; the input device is set to input annotated operation instructions, and the display processor is set to follow The annotation operation instruction obtains the corresponding annotation data, and combines the annotation data with the first screen data to generate the second screen data after arithmetic processing; or, on the display layer of the first screen data Create a label layer, display the label data on the label layer, and generate the second screen data.
The multi-screen interactive device according to claim 15, wherein the input device is further configured to input control instructions, and the data transmission module is configured to return the control instructions to the first terminal device and receive the The first screen data output by the first terminal device after switching according to the control instruction.
The multi-screen interactive device according to claim 12, further comprising a memory, and the memory is electrically connected with the data transmission module;

The memory includes a first buffer area and a second buffer area, the first buffer area is configured to store the first screen data, and the second buffer area is configured to store the second screen data.
The multi-screen interactive device according to claim 17, further comprising an audio input device, the data transmission device further comprises a microphone DSP chip and a U-segment signal transmission module, the microphone DSP chip and the U-segment signal transmission module are electrically connected, so The microphone DSP chip is electrically connected with the audio input device.
A multi-screen interactive system, comprising a wireless screen transfer device, the multi-screen interactive device according to any one of claims 13 to 18, and a data receiving device; the wireless screen transfer device is connected to a first terminal device and is set to obtain The first screen data of the first terminal device is further configured to establish a wireless communication connection with the multi-screen interactive device, and send the first screen data to the multi-screen interactive device;

The data receiving device is configured to connect with the second terminal device, and is also configured to establish a wireless communication connection with the multi-screen interactive device, and receive second screen data sent by the multi-screen interactive device;

The multi-screen interactive device is configured to obtain first screen data output by the first terminal device through a wireless communication connection with the wireless screen transfer device; obtain locally displayed second screen data according to the first screen data ; Display the second screen data; send all or part of the second screen data to a second terminal device for display through a wireless communication connection with a data receiving device.
The multi-screen interactive system according to claim 19, wherein the wireless screen transfer device comprises a TypeC receiving port, a wireless module, a first data conversion chip, and a microprocessor; the TypeC receiving port and the first data The conversion chip is connected, the first data conversion chip is connected with the TypeC receiving port and a microprocessor, and the microprocessor is connected with the wireless module;

The TypeC receiving port is set to receive the first screen data of the first terminal device; the first screen data is media data in the DP protocol format, and the media data is the media content displayed on the screen of the first terminal device;

The first data conversion chip and the microprocessor are configured to receive the first screen data sent by the TypeC receiving port, and perform data format conversion on the first screen data;

The wireless module is configured to send the first screen data converted from the data format to the multi-screen interactive device.
The multi-screen interactive system according to claim 19, wherein the data receiving device comprises:

A receiving routing module, configured to establish a wireless communication connection with the multi-screen interactive device;

The first interface is set to connect with the second terminal device;

The main controller is connected to the routing module and the first interface, is configured as a wireless communication connection with the multi-screen interactive device, receives the second screen data sent by the multi-screen interactive device, and connects the first The second screen data is transmitted to the second terminal device through the first interface.