CN101697110B - Method and system for controlling interaction of synchronous and heterogeneous display terminals - Google Patents
Method and system for controlling interaction of synchronous and heterogeneous display terminals Download PDFInfo
- Publication number
- CN101697110B CN101697110B CN200910154093.2A CN200910154093A CN101697110B CN 101697110 B CN101697110 B CN 101697110B CN 200910154093 A CN200910154093 A CN 200910154093A CN 101697110 B CN101697110 B CN 101697110B
- Authority
- CN
- China
- Prior art keywords
- display module
- module
- working procedure
- display
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for controlling the interaction of synchronous and heterogeneous display terminals, which comprises an editing step and a play step. Specifically, the editing step comprises the following sub-steps: setting the running mode of each display module running program to be a master control mode or a peer-to-peer mode by a control box; clicking a display module icon to be edited in the control box and editing elements and realized functions of each display module running program; constructing interaction relationships among the elements of each display module running program; and uniformly describing the edited elements of each display module running program and the interaction relationships among the elements of each display module running program through a master control display module description document or independently describing the edited elements of each display module running program and the interaction relationships among the elements of each display module running program through each peer-to-peer display module description document, and storing the description documents into a server database module; while the play step comprises that: the control box acquires and resolves the description documents and communicates with each display module; and each display module synchronously displays the elements of each pre-constructed display module running program so as to realize a function of interaction control.
Description
Technical field
The present invention relates to network transmission technology, particularly relate to a kind of interaction of synchronous and heterogeneous display terminals control method and system.
Background technology
The development of Web and browser technology, make people can not be subject to the restriction of terminal device, the equipment having browser function by any one visits internet, by internet obtaining information, carries out commercial propaganda, is engaged in the various activity such as long-distance education and amusement.
Although, current web page program can support that each terminal is conducted interviews by various browser, namely user can pass through the access Web page such as PC, PDA, embedded device, but, the Web page of each display terminal access has consistance simultaneously, and the same time, same Web page accessed by different display terminal, the Web page of seeing each other is identical, and the function being presented to each display terminal is also completely the same.Especially, the application program based on browser that each display terminal loads isolates each other, does not realize the functions such as cooperation interaction control.
In recent years, the synergetic office work product occurred on the market, to a certain extent, is provided with certain associated treatment function, and multiple terminal user can pass through Web page program, synergetic office work, jointly completes works.Such as, several artist or Artist's plan complete a work of fine arts together, after consulting respective action to each other, cooperative drawing software can be passed through, carry out works drafting, although everyone only draws that part of oneself, what show is the overall picture of whole works, everyone can both see the progress of whole works, and other people progress.This synergetic office work product, improves the work efficiency of people, and the works that the many people of needs are completed together by the restriction of regional space, can not be subject to the restriction of platform device.But, current synergetic office work product, the user of each display terminal, is also merely able to control the part of oneself process, inherently, synergetic office work product is a kind of distributed computing model, and a large task, is divided into multiple subtask, each subtask is at an independently terminal operating, relatively independent between each subtask, the result that all subtasks execute is combined, then achieve the task that this is large.As can be seen here, synergetic office work product on the market, at program run duration, each terminal remains relatively independent, can carry out information transmission at most each other, but can not carry out interactive controlling.
In fact, along with the development of the display technology such as embedded device and LED, various display terminal emerges in an endless stream, the issue of information and the displaying of product were no longer as in the past, be confined to a certain or a certain class display terminal, but require to issue to the display terminal of variant kind, meanwhile, also requiring can interactive controlling between each display terminal. simultaneouslySuch as, some large exhibitions, each manufacturer is when oneself product of displaying, can issue by display terminals such as PC, PDA, LED display simultaneously, but the audience of each display terminal or audient user are but completely different, therefore, can run different product introduction interfaces for different display terminals, each manufacturer can be undertaken alternately, can representing the product of oneself better by a certain display terminal and other each display terminals simultaneously.
But, above-mentioned across different display terminal, and the technology of interactive controlling can be carried out, to have in essence different from synergetic office work product on the market, and not synergetic office work technology can solve, therefore, need a kind of new technical method, to solve the interactive controlling problem of synchronous and heterogeneous display terminals.
Summary of the invention
The problem that the embodiment of the present invention will solve is to provide the method and system that a kind of interaction of synchronous and heterogeneous display terminals controls, and to realize same application program, at different display terminals, shows different interfaces and represents different functions at each display terminal; Meanwhile, the user of each display terminal can pass through mouse or the mode such as keyboard or touch, and application programs object operates, and then realizes the interactive controlling between different display terminal.
To achieve these goals, The embodiment provides the method that structure interaction of synchronous and heterogeneous display terminals controls, comprise the following steps:
Edit step:
The operational mode of synchronous and heterogeneous display module is set by control box;
In control box, click display module icon to be edited by mouse or touch, edit the described element of display module working procedure and the function of realization;
Interactive relation between the element constructing each display module working procedure;
By the interactive relation between the element of each display module working procedure of editor and the element of each display module working procedure, carry out Unify legislation by description document, and be saved to server database module;
Play step:
Control box communicates with server database module, obtains and mathematics expression file;
Control box, according to the description document of resolving, communicates with each display module;
Each display module synchronously presents the element of each display module working procedure constructed in advance, and the interactive relation between the element simultaneously representing each display module working procedure, realizes function of interaction control.
Beneficial effect of the present invention is:
(1) by method provided by the invention, user can application programs issue at different display terminals relatively easily;
(2) user by control box provided by the invention, can also be clicked by mouse, the interactive relationship between the element object constructing different display module working procedure;
(3) by configuration mode, making user without the need to directly writing code, the editor to different display module application program, structure can be realized and apply accordingly.
Accompanying drawing explanation
Fig. 1 is the system architecture diagram of interaction of synchronous and heterogeneous display terminals control method of the present invention;
Fig. 2 is the structural drawing of interaction of synchronous and heterogeneous display terminals control method under master control operational mode;
Fig. 3 is the process flow diagram of interaction of synchronous and heterogeneous display terminals control method under master control operational mode;
Fig. 4 is the structural drawing of interaction of synchronous and heterogeneous display terminals control method under reciprocity operational mode;
Fig. 5 is interaction of synchronous and heterogeneous display terminals control method process flow diagram under reciprocity operational mode;
Fig. 6 is the communication process figure between the display module working procedure element object of control box and establishment in the present invention;
Fig. 7 is the interactive schematic diagram of main control module and display module working procedure element object in the inventive method;
Fig. 8 is the flow process creating display module working procedure element object in the inventive method;
Fig. 9 is that master control display module description document of the present invention generates and preserves procedure chart;
Figure 10 is the Organization Chart by control box inediting display module working procedure in the inventive method;
Figure 11 is the Organization Chart playing many display modules working procedure in the inventive method.
Embodiment
The preferred embodiments of the present invention provide a kind of interaction of synchronous and heterogeneous display terminals control method and system.The method is mainly by being embedded into the ActiveX technology in browser, create control box, utilize the related control in control box, user only needs to be clicked by mouse, the mode such as to pull, just can facilitate, fast, the different element of display module working procedure of structure of What You See Is What You Get and the function of realization, namely, visual each display module icon is clicked in control box, the runnable interface of editing application program at each display module and the function of execution, the control in control box can also be utilized simultaneously, construct the interactive relation between each display module working procedure, realize the interaction between different display module.Each display module working procedure in the preferred embodiment of the present invention, refer to a kind of application program based on browser, this application program synchronously can be carried out display at multiple isomery display module and be run, the function of the interface that each display module runs and realization is different, and can carry out interactive controlling between the program of each display module operation.But in practice, the program that each display module runs can be the program based on browser, also can be the program supporting multimedia player (Real, MediaPlayer, Flash, Player, QuickTime etc.).Realizing effect is, suppose that display module A plays video, this video can respond to the event or the event that pre-sets of execution that user triggers, after this event is excited, its function performed is for open a URL at display module B, then display module B receives the event that display module A excites, and then performs corresponding function, opens this URL.Equally, user can click certain object in display module A, controls attribute or the action of certain object in display module B.
Disclose a kind of method constructing interaction of synchronous and heterogeneous display terminals and control in the embodiment of the present invention, the enforcement of the method is divided into edit step and plays step.Namely edit step is that user edits the program that each display module runs, the element object of the program of structure, running; Playing step, is namely that user plays at each display module edited application program, and in the process play, each display module shows the application object that user constructs in advance, and the interactive controlling relation between application object.
Display module in the present invention can be isomorphism, also can be isomery.In editing process, the operational mode of synchronous and heterogeneous display module is set by control box, wherein synchronous and heterogeneous display module refers to the dissimilar multiple display modules synchronously presenting identical or different program, and its operational mode refers to master control operational mode or reciprocity operational mode.Under master control operational mode, communicate each other for realizing between each display module, then need to register at main control module, registered display module just obtains unique registration code, and adds in control box with visual form of icons automatic powder adding.Different types of display module, the icon style shown in control box is different.Such as, PC display, then show computer screen icon; LED display or touch-screen then show the screen-icon of dot pattern; PDA, mobile phone etc. then show mobile phone icon.Under ad-hoc mode, each display module is then without the need to registering at main control module.
User can pass through mouse or the mode such as keyboard or touch, clicks display module icon to be edited in control box, the element of editor's display module working procedure and the function of realization, the interactive relation between the element constructing each display module working procedure.By the interactive relation between the element of each display module working procedure of editor and the element of each display module working procedure, carry out Unify legislation by description document, and be saved to server database module.Wherein, main control module is the control center under master control operational mode, is responsible for the intercommunication coordinating each display module, in this mode, need a main control module and multiple display module, in particular cases, also can adopt multiple main control module and multiple display module.
In play mode, control box communicates with server database module, obtains and mathematics expression file; Control box, according to the description document of resolving, communicates with each display module;
Each display module synchronously presents the element of each display module working procedure constructed in advance, and the interactive relation between the element simultaneously representing each display module working procedure, realizes function of interaction control.
Fig. 1 is the system architecture diagram of a kind of interaction of synchronous and heterogeneous display terminals control method of the present invention, and system of the present invention comprises as lower part:
101 server database module, for receiving the description document that 102 control box modules send, the request that response browser or multimedia player send, and return asked description document to browser or multimedia player; Wherein description document comprises master control display module description document and/or reciprocity display module description document, is text, script language files and expansion script language files; Script language files comprises Actionscript, Flex, Javascript, Microsoft F#, Microsoft Powershell, Perl, PHP, Python, Ruby, VB Script; Expansion script comprises XML, SMIL.In actual design process, the language of design can be different, but the principle of design and to act on essence identical, all within this patent protection domain.
102 control box modules are control centers of system, embed in a browser, include but not limited to 103 basic function module, 104 main control modules; In the process that master control display module description document and/or reciprocity display module description document are transmitted between control box 102 and server database module 101, in order to data security, usually the mode of encrypted transmission can be adopted, cryptographic algorithm can be used but not limited to following kind: MD5/SHA1, DSA, DESede/DES, Diffie-Hellman.Same in 102 control box and basic function module 103, when communicating between main control module 104, also cipher mode can be adopted to communicate, the mode of communication comprises control box and calls main control module interface function, basic function module interface function, and control box is by 105 protocol engines, 106 protocol interface layer, to display module 107, 108, 109, 110 (such as, JavaScript program) send the relevant information of each display module working procedure object factory file based on XML agreement or other ones extend agreement or custom protocol specification, for controlling the establishment of each display module working procedure object in each display module and generation.The message that the display module working procedure element object that same control box can respond the establishment of each display module returns.
102 control box in the present invention are Flash control or Java control or JavaScript control or VBScript control or ActiveX control or the built-in control module of browser, for controlling tectonic manifestation module working procedure element object; Have dragging property, namely user can pass through mouse drag control box, is positioned over the appropriate location in browser; User can also select the members of control box or control box as required simultaneously, such as, configuration (config) window of display module working procedure element object, display module working procedure element object tree structure window, above-mentioned window is all visible or hide, and therefore it has observability and hiding.
In whole system framework, the mode of operation of display module working procedure can be divided into master control operational mode and reciprocity operational mode; Under master control operational mode, each display module needs to register in main control module, after registration, each display module obtains unique registration code, main control module is communicated with each display module by 105 protocol engines, 106 protocol interface layer, sending controling instruction, coordinates the interactive relation between each display module working procedure.Under reciprocity operational mode, each display module does not need to register at main control module, and each display module connects voluntarily, form peer-to-peer network, display module does not have centralized-control center, reciprocity each other between each display module, just can show corresponding icon in control box after successful connection.
102 control box generally include partly or entirely following:
Interpolation/the delete button of the element object of A, display module working procedure or menu;
B, save button or menu, previous action button or menu, next step action button or menu;
The basic setup information of the basic setup information of C, control box and the element object of display module working procedure.
103 is the basic function module in 102 control box, for editing the basic function operation of the element object of display module working procedure, wherein basic function includes but not limited to: the operation etc. of the element object of deleting the display module working procedure created, the operation cancelling back, recovery back;
Then user by clicking the control in basic function module, as first clicked the control object that user has created, can click the deletion control in basic function module, deletes the element object of the display module working procedure created; Control is cancelled, for cancelling previous operation in basic function module; Recovery control in basic function module, for the operation once cancelled before recovering; Initial parameter in basic function module arranges control, for arranging the initial parameter information of the element object of display module working procedure; Preservation control in basic function module, for preserving etc. current configuration information.
104 main control modules, are communicated with each display module by 105 protocol engines, 106 protocol interface layer, issuing control instruction;
Under master control operational mode, a main control module is adopted in embodiments of the invention, by all display modules of this master control module controls, in specific implementation, main control module also can adopt multiple, and namely the multiple display module of multiple master control module controls, can intercom between main control module mutually, also can intercom mutually between main control module with display module, number and the classification of main control module and display module can be determined according to actual needs.
105 protocol engines, encapsulate in the embodiment of the present invention related protocol required for communicating between control box with display module, and the agreement in protocol engine can carry out increasing and deleting as required.
106 protocol interface layer, communicate to connect between control box and each display module module for making, and in the system of the present invention, the corresponding control in control box and the communication between main control module and display module are also realized by this protocol interface layer.
107 ~ 110 display modules, for the operation of simultaneous display each display module working procedure at each display module;
User by selecting the control in control box, can click the icon of corresponding display module, the element of editor's display module working procedure.Such as, user selects the picture control in control box, then in corresponding display module, builds little webpage, then is pulled by mouse, in the webpage built, create an object picture, also can be this picture and adds link information.Display module in the present invention can be isomorphism, also can be isomery, and namely each display module can be one species, such as all using PC display as display terminal; Each display module also can be different types of, and such as, some display modules are PC displays, have plenty of PDA, also have plenty of touch-screen or LED display etc.
In the embodiment of the present invention, the environment of master control operational mode is: a main control module and multiple display module, and wherein main control module can integrate with a display module, also can independently exist.It is fast that main control module controls one or more display mould by operating system; Operating system includes but not limited to VMC, Linux, XWindow etc.; Each display module working procedure, by main control module sending controling instruction, coordinates the operation between each display module working procedure and interactive controlling.The environment of equity operational mode is, multiple display module forms peer-to-peer network, connect voluntarily between each display module, in this mode, main control module in control box and between display module is not related, carry out mutual cooperation control by control box between display module, but not send instruction as master control operational mode by main control module.
Fig. 2 is the structural drawing of interaction of synchronous and heterogeneous display terminals control method under master control operational mode.
202, the main control module of 203,204 display modules respectively in control box is registered, and registered display module obtains unique registration code, and adds in control box with visual form of icons automatic powder adding; Choose in control box and activate icon A or the icon B or icon C of registered display module, then can edit the element of corresponding display module working procedure; And then the interactive relation between the element constructing each display module working procedure; Then by the interactive relation between the element of each display module working procedure of editor and the element of each display module working procedure, carry out Unify legislation by master control display module description document, and be saved to server database module.Main control module is undertaken alternately, realizing the control to each display module by protocol engine and protocol interface and each display module.Display module can be an equipment separately with display screen, or multiple display planes of a host computer control.
Wherein master control display module description document adopts extend markup language or script; Master control display module description document adopts the mode of objectification to describe the element of display module working procedure, and the element of each display module working procedure is a standalone object; Master control display module description document, in transmitting procedure, is encrypted transmission or not encrypted transmission.
The present invention, for the application program based on browser, illustrates under constructing master control operational mode, the process of each display module working procedure.
User's open any browser, loads 102 control box modules, includes but not limited in control box module in browser: basic function module, main control module, object configuration module; In actual applications, user as required, can add corresponding module in control box.Control box of the present invention supports plug-in type Function Extension; namely the functional module that oneself is developed can be placed in control box of the present invention by user easily; therefore; several functional module in the control box mentioned in the present invention and user are embedded into the functional module in control box of the present invention, all at the row of the present invention's protection.
User, before each display module working procedure element object of structure, need determine kind and the number of display module in advance, can certainly add in the later stage.After determining all display modules, need each display module to register in main control module, the display module after registration just can add in control box by automatic powder adding, and each display module has unique registration code.
In actual applications, user is by activating display module icon registered in control box, select the corresponding control in control box, by the method that mouse pulls, load and tectonic manifestation module working procedure element object, after creating display module working procedure element object, user can by activating object configuration module or allocation window, essential information configuration and event information configuration are carried out to the object created, and the event control information configuration between object.By the relation between the basic function module tectonic manifestation module working procedure element object in control box.Relation between each display module working procedure element object of structure and each display module working procedure element object is generated master control display module description document, and master control display module description document is saved in server database module.
The present invention in the process of tectonic manifestation module working procedure element object, employing be a kind of object structure, be namely encapsulated in object structure by control box display module working procedure element object, comprise:
(1) element object of tectonic manifestation module working procedure;
(2) function corresponding after the event that the element object of editing display module working procedure triggers and event trigger;
(3) calling function respective function performs the function of described correspondence;
Wherein object structure comprises event that the basic operation of object and base attribute, object trigger, function corresponding to objects trigger event.
Produce interactive relation by calling respective function between the element object of the program that display module runs, and after function is finished, new event can also be triggered further, thus perform new function;
Interactive relation between the element object of display module working procedure of structure and the element object of display module working procedure is generated corresponding master control display module description document;
Master control display module description document is saved in server database module;
When the program that each display module runs is play, then by control box and server database communication, obtain and resolve master control display module description document, create the element object of display module working procedure and monitor event, if event triggers, then perform the function corresponding to this event.
Object structure comprises event, the object functionality that the basic operation of object and base attribute, object trigger; Wherein function is realized by function in a program; Object structure realizes in object class, object (Object), subject-induced event (Event), object functionality function (Function) trinity.When specific design, in a concrete object class, often comprise object properties, event, object functionality that object is corresponding; The wherein corresponding event of object, it is the outside or inside event can experienced for object self, object functionality then may be used for other object operated outside this object, a power function also can operate several object simultaneously, such as, a object in display module A has been triggered click event, and the b object that can trigger in display module B moves to N position from M position, run duration is t, and mode of motion is default.In the Functional Design of utility function, except using object class intrinsic function, can also external function be used, method of calling and object intrinsic function similar, the just resource difference that uses and design.
Produce interactive relation by calling respective function between display module working procedure element object, and after function is finished, new event can also be triggered further, thus perform new function; Interactive relation between the display module working procedure element object of structure and display module working procedure element object is generated corresponding master control display module description document; And master control display module description document is saved in server database.
Master control display module description document is for describing main control module, each display module working procedure element object, and the interactive relation between each display module working procedure element object, carries out Unify legislation by an XML or other descriptive languages.Comprise the set of each display module working procedure element object < attribute-event-function >, for describing the function after the existing attribute of this display module working procedure element object, the event of triggering and trigger event or application.
Below with an instantiation, further describe the method and system that interaction of synchronous and heterogeneous display terminals of the present invention controls:
Suppose, in a certain exhibition, a certain auto vendor is for showing its up-to-date product by PC, PDA and LED display.The display screen of PDA due to size limited, be applicable to one-piece construction and some essential informations of showing automobile, LED display size is larger, be applicable to showing the inner structure of this automobile and the subtlety of associated components, PC screen, between the two aforementioned, is applicable to showing the general structure of automobile and finer and smoother picture.If adopt existing display technique and means, then can be the application program that a products propaganda is done by this automobile vendor, but when issuing, the Product Interface that user is seen by PC or PDA or LED display is duplicate, and namely same application program picture is play at different display terminals.The effect that this kind is thrown in is obviously poor.But, adopt method and system provided by the invention, just can realize following effect: the car show picture of (1) PC, PDA and LED display display is different; (2) user clicks certain position of automobile on PDA, then LED display or PC can show the detail at this position; (3) each display terminal interactive controlling, the operational process that the displaying one that combines is complicated.For realizing three such effects, user can realize by method and system provided by the invention, and the process of realization is as follows:
Suppose that main control module in the present embodiment and PC display module integrate, when specific implementation, main control module also can independently be gone out.PC both comprised main control module, also comprised a display module; In addition two other display module is also had, PDA and LED display.
User starts browser by main control module, loads control box of the present invention in browser;
PC display module, PDA display module and LED display module are registered according to the classification of each display module respectively in main control module, after registration, main control module is that each display module distributes unique registration code, registered each display module will automatically graphically be added in the display editor module of control box simultaneously, and user can check registered display module by the form of the form of chart or tree structure.
User activates the display module icon in control box, click corresponding control, such as user clicks PDA icon, then constructs PDA display module working procedure element object, as the overall picture showing automobile by PDA, be equipped with concise and to the point text description and company-information simultaneously; User clicks LED display module icon, and structure LED display module working procedure element object, as shown the inner structure picture of automobile by LED; User clicks PC icon, and structure PC display module working procedure element object, as shown the fine and smooth picture at certain position of automobile by PC.These pictures can be as required, show with the form of the form of picture or video, it is worth mentioning that, no matter picture or video or text or other form, be all be added in the Web page application program that current browser opens with the form of object by control box in the present invention, final when showing, each display terminal is also load in the mode of browser application, but the content of displaying itself can be given prominence to when showing, and the main information of browser is hidden.
After having constructed each display module working procedure element object, user is by the interactive relation between control box editor each display module working procedure element object.
Such as, show in the process of Integral automobile picture at PDA display module, user can click certain part of automobile, after user clicks certain position of automobile, as clicked the airbag part of automobile, the then picture of LED display meeting terminal current presentation, the current event excited of user on response PDA, then show the overall looks of air bag; As a same reason, user also can touch LED display by the mode touched, and excites corresponding event, makes PDA or PC display screen show corresponding picture, perform a certain function, as opened the website of this manufacturer or linking other information etc.
Interactive relation between display module working procedure and display module working procedure by call and the interface function that carries on an agreement realizes, or adopts the extension of network protocol realization based on XML.
The mode calling and perform function comprises:
A. main control module calls and the current one or more display module interface function of execution, change attribute or the behavior of current one or more display module working procedure element object;
B. other one or more display module interface functions are called and performed to current one or more display module working procedure element object, changes attribute or the behavior of other one or more display module working procedure element object.
The attribute wherein changing display module working procedure element object comprises the steps:
Activate the display module working procedure element object of response events;
Activate object configuration module by control box, the function performed when configuring event and the event response of described display module working procedure element object response, select or objective for implementation when described function performs is set; Wherein objective for implementation refers to display module working procedure element object; When configuration feature performs, the attribute information of objective for implementation.
The behavior of change display module working procedure element object comprises the steps:
Activate the display module working procedure element object of response events;
Object configuration module is activated, the function performed when event, event response that configuration display module working procedure element object responds by control box; Select or objective for implementation when function performs is set; Objective for implementation refers to display module working procedure element object; When configuration feature performs, the behavioural information of objective for implementation; The behavioural information of objective for implementation, refers to the multidate information of objective for implementation, performs some or multiple action.
After user completes display module working procedure element object information configuration, each display module working procedure element object that can construct generates master control display module description document, and this description document is complete describes the attribute information of each display module working procedure element object, event information and function information; And this synchronous and heterogeneous display terminals description document is sent to server database end.
Construct display module working procedure element object, and the interactive relation between each display module working procedure element object, and after the master control display module description document of generation is sent to server database end, when performing each display module working procedure, just the pattern can play is run, namely control box is connected with server-side database, obtain master control display module description document, and this description document is resolved, according to the content of resolving, run each display module application program, corresponding application object is constructed at each display module, monitor and respond the event that each display module application object excites, thus perform corresponding function of interaction control.
Fig. 3 is the process flow diagram of interaction of synchronous and heterogeneous display terminals control method under master control operational mode.
301 register at main control module for display module, after registration, can communicate between each display module, the mode of registration can have a variety of, as by logon server website, website is registered, also can be registered by the mode sending note.That is, under the framework of synchronous and heterogeneous display terminals switching control method of the present invention, realize different display modules and run the program of being mutually related simultaneously, then each display module can select corresponding logon mode according to respective feature.As mobile phone or PDA display device, can be registered by the mode sending note to server; LED information display screen can be registered by wired or wireless communication mode; PC can be registered by the mode of internet Website login.
After each display module is registered, just can edit each display module working procedure element object by 302, include but not limited in display module, add text element, picture element, video elementary etc., after having constructed corresponding element object, can edit the attribute information of each element object, event information and function information.And then can construct the interactive relation between different display module working procedure element object by 303, thus make each display module working procedure in the process performed, interaction response can be carried out each other.Then 304 are passed through by each display module working procedure element object, and the interactive relation between each display module working procedure element object, carry out record description by an XML description document, generate master control display module description document.Finally, by 305, the master control display module description document of generation is sent to server database.
Fig. 4 is the structural drawing of interaction of synchronous and heterogeneous display terminals control method under reciprocity operational mode.
In figure, 401,402,403,404 is all display module, display module A, display module B, display module C, display module D can represent different display devices respectively, if display module A is PC, display module B is mobile phone or hand-held PDA, and display module C is mobile unit, display module D is LED information display screen.Each display module also can be the display device of one species, as being all PC or being all mobile phone.In a particular application, each display module can also be the different display interfaces on uniform machinery, and as on same machine, display screen is divided into four parts, every part represents a display module.Under reciprocity operational mode, display module A, display module B, carry out between display module C and display module D interconnected, form the network of equity, and then be connected with control box, after connecting, each display module just can show corresponding display module icon in control box.User, in the process of editor, choosing in control box and activating the icon of the display module of described successful connection, edits the element of corresponding display module working procedure; Interactive relation between the element constructing each display module working procedure; By editor each display module working procedure element and and the element of other display module working procedures between interactive relation, be described by reciprocity display module description document, and each reciprocity display module description document is saved to server database module.
Fig. 5 is interaction of synchronous and heterogeneous display terminals control method process flow diagram under reciprocity operational mode.
501 is carry out interconnected between each display module, forms a peer-to-peer network.The interconnected of display module can be interconnected in early stage, also can add in the later stage.Such as, user is in the process of editor, initial stage only has 3 display modules to connect, but in application afterwards, there is again other display module to add wherein, then still can carry out interconnected with the module of 3 above, namely, adding or exiting of display module, can not affect the operation of whole system.
502 is edit reciprocity interconnected each display module, includes but not limited to edit the text message, pictorial information, video information etc. in each display module working procedure element, configures the attribute information of each display module working procedure element object.
After having constructed in 502 each display module working procedure element object and corresponding essential information, just by the interactive relation between 503 tectonic manifestation module working procedure element object and other display module working procedure element object, as clicked certain picture in display module A, then can open some links in display module B; Or in display module C, click some links, then in display module D, carry out video playback.Interactive relation between each display module working procedure element object realizes by protocol interface function call.
504 is that each display module working procedure element object and the interactive relation between this display module working procedure element object and other display module working procedure element object are generated XML description document, i.e. reciprocity display module description document.If there is N number of display module, then generate N number of reciprocity display module description document the most at last.Equity display module description document adopts extend markup language or script; Equity display module description document adopts the mode of objectification to describe the element of display module working procedure, and the element of each display module working procedure is a standalone object; Equity display module description document, in transmitting procedure, is encrypted transmission or not encrypted transmission.
505 is that the N number of reciprocity display module description document generated is saved to server database.
Fig. 6 is the communication process figure between the display module working procedure element object of control box and establishment in the present invention;
The present invention 102 control box is by 601 agreements, and the protocol engine interface in 602 communicates with the object of establishment; Wherein protocol engine interface comprises Flash protocol engine interface and JavaScript protocol engine interface, the former is for realizing the communication between the video inner element play in control box and multimedia player, and the latter is for realizing the communication between control box and web page element.That is, the display module application program run is if based on multimedia player, then need to be communicated by Flash protocol engine interface; If the application program that display module runs based on browser, then needs to be communicated by JavaScript protocol engine interface.
603 is the objects created by the control in control box, by selecting the object that will create in object interface during concrete operations, and then realizes;
After having created object 603, the attribute of the properties interface gathered by control box to the object created is arranged;
604 event informations that can respond for the object created;
605 some function informations that can realize for the object created;
The present invention, to edit display module A working procedure element object and display module B working procedure element object carries out interactive controlling, further illustrates the detailed process of the embodiment of the present invention.
Carry out control by control box of the present invention to display module A working procedure element object and display module B working procedure element object to comprise the following steps:
(1) by the control inerface of ActiveX or AJAX technological development control box;
(2) user selects the control in control box by this control inerface as required, utilizes the current control chosen, operates display module A working procedure element object and display module B working procedure element object;
(3) in editor's display module A process, selected control is communicated with display module A working procedure element object by protocol engine and protocol interface function, by protocol engine interface editor control display module B working procedure element object;
(4) in editor's display module B process, selected control is communicated with display module B application object by protocol engine interface and interface function, by protocol engine interface editor control display module A application object;
(5) according to the operation of (3), (4), determine the application object for interpolation and/or adjustment in display module A and display module B, the base attribute information of current operation object is set;
(6) for current operation object adds event, and the event information of current operation object response is set;
(7) repeat said process, realize carrying out editor control to the application object of display module A and display module B.
Fig. 7 is the interactive schematic diagram of main control module and display module working procedure element object in the inventive method;
Control box of the present invention is by protocol engine editor control main control module and display module working procedure element object;
Control box is responsible for coordinating the communication between main control module interface function and display module interface function simultaneously, by communication between the two, realizes the interaction between main control module and display module working procedure element object.Such as, user is by a certain text object in control box editor tectonic manifestation module working procedure, after having constructed the base attribute of text object, user can be text object and adds event response information, for controlling a certain object picture in another display module working procedure.Object picture in display module textual object and another display module carries out interactive process and realizes in the following way:
The mouse-click event of the text object response user in display module, after this event occurs, main control module coordinates the interactive controlling instruction in event response process, and event information is passed to another display module interface function by interface function by the text object of display module;
Another display module interface function obtains the object information of this event effect after receiving the event information transmitted, and by main control module to display module working procedure element object, as object picture carries out editor control.
Fig. 8 is the flow process creating display module working procedure element object in the inventive method, control box in one embodiment of the invention is created by Flash control and forms, and user is using the operating process of control box establishment display module working procedure element object as follows:
801 click the respective icon in Flash in control box for user, such as, under the click master control operational mode icon of display module, and then choose corresponding picture icon, the web page files that user utilizes browser to open in current display module, the mode pulled by mouse creates object picture;
802 for creating in Object Process, and invocation protocol engine interface function, creates new object to realize being pulled by mouse in display module;
803 for after user created object, and protocol engine interface sends establishment information to Flash, the information such as size, position of the object that notice Flash creates;
The 804 establishment information sent according to the protocol engine interface received for Flash, create object and association attributes thereof at Flash record.
Fig. 9 is that master control display module description document of the present invention generates and preserves procedure chart;
After user creates the interactive relation between display module working procedure element object and each display module working procedure element object by control box of the present invention, just the master control display module description document for describing the interactive relation between display module working procedure can be generated, then by the preservation operation in control box, the master control display module description document generated is preserved;
The embodiment of the present invention, adopt XML to be described the display module working procedure element object created, then XML master control display module description document is saved to database, specific operation process is as follows:
901 is Flash control box preservation operation, after namely user has created display module working procedure element object, clicks the save button in Flash control box, just can generate XML master control display module description document;
Generate the process of XML master control display module description document, be exactly according to XML syntax format, to corresponding field predefine, then by 902 protocol engine interfaces (Flash protocol engine interface or JavaScript protocol engine interface), communicate with between main control module, display module, by the respective field that XML describes, send to server database module by webpage;
903 is web page program, namely protocol engine interface (Flash protocol engine interface or JavaScript protocol engine interface) communicates with server database module by calling PHP program in an embodiment, as Asp, Jsp or Php etc., 903 receive the 902 XML field informations sent, then 903 the XML field information received is sent to server database module, and XML field information is saved to server database module, if preserve successfully, then server database module sends and preserves successful information to 903, 903 receive server database end send preservation successful information after, send it to protocol engine interface 902 module, by protocol engine interface check PHP program, 902 receive after server preserves successful message, just information 905 can be sent, inform that user's current sync heterogeneous display terminals description document is preserved successfully at server database.
The generative process of equity display module description document and the generative process of master control display module description document basically identical, the description document generated under difference is reciprocity operational mode is relevant with the quantity of display module, each display module can generate a reciprocity display module description document, if there is each display module of N, generate each reciprocity display module description document of N the most at last.
Figure 10 is the Organization Chart by control box inediting display module working procedure in the inventive method, in system architecture of the present invention, control box can directly be integrated in existing browser, also 101 server ends can be placed on, when user starts browser, then 102 control box are got from 101 server ends;
After browser end successfully loads control box, user just can click display module icon wherein, and then selects corresponding control, tectonic manifestation module working procedure element object;
Main control module in control box is coordinated, by display module interface function tectonic manifestation module working procedure element object by protocol engine and protocol interface and each display module.After the above-mentioned object of construction complete, generate master control display module description document or reciprocity display module description document, eventually through 102 control box, master control display module description document or reciprocity display module description document are saved to server database.
Figure 11 is the Organization Chart playing many display modules working procedure in the inventive method, namely user has constructed each display module working procedure element object, and after the master control display module description document of generation or reciprocity display module description document are stored to server database, when user needs to run the plurality of display module working procedure at multiple display terminal, play by starting browser, specific implementation process is:
Embed in user browser or load 1101 synchronous and heterogeneous display terminals application program playing modules, in the present invention, synchronous and heterogeneous display terminals application program playing module is Flash control or Java control or JavaScript control or VBScript control or ActiveX control or the built-in control module of browser.
101 server database module, for receiving the playing request that browser module sends, and return asked master control display module description document or reciprocity display module description document to browser; Server database module is used for storing or dynamically generating master control display module description document or reciprocity display module description document simultaneously, and server database module also has the function of counting user operation behavior;
The working procedure of display module more than 1101 playing module, embed in a browser, there is observability and hiding, for communicating with server database module, send request master control display module description document or reciprocity display module description document to server database module, master control display module description document that reception server database returns or reciprocity display module description document;
The working procedure of display module more than 1102 parsing module, embed in a browser, as in script or program language Module-embedding webpage, not there is observability, be connected with many display modules working procedure playing module, for receiving the instruction that many display modules working procedure playing module sends, and resolve master control display module description document or reciprocity display module description document, coordinated by main control module and each display module, finally in the process playing many display modules working procedure, construct each display module working procedure element object, and the interactive controlling relation between described object.
The present invention is described by specific embodiment, it will be appreciated by those skilled in the art that, without departing from the present invention, can also carry out various conversion and be equal to substituting to the present invention.In addition, for particular condition or concrete condition, various amendment can be made to the present invention, and not depart from the scope of the present invention.Therefore, the present invention is not limited to disclosed specific embodiment, and should comprise the whole embodiments fallen within the scope of the claims in the present invention.
Claims (10)
1. construct the method that interaction of synchronous and heterogeneous display terminals controls, it is characterized in that, comprise the following steps: edit step:
The operational mode of synchronous and heterogeneous display module is set by control box;
In control box, click display module icon to be edited, edit the described element of display module working procedure and the function of realization; The element of described display module working procedure refers to the media information element shown in display module;
Interactive relation between the element constructing each display module working procedure;
By the interactive relation between the element of each display module working procedure of editor and the element of each display module working procedure, carry out Unify legislation by description document, and be saved to server database module;
Play step:
Control box communicates with server database module, obtains and mathematics expression file;
Control box, according to the description document of resolving, communicates with each display module;
Each display module synchronously presents the element of each display module working procedure constructed in advance, and the interactive relation between the element simultaneously representing each display module working procedure, realizes function of interaction control.
2. as claimed in claim 1 a kind of construct interaction of synchronous and heterogeneous display terminals control method, it is characterized in that:
Described synchronous and heterogeneous display module refers to the dissimilar multiple display modules synchronously presenting identical or different program;
The operational mode of described synchronous and heterogeneous display module refers to master control operational mode or reciprocity operational mode;
Described description document refers to master control display module description document or reciprocity display module description document;
Described master control display module description document refers to the description document generated under master control operational mode;
Described reciprocity display module description document refers to the description document that each display module generates under reciprocity operational mode;
Described master control operational mode refers to that each display module needs the main control module in control box to register, and then could realize between each display module intercoming mutually;
Described reciprocity operational mode refers to that each display module is registered without the need to the main control module in control box, is interconnected to constitute peer-to-peer network between each display module.
3. the method that under master control operational mode, interaction of synchronous and heterogeneous display terminals controls, is characterized in that, comprise the following steps:
Display module is registered in the main control module of control box, and registered display module obtains unique registration code, and adds in control box with visual form of icons automatic powder adding;
Choose in control box and activate the icon of described registered display module, the element of corresponding display module working procedure is edited;
Interactive relation between the element constructing each display module working procedure;
By the interactive relation between the element of each display module working procedure of editor and the element of each display module working procedure, carry out Unify legislation by master control display module description document, and be saved to server database module.
4. a kind of method that interaction of synchronous and heterogeneous display terminals controls under master control operational mode as claimed in claim 3, is characterized in that:
The environment that described each display module program is run is: a main control module and multiple display module;
Described main control module is undertaken alternately, realizing the control to each display module by protocol engine and protocol interface and each display module;
Described multiple display module is isomorphism display module or isomery display module; Described main control module is present in control box, for each display module of cooperation control;
Described display module needs after main control module is registered, and just can intercom mutually between each display module;
Described display module is an equipment separately with display screen, or multiple display planes of a host computer control;
Described control box is Flash control or Java control or JavaScript control or VBScript control or ActiveX control or the built-in control module of browser, for controlling editor's display module working procedure element object;
Described control box comprises basic function module, object configuration module, main control module;
Described control box has dragging property, and has observability and hiding is for you to choose.
5. a kind of method that interaction of synchronous and heterogeneous display terminals controls under master control operational mode as claimed in claim 3, is characterized in that:
Described master control display module description document adopts extend markup language or script;
Described master control display module description document adopts the mode of objectification to describe the element of display module working procedure, and the element of each display module working procedure is a standalone object;
Described master control display module description document, in transmitting procedure, is encrypted transmission or not encrypted transmission.
6. the method that under reciprocity operational mode, interaction of synchronous and heterogeneous display terminals controls, is characterized in that, comprise the following steps:
Each display module is interconnected to constitute peer-to-peer network;
Each display module is connected with control box, after successful connection, then adds in control box with visual form of icons automatic powder adding;
Choose in control box and activate the icon of the display module of described successful connection, the element of corresponding display module working procedure is edited;
Interactive relation between the element constructing each display module working procedure;
By editor each display module working procedure element and and the element of other display module working procedures between interactive relation, be described by reciprocity display module description document, and each reciprocity display module description document is saved to server database module.
7. a kind of method that interaction of synchronous and heterogeneous display terminals controls under reciprocity operational mode as claimed in claim 6, is characterized in that:
Described reciprocity display module description document adopts extend markup language or script;
Described reciprocity display module description document adopts the mode of objectification to describe the element of display module working procedure, and the element of each display module working procedure is a standalone object;
Described reciprocity display module description document, in transmitting procedure, is encrypted transmission or not encrypted transmission.
8. the method for interactive relation between tectonic manifestation module and display module, is characterized in that, comprise the following steps:
Display module main control module carry out registering or display module without the need to registering at main control module, but to be connected with control box;
Interactive relation between display module working procedure and display module working procedure by call and the interface function that carries on an agreement realizes, or adopts the extension of network protocol realization based on XML; Described display module is isomorphism or isomery display module;
Describedly to call and the mode of the interface function that carries on an agreement comprises:
A. the main control module in control box or control box is undertaken alternately by protocol interface function and multiple display module, changes attribute or the behavior of the element object of current one or more display module working procedure;
B. the element object of current one or more display module working procedure is by protocol interface function, changes attribute or the behavior of the element object of other one or more display module working procedures.
9. edit the system that interaction of synchronous and heterogeneous display terminals controls, it is characterized in that, comprise with lower module:
A. server database module, for receiving the master control display module description document of control box module transmission and/or reciprocity display module description document, the request that response control box sends, and return asked master control display module description document and/or reciprocity display module description document to control box; Control box calls PHP or JSP or ASP program in the application, operating database;
B. control box module is the control center of system, embeds in a browser, comprises basic function module, object configuration module, main control module, playing module;
Basic function module, for realizing the basic function operation of the element object of display module working procedure, described basic function comprises: delete create object, cancel, previous action, next step operation, the default information of object in control box;
Object configuration module, for configuring attribute information and the trigger event information of the element object of display module working procedure, and function application message corresponding to objects trigger event; Comprise the default setting of the element object configuring each display module working procedure;
Main control module, for managing each display module, to each display module sending controling instruction, coordinates synchronous operation in the element object display module of each display module working procedure;
Playing module, the master control display module description document obtained from server control box and/or reciprocity display module description document are resolved, and according to the content of resolving, play the element of the program that each display module constructs in advance at each display module;
C. display module, for display also working procedure, presents in process at the element of each display module working procedure, carries out interactive controlling between display module and display module;
D. browser module, for carrying the program of control box and/or display module operation.
10. as claimed in claim 9 a kind of edit interaction of synchronous and heterogeneous display terminals control system, it is characterized in that;
Load control box module in browser module, control box module comprises basic function module, object configuration module, main control module, playing module;
The operational mode of synchronous and heterogeneous display terminals is set in control box;
Activate the display module icon under master control operational mode or the display module icon under reciprocity operational mode, the element of described display module working procedure is edited;
By activating object configuration module, essential information configuration and event information configuration are carried out to the element object of described establishment, and the event control information configuration between element object;
Interactive controlling relation between the element object of the display module working procedure created and described object is generated master control display module description document or reciprocity display module description document, and is saved to server database module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910154093.2A CN101697110B (en) | 2009-10-26 | 2009-10-26 | Method and system for controlling interaction of synchronous and heterogeneous display terminals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910154093.2A CN101697110B (en) | 2009-10-26 | 2009-10-26 | Method and system for controlling interaction of synchronous and heterogeneous display terminals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101697110A CN101697110A (en) | 2010-04-21 |
| CN101697110B true CN101697110B (en) | 2015-06-24 |
Family
ID=42142216
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910154093.2A Active CN101697110B (en) | 2009-10-26 | 2009-10-26 | Method and system for controlling interaction of synchronous and heterogeneous display terminals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101697110B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156713A (en) * | 2011-03-11 | 2011-08-17 | 上海全景数字技术有限公司 | Multimedia playing method based on embedded equipment |
| CN103078788B (en) * | 2011-06-27 | 2015-12-09 | 北京奇虎科技有限公司 | A kind of information interacting method based on application and system |
| CN103135965B (en) * | 2011-11-23 | 2016-09-28 | 北京新媒传信科技有限公司 | A kind of user interface method and system |
| CN102855112A (en) * | 2012-08-14 | 2013-01-02 | 王斌 | Device for screen control |
| CN103092608B (en) * | 2012-12-27 | 2016-02-10 | 广州杰赛科技股份有限公司 | The generation of the client of collecting device information and operation method, server and equipment |
| US9858027B2 (en) * | 2014-10-30 | 2018-01-02 | Adobe Systems Incorporated | Multiple display rendering of digital content |
| CN104731591A (en) * | 2015-03-19 | 2015-06-24 | 天脉聚源（北京）教育科技有限公司 | Method and device for processing control in content display process |
| CN105573708A (en) * | 2016-02-24 | 2016-05-11 | 石家庄格物电子科技有限公司 | Video file editing control method and device thereof |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1259257A (en) * | 1997-05-01 | 2000-07-05 | 雷德福格有限公司 | Interactive display system |
| CN101067761A (en) * | 2007-05-24 | 2007-11-07 | 司秉玉 | Method and equipment for making interactive operation with display system |
| CN101479693A (en) * | 2006-04-20 | 2009-07-08 | 惠普开发有限公司 | Method and system for interfacing a digital device with an interactive display surface |
-
2009
- 2009-10-26 CN CN200910154093.2A patent/CN101697110B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1259257A (en) * | 1997-05-01 | 2000-07-05 | 雷德福格有限公司 | Interactive display system |
| CN101479693A (en) * | 2006-04-20 | 2009-07-08 | 惠普开发有限公司 | Method and system for interfacing a digital device with an interactive display surface |
| CN101067761A (en) * | 2007-05-24 | 2007-11-07 | 司秉玉 | Method and equipment for making interactive operation with display system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101697110A (en) | 2010-04-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101697110B (en) | Method and system for controlling interaction of synchronous and heterogeneous display terminals | |
| US9438467B1 (en) | Methods of obtaining application media packages | |
| CN101630329A (en) | Method and system for interaction of video elements and web page elements in web pages | |
| US6934697B1 (en) | Creating customized internet access client user interface | |
| CN107391134B (en) | Method and device for automatically generating and dynamically transforming universal mobile application interactive interface | |
| US20080215995A1 (en) | Model based avatars for virtual presence | |
| CN101697156B (en) | A kind of method and system of constructing chain web pages | |
| US20110167336A1 (en) | Gesture-based web site design | |
| CN106445486A (en) | Webpage construction and generation method and system | |
| CN102012906A (en) | Three-dimensional scene management platform based on SaaS architecture and editing and browsing method | |
| CN103034690A (en) | Self-customizing method of mobile terminal client application program based on web service | |
| CN106293743A (en) | A kind of mobile modeling and build Mobile solution the method realizing cross-platform issue | |
| CN113849156B (en) | Codeless intelligent development system applied to OpenHarmony operating system and application method thereof | |
| CN107391736A (en) | A kind of page display method and device | |
| CN106162353A (en) | Interface processing method, Apparatus and system | |
| CN110502228A (en) | A method of VR content creation and generation VR application program based on cloud platform | |
| CN101681471A (en) | Advertisement information management method, advertisement information management system, call receiving method, and call receiving system | |
| CN108363749B (en) | Method and apparatus for information processing | |
| CN101917573B (en) | Implementation method of Widget system and television using the system | |
| CN103870280B (en) | Webpage seamless combining processing method based on FLEX and JSP | |
| CN108319474A (en) | A kind of page info generation method, device and equipment | |
| CN114968032B (en) | Policy arrangement processing method, device, equipment, system and storage medium | |
| US8140999B2 (en) | Display process device and display process method | |
| CN104111768B (en) | Interactive window and method and system for customizing, quoting and synchronizing interactive window | |
| US20080104524A1 (en) | System and Method for Facilitating Ip Telephony Applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |