CN106851114A - A kind of photo shows, photo generating means and method, terminal - Google Patents
A kind of photo shows, photo generating means and method, terminal Download PDFInfo
- Publication number
- CN106851114A CN106851114A CN201710206286.2A CN201710206286A CN106851114A CN 106851114 A CN106851114 A CN 106851114A CN 201710206286 A CN201710206286 A CN 201710206286A CN 106851114 A CN106851114 A CN 106851114A
- Authority
- CN
- China
- Prior art keywords
- photo
- main body
- user
- sight line
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephone Function (AREA)
Abstract
Shown the invention discloses a kind of photo, photo generating means and method, terminal, wherein, the photo display device includes：First determining module, the region that the sight line for determining user is stopped on photo；Second determining module, the main body thing of the sight line dwell regions on photo for determining user；Display module, the main body thing in the region stopped for pair sight line of determination enters Mobile state and presents, wherein, the photo is that main body thing and background are recognized when shooting, and is integrated with the static information formation of the multidate information and background of main body thing.The static data of dynamic data and background area in the present invention based on main body object area, synthesize the photo for shooting and obtaining, the main body thing that meeting identifying user sight line is aimed at when user checks photo, and the main body thing aimed at user's sight line carries out dynamic-form, so as to improve the diversity of picture presentation.
Description
Technical field
The present invention relates to image processing field, more particularly to a kind of photo show, photo generating means and method, terminal.
Background technology
With continuing to develop for Internet technology, and the mobile terminal such as mobile phone is continued to develop.Increasing intelligence is eventually
End is all integrated with camera function, so that people the function such as can just be realized taking pictures by mobile phone terminal.
When current picture shooting, whole picture region is shown according to same way.For example, video is exactly whole
Individual region is all Dynamic Announce, and picture is exactly that whole region is all static state display.The realization of picture can be so caused to lose
Many flexibilities.
Regarding to the issue above, effective solution is not yet proposed at present.
The content of the invention
It is a primary object of the present invention to propose a kind of photo show, photo generating means and method, terminal, it is intended to improve
The diversity that picture is presented.
To achieve the above object, a kind of photo display device that the present invention is provided, described device includes：
First determining module, the region that the sight line for determining user is stopped on photo；
Second determining module, the main body thing of the sight line dwell regions on photo for determining user；
Display module, the main body thing in the region stopped for pair sight line for determining enters Mobile state and presents, wherein, the photo
It is that main body thing and background are recognized when shooting, and is integrated with the static information formation of the multidate information and background of main body thing.
Further, second determining module includes：
First determining unit, for it there are multiple main body things on the photo in the case of, determines that the sight line of user exists
Coordinate position in the photo；
Second determining unit, for determining one or more main body things including the coordinate position in the photo；
Generation unit, for one or more main bodys of the coordinate position will to be included in the photo for determining source
Thing, as the main body thing of the sight line of the user for determining dwell regions on photo.
Further, first determining module includes：Sensing unit, for being sensed by the front camera in terminal
The optic centre of eyes of user；
Generation unit, for the region in the optic centre preset range of the eyes of user that will be sensed, as the use
The region that the sight line at family is stopped on photo.
Additionally, to achieve the above object, the present invention also proposes a kind of photo generating means, and described device includes：
Identification module, main body object area and background area for identifying the region that is taken；
First acquisition module, for obtaining the dynamic data of the main body object area and the static number of the background area
According to；
Synthesis module, for by the static data of the dynamic data of the main body object area and the background area, synthesizing
For the photo that shooting is obtained.
Further, said apparatus also include：Second acquisition module, in the main body thing area for identifying the region that is taken
Before domain and background area, by the first camera and second camera in terminal, the image in the region that is taken described in acquisition
Data.
Further, first acquisition module includes：
First acquisition unit, for obtaining the dynamic data by main body object area by first camera；
Second acquisition unit, the static data for obtaining the background area by the second camera.
Additionally, to achieve the above object, the present invention also proposes a kind of terminal, including：Photo described in any of the above-described shows
Showing device, and/or, the photo generating means described in any of the above-described.
Additionally, to achieve the above object, the present invention also proposes a kind of photo display methods, and methods described includes：
Determine the region that the sight line of user is stopped on photo；
Determine the main body thing of sight line dwell regions on photo of user；
Pair determine sight line stop region main body thing enter Mobile state presentation, wherein, the photo be shoot when
Identification main body thing and background, and be integrated with the static information formation of the multidate information and background of main body thing.
Further, in the case of there are multiple main body things on the photo, determine the sight line of user on photo
The main body thing of dwell regions includes：
Determine coordinate position of the sight line of user in the photo；
Determine one or more main body things including the coordinate position in the photo；
One or more main body things of the coordinate position will be included in the photo for determining source, as what is determined
The main body thing of the sight line of user dwell regions on photo.
Further, the region that the sight line of user is stopped on photo is determined, including：
The optic centre of eyes of user is sensed by the front camera in terminal；
Region in the optic centre preset range of the eyes of user that will be sensed, as the sight line of the user in photo
The region of upper stop.
Additionally, to achieve the above object, the present invention also proposes a kind of photograph generation method, and methods described includes：
Identify main body object area and the background area in the region that is taken；
Obtain the dynamic data of the main body object area and the static data of the background area；
By the dynamic data of the main body object area and the static data of the background area, the photograph for shooting and obtaining is synthesized
Piece.
Further, before the main body object area in the region that is taken and background area is identified, methods described also includes：
By the first camera and second camera in terminal, the view data in the region that is taken described in acquisition.
Further, the dynamic data of the main body object area and the static data of the background area are obtained, including：
The dynamic data by main body object area is obtained by first camera；
The static data of the background area is obtained by the second camera.
Further, main body object area and the background area in the region that is taken are identified, including：
Using the region that there is motion change in the scheduled time in the region that is taken as main body object area.
The photo that the present invention is provided show, photo generating means and method, being capable of the dynamic data based on main body object area
With the static data of background area, the photo for shooting and obtaining is synthesized, can identifying user sight line when user checks photo
The main body thing of aiming, and the main body thing aimed at user's sight line carries out dynamic-form, so as to improve the various of picture presentation
Property.
Brief description of the drawings
Fig. 1 is the hardware architecture diagram for realizing each optional mobile terminal of embodiment one of the invention；
Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is the structured flowchart of the photo display device according to the embodiment of the present invention；
Fig. 4 is the structured flowchart of the photo generating means according to the embodiment of the present invention；
Fig. 5 is the method flow diagram of the photo display methods according to the embodiment of the present invention；
Fig. 6 is the method flow diagram of the photograph generation method according to the embodiment of the present invention；
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The mobile terminal of each embodiment of the invention is realized referring now to Description of Drawings.In follow-up description, use
For represent element such as " module ", " part " or " unit " suffix only for being conducive to explanation of the invention, itself
Not specific meaning.Therefore, " module " can be used mixedly with " part ".
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP
The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement
Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is that the hardware configuration of the mobile terminal for realizing each embodiment of the invention is illustrated.Certainly, the present invention is in embodiment
It is middle the hardware configuration of the mobile terminal comprehensively to be illustrated, in subsequent embodiment, if also relating to mobile terminal,
Can be illustrated using the hardware configuration in embodiment, repetition of explanation will be carried out no longer in subsequent embodiment, and the description below answers pin
Each embodiment of the invention is applicable.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups for showing
Part.More or less component can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and wireless communication system
Or the radio communication between network.For example, wireless communication unit can include broadcasting reception module 111, mobile communication module
112nd, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcast management server
Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be generated and sent
The broadcast singal and/or broadcast related information generated before the server or reception of broadcast singal and/or broadcast related information
And send it to the server of terminal.Broadcast singal can include TV broadcast singals, radio signals, data broadcasting
Signal etc..And, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Pass information can also be provided via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 is received.Broadcast singal can exist in a variety of manners, for example, it can be with the electronics of DMB (DMB)
The form of program guide (EPG), the electronic service guidebooks (ESG) of digital video broadcast-handheld (DVB-H) etc. and exist.Broadcast
Receiver module 111 can receive signal and broadcast by using various types of broadcast systems.Especially, broadcasting reception module 111
Can be wide by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video
Broadcast-hand-held (DVB-H), forward link media (MediaFLO@) Radio Data System, received terrestrial digital broadcasting integrated service
Etc. (ISDB-T) digit broadcasting system receives digital broadcasting.Broadcasting reception module 111 may be constructed such that and be adapted to provide for extensively
Broadcast the various broadcast systems and above-mentioned digit broadcasting system of signal.Via broadcasting reception module 111 receive broadcast singal and/
Or broadcast related information can be stored in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal can be logical including voice
Words signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can include WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant
ToothTM, radio frequency identification (RFID), Infrared Data Association (IrDA), ultra wide band (UWB), purple honeybeeTMEtc..
Location information module 115 is the module for checking or obtaining the positional information of mobile terminal.Location information module
Typical case be GPS (global positioning system).According to current technology, GPS module 115 is calculated and comes from three or more satellites
Range information and correct time information and the Information application triangulation for calculating, so as to according to longitude, latitude
Highly accurately calculate three-dimensional current location information.Currently, defended using three for calculating the method for position and temporal information
Star and the position that is calculated by using other satellite correction and the error of temporal information.Additionally, GPS module 115
Can be by Continuous plus current location information in real time come calculating speed information.
A/V input blocks 120 are used to receive audio or video signal.A/V input blocks 120 can include the He of camera 121
Microphone 122, the static images that 121 pairs, camera is obtained in Video Capture pattern or image capture mode by image capture apparatus
Or the view data of video is processed.Picture frame after treatment may be displayed on display unit 151.Processed through camera 121
Picture frame afterwards can be stored in memory 160 (or other storage mediums) or sent out via wireless communication unit 110
Send, two or more cameras 121 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone calling model, note
Sound (voice data) is received via microphone in record pattern, speech recognition mode etc. operational mode, and can be by so
Acoustic processing be voice data.Audio (voice) data after treatment can be converted in the case of telephone calling model can
The form for being sent to mobile communication base station via mobile communication module 112 is exported.Microphone 122 can implement various types of making an uproar
Sound eliminates (or suppression) algorithm to eliminate the noise or dry that (or suppression) produces during reception and transmission audio signal
Disturb.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user input
Plant operation.User input unit 130 allows the various types of information of user input, and can include keyboard, metal dome, touch
Plate (for example, detection due to being touched caused by resistance, pressure, electric capacity etc. change sensitive component), roller, rocking bar etc.
Deng.Especially, when touch pad is superimposed upon on display unit 151 in the form of layer, touch-screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 1 00, (for example, mobile terminal 1 00 opens or closes shape
State), the presence or absence of the contact (that is, touch input) of the position of mobile terminal 1 00, user for mobile terminal 1 00, mobile terminal
The acceleration or deceleration movement of 100 orientation, mobile terminal 1 00 and direction etc., and generate for controlling mobile terminal 1 00
The order of operation or signal.For example, when mobile terminal 1 00 is embodied as sliding-type mobile phone, sensing unit 140 can be sensed
The sliding-type phone is opened or closed.In addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).Sensing unit 140 can will be combined below including proximity transducer 1410
Touch-screen is described to this.
Interface unit 170 is connected the interface that can pass through with mobile terminal 1 00 as at least one external device (ED).For example,
External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing
Line FPDP, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be that storage uses each of mobile terminal 1 00 for verifying user
Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included
Etc..In addition, the device (hereinafter referred to as " identifying device ") with identification module can take the form of smart card, therefore, know
Other device can be connected via port or other attachment means with mobile terminal 1 00.Interface unit 170 can be used for reception and come from
The input (for example, data message, electric power etc.) of the external device (ED) and input that will be received is transferred in mobile terminal 1 00
One or more elements can be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 can serve as allowing by it by electricity
Power provides to the path of mobile terminal 1 00 from base or can serve as allowing the various command signals being input into from base to pass through it
It is transferred to the path of mobile terminal.Be can serve as recognizing that mobile terminal is from the various command signals or electric power of base input
The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio and/or tactile manner
Go out signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.).Output unit 150 can include display
Unit 151, dio Output Modules 152, alarm unit 153 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity
During words call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia file
Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern
Or during image capture mode, display unit 151 can show the image of capture and/or the image of reception, show video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when display unit 151 and touch pad in the form of layer it is superposed on one another to form touch-screen when, display unit
151 can serve as input unit and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user to be watched from outside, and this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
Desired implementation method, mobile terminal 1 00 can include two or more display units (or other display devices), for example, moving
Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used to detect touch
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
It is that wireless communication unit 110 is received or in memory 160 when under the isotypes such as speech recognition mode, broadcast reception mode
The voice data transducing audio signal of middle storage and it is output as sound.And, dio Output Modules 152 can be provided and movement
The audio output (for example, call signal receives sound, message sink sound etc.) of the specific function correlation that terminal 100 is performed.
Dio Output Modules 152 can include loudspeaker, buzzer etc..
Alarm unit 153 can provide output and be notified to mobile terminal 1 00 with by event.Typical event can be with
Including calling reception, message sink, key signals input, touch input etc..In addition to audio or video is exported, alarm unit
153 can in a different manner provide output with the generation of notification event.For example, alarm unit 153 can be in the form of vibrating
Output is provided, when calling, message or some other entrance communication (incomingcommunication) are received, alarm list
Unit 153 can provide tactile output (that is, vibrating) to notify to user.Exported by providing such tactile, even if
When in pocket of the mobile phone of user in user, user also can recognize that the generation of various events.Alarm unit 153
The output of the generation of notification event can be provided via display unit 151 or dio Output Modules 152.
Memory 160 can store software program for the treatment and control operation performed by controller 180 etc., Huo Zheke
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And, memory 160 can store the vibration of various modes on being exported when touching and being applied to touch-screen and audio signal
Data.
Memory 160 can include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, many
Media card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..And, mobile terminal 1 00 can perform memory with by network connection
The network storage device cooperation of 160 store function.
The overall operation of the generally control mobile terminal of controller 180.For example, controller 180 is performed and voice call, data
Communication, video calling etc. related control and treatment.In addition, controller 180 can be included for reproducing (or playback) many matchmakers
The multi-media module 181 of volume data, multi-media module 181 can be constructed in controller 180, or can be structured as and control
Device 180 is separated.Controller 180 can be with execution pattern identifying processing, the handwriting input that will be performed on the touchscreen or picture
Draw input and be identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit
Appropriate electric power needed for part and component.
Various implementation methods described herein can be with use such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implemented.Implement for hardware, implementation method described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein
At least one in electronic unit is implemented, and in some cases, such implementation method can be implemented in controller 180.
For software implementation, the implementation method of such as process or function can with allow to perform the single of at least one function or operation
Software module is implemented.Software code can be come by the software application (or program) write with any appropriate programming language
Implement, software code can be stored in memory 160 and performed by controller 180.
So far, oneself according to its function through describing mobile terminal.Below, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is used as showing
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Mobile terminal 1 00 as shown in Figure 1 may be constructed such that using via frame or packet transmission data it is all if any
Line and wireless communication system and satellite-based communication system are operated.
The communication system that mobile terminal wherein of the invention can be operated is described referring now to Fig. 2.
Such communication system can use different air interface and/or physical layer.For example, used by communication system
Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications system
System (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc..As non-limiting example, under
The description in face is related to cdma communication system, but such teaching is equally applicable to other types of system.
With reference to Fig. 2, cdma wireless communication system can include multiple mobile terminal 1s 00, multiple base station (BS) 270, base station
Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN)
290 form interface.MSC280 is also structured to form interface with the BSC275 that can be couple to base station 270 via back haul link.
If any one in the interface that back haul link can be known according to Ganji is constructed, the interface includes such as E1/T1, ATM, IP,
PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that system can include multiple BSC275 as shown in Figure 2.
Each BS270 can service one or more subregions (or region), by multidirectional antenna or the day of sensing specific direction
Each subregion of line covering is radially away from BS270.Or, each subregion can be by two or more for diversity reception
Antenna is covered.Each BS270 may be constructed such that the multiple frequency distribution of support, and the distribution of each frequency has specific frequency spectrum
(for example, 1.25MHz, 5MHz etc.).
What subregion and frequency were distributed intersects can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
System (BTS) or other equivalent terms.In this case, term " base station " can be used for broadly representing single
BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, each subregion of specific BS270 can be claimed
It is multiple cellular stations.
As shown in Figure 2, broadcast singal is sent to broadcsting transmitter (BT) 295 mobile terminal operated in system
100.Broadcasting reception module 111 as shown in Figure 1 is arranged at mobile terminal 1 00 to receive the broadcast sent by BT295
Signal.In fig. 2 it is shown that several global positioning system (GPS) satellites 300.Satellite 300 helps position multiple mobile terminals
At least one of 100.
In fig. 2, multiple satellites 300 are depicted, it is understood that be, it is possible to use any number of satellite obtains useful
Location information.GPS module 115 as shown in Figure 1 is generally configured to coordinate with satellite 300 to be believed with obtaining desired positioning
Breath.Substitute GPS tracking techniques or outside GPS tracking techniques, it is possible to use other of the position of mobile terminal can be tracked
Technology.In addition, at least one gps satellite 300 can optionally or additionally process satellite dmb transmission.
Used as a typical operation of wireless communication system, BS270 receives the reverse link from various mobile terminal 1s 00
Signal.Mobile terminal 1 00 generally participates in call, information receiving and transmitting and other types of communication.Each of the reception of certain base station 270 is anti-
Processed in specific BS270 to link signal.The data of acquisition are forwarded to the BSC275 of correlation.BSC provides call
Resource allocation and the mobile management function of the coordination including the soft switching process between BS270.The number that BSC275 will also be received
According to MSC280 is routed to, it provides the extra route service for forming interface with PSTN290.Similarly, PSTN290 with
MSC280 forms interface, and MSC and BSC275 form interface, and BSC275 correspondingly controls BS270 with by forward link signals
It is sent to mobile terminal 1 00.
Based on above-mentioned mobile terminal hardware configuration and communication system, the photo display dress in the embodiment of the present invention is proposed
Put, as shown in figure 3, the photo display device of the embodiment of the present invention can include：First determining module 301, the second determining module
302 and display module 303.Modules are described as follows below：
1) the first determining module 301, the region that the sight line for determining user is stopped on photo；
Can be by the front camera sense in terminal in identifying user sight line when dwell regions on screen
Answer the optic centre of eyes of user, but the region in the optic centre preset range of the eyes of user that will be sensed, as institute
State the region that the sight line of user is stopped on photo.
I.e., it is contemplated that when picture is seen, the region that optic centre is faced is exactly the area that people is watching to general people
Domain.Therefore, it can recognize the interest region that beholder is current by front camera, i.e. the region that user's sight line is faced, just
May be considered the interest region of beholder.
2) the second determining module 302, the main body thing of the sight line dwell regions on photo for determining user；
It is determined that after the area-of-interest of beholder, it is possible to determine the main body thing in the region, the master for determining
It can also be multiple that body thing can be one.
For example, there is two main body things in active user's visual line of sight, one in dynamic people, and the dog for slipping, then,
Just can be using the two main body things all as the main body thing for identifying.
Or, if the dynamic main body thing of only one of which in photo current, then when user's sight line look at this picture
When, just directly determine the dynamic main body thing as the main body thing for identifying.
It is important to note, however, that the mode of above-mentioned cited determination main body thing is only schematic description, in actual reality
When existing, main body thing can also be determined using other modes.The application is not construed as limiting to this.
In one embodiment, the second determining module 302 can include：First determining unit, in the photo
In the case of the upper main body things in the presence of multiple, coordinate position of the sight line of user in the photo is determined；Second determining unit, uses
In it is determined that including one or more main body things of the coordinate position in the photo；Generation unit, for source will to be determined
One or more main body things including the coordinate position in the photo, the sight line as the user for determining is stopped on photo
Stay the main body thing in region.
That is, by the coordinate position on screen, main body thing is determined.
3) display module 303, the main body thing in the region stopped for pair sight line for determining enters Mobile state and presents, wherein, institute
It is that main body thing and background are recognized when shooting to state photo, and is integrated with the multidate information of main body thing and the static information shape of background
Into.
It is to clap for main body thing because the photo seen is the picture that there is the combination of sound state, i.e. when being shot
The dynamic picture taken the photograph, is all the static images for using for such as background all regions, and then both are synthesized, it is possible to obtained
The picture being association of activity and inertia.
For example, what is shot is that two people (small A and small B) are sitting in the picture being had a meal on desk, although what shooting was obtained is one
The picture of static state display, but the pictorial information that the pictorial informations dynamically had a meal of the small A that is wherein stored with and small B dynamically have a meal.
User is being detected when picture is seen, that currently see is small A, then just show the dynamic picture data of small A,
If user is when picture is seen, that currently see is small B, then just show the dynamic picture data of small B, it can be seen that, lead to
Crossing this mode can improve flexibility and the interest that picture shows.
Further, when the dynamic data of currently displaying which main body thing is recognized, above-mentioned knowledge can not only be used
The mode of other beholder's sight line, can also use other modes, for example, carrying out click behaviour to certain destination object by user
Make, then in response to the operation, just show the dynamic data of the corresponding main body thing of click location.Which kind of specifically triggered using mode
The display of main body thing dynamic data is carried out, can be selected according to actual needs, the application is not construed as limiting to this.
This example additionally provides a kind of photo generating means, as shown in figure 4, can include：Identification module 401, first is obtained
These modules are specifically described as follows by module 402 and synthesis module 403 below：
1) identification module 401, main body object area and background area for identifying the region that is taken；
In view of in the application primarily to realizing that what picture was association of activity and inertia taking pictures and show so that shoot and obtain
Some regions of photo are dynamics, but the photo for being formed is static, when only determining to need display dynamic data, just meeting
Show dynamic region.
If these dynamic areas are static destination objects, it is clear that just lose meaning, therefore, the main body to be recognized
Thing needs to be that dynamic object could cause that this picture shooting and display process are meaningful.Therefore, the region knowledge that is taken is being carried out
When other, can in the given time be there is into dynamic change in these by the region that there is dynamic change in identification region
Region as main body object area.For example, the region that is taken is for several individuals are at table, then what is moved in this region is the upper half of people
Body, therefore, it can this one by one above the waist as main body object area.When identification, it is possible to using the pre- timing of identification
The region of interior occurrence dynamics change is used as main body object area, for example, there is the region of change in three seconds in statistics, as main body thing
Region.
In one embodiment, identification module 401 specifically can be used in the scheduled time in the region that is taken
There is the region of motion change as main body object area.
2) the first acquisition module 402, for obtain the main body object area dynamic data and the background area it is quiet
State data；
After main body object area is identified, other regions just can serve as background area, obtain picture letter
When breath, it is possible to obtain the dynamic data of main body object area, such as：Change dynamic data in 3s, for background area
Only need to obtain a static information.In the case where there are multiple main body object areas, each main body object area is just obtained
Dynamic data.
If there is two cameras on camera terminal：First camera and second camera, then can also identify
Be taken region main body object area and background area before, by the first camera and second camera in terminal, obtain
The view data in the region that is taken.Specifically, in order to realize effective division of function, can be by first camera
The dynamic data by main body object area is obtained, the static data of the background area is obtained by the second camera.
It is also finally to show i.e., it is possible to be that the first camera obtains photo of the photo as final basis imaging
Still photo, the dynamic data of main body thing for identifying then is obtained by second camera.Both data are combined
The final picture being association of activity and inertia can be obtained.
3) synthesis module 403, for by the static data of the dynamic data of the main body object area and the background area,
Synthesize the photo for shooting and obtaining.
That is, by the combination of dynamic data and static data, obtain finally shooting the photo for obtaining.Because in the photo both
There is dynamic data, there is static data again so that user is when display dynamic change is thought, it can be seen that dynamic change.Enter one
Step, if again by sensing the optic centre of beholder's eyes, triggering display automated regional so that main body thing can be with photo
Dynamic play is carried out, such that it is able to realize wanting to see where technique effect where moved.
Shown based on above-mentioned photo, photo generating means, propose the inventive method each embodiment.
As shown in figure 5, the embodiment of the present invention proposes a kind of photo display methods, can include：
Step 501：Determine the region that the sight line of user is stopped on photo；
Can be by the front camera sense in terminal in identifying user sight line when dwell regions on screen
Answer the optic centre of eyes of user, but the region in the optic centre preset range of the eyes of user that will be sensed, as institute
State the region that the sight line of user is stopped on photo.
I.e., it is contemplated that when picture is seen, the region that optic centre is faced is exactly the area that people is watching to general people
Domain.Therefore, it can recognize the interest region that beholder is current by front camera, i.e. the region that user's sight line is faced, just
May be considered the interest region of beholder.
Step 502：Determine the main body thing of sight line dwell regions on photo of user；
It is determined that after the area-of-interest of beholder, it is possible to determine the main body thing in the region, the master for determining
It can also be multiple that body thing can be one.
For example, there is two main body things in active user's visual line of sight, one in dynamic people, and the dog for slipping, then,
Just can be using the two main body things all as the main body thing for identifying.
Or, if the dynamic main body thing of only one of which in photo current, then when user's sight line look at this picture
When, just directly determine the dynamic main body thing as the main body thing for identifying.
It is important to note, however, that the mode of above-mentioned cited determination main body thing is only schematic description, in actual reality
When existing, main body thing can also be determined using other modes.The application is not construed as limiting to this.
In one embodiment, in the case of there are multiple main body things on the photo, the sight line of user is determined
The main body thing of dwell regions can include on photo：Determine coordinate position of the sight line of user in the photo；Determine institute
State one or more main body things including the coordinate position in photo；The coordinate will be included in the photo for determining source
One or more main body things of position, as the main body thing of the sight line of the user for determining dwell regions on photo.
Step 503：Pair determine sight line stop region main body thing enter Mobile state presentation, wherein, the photo be
Identification main body thing and background when shooting, and be integrated with the static information formation of the multidate information and background of main body thing.
It is to clap for main body thing because the photo seen is the picture that there is the combination of sound state, i.e. when being shot
The dynamic picture taken the photograph, is all the static images for using for such as background all regions, and then both are synthesized, it is possible to obtained
The picture being association of activity and inertia.
For example, what is shot is that two people (small A and small B) are sitting in the picture being had a meal on desk, although what shooting was obtained is one
The picture of static state display, but the pictorial information that the pictorial informations dynamically had a meal of the small A that is wherein stored with and small B dynamically have a meal.
User is being detected when picture is seen, that currently see is small A, then just show the dynamic picture data of small A,
If user is when picture is seen, that currently see is small B, then just show the dynamic picture data of small B, it can be seen that, lead to
Crossing this mode can improve flexibility and the interest that picture shows.
Further, when the dynamic data of currently displaying which main body thing is recognized, above-mentioned knowledge can not only be used
The mode of other beholder's sight line, can also use other modes, for example, carrying out click behaviour to certain destination object by user
Make, then in response to the operation, just show the dynamic data of the corresponding main body thing of click location.Which kind of specifically triggered using mode
The display of main body thing dynamic data is carried out, can be selected according to actual needs, the application is not construed as limiting to this.
As shown in fig. 6, the embodiment of the present invention proposes a kind of photograph generation method, may include steps of：
Step 601：Identify main body object area and the background area in the region that is taken；
In view of in the application primarily to realizing that what picture was association of activity and inertia taking pictures and show so that shoot and obtain
Some regions of photo are dynamics, but the photo for being formed is static, when only determining to need display dynamic data, just meeting
Show dynamic region.
If these dynamic areas are static destination objects, it is clear that just lose meaning, therefore, the main body to be recognized
Thing needs to be that dynamic object could cause that this picture shooting and display process are meaningful.Therefore, the region knowledge that is taken is being carried out
When other, can in the given time be there is into dynamic change in these by the region that there is dynamic change in identification region
Region as main body object area.For example, the region that is taken is for several individuals are at table, then what is moved in this region is the upper half of people
Body, therefore, it can this one by one above the waist as main body object area.When identification, it is possible to using the pre- timing of identification
The region of interior occurrence dynamics change is used as main body object area, for example, there is the region of change in three seconds in statistics, as main body thing
Region.
Step 602：Obtain the dynamic data of the main body object area and the static data of the background area；
After main body object area is identified, other regions just can serve as background area, obtain picture letter
When breath, it is possible to obtain the dynamic data of main body object area, such as：Change dynamic data in 3s, for background area
Only need to obtain a static information.In the case where there are multiple main body object areas, each main body object area is just obtained
Dynamic data.
If there is two cameras on camera terminal：First camera and second camera, then can also identify
Be taken region main body object area and background area before, by the first camera and second camera in terminal, obtain
The view data in the region that is taken.Specifically, in order to realize effective division of function, can be by first camera
The dynamic data by main body object area is obtained, the static data of the background area is obtained by the second camera.
It is also finally to show i.e., it is possible to be that the first camera obtains photo of the photo as final basis imaging
Still photo, the dynamic data of main body thing for identifying then is obtained by second camera.Both data are combined
The final picture being association of activity and inertia can be obtained.
Step 603：By the dynamic data of the main body object area and the static data of the background area, shooting is synthesized
The photo for obtaining.
That is, by the combination of dynamic data and static data, obtain finally shooting the photo for obtaining.Because in the photo both
There is dynamic data, there is static data again so that user is when display dynamic change is thought, it can be seen that dynamic change.Enter one
Step, if again by sensing the optic centre of beholder's eyes, triggering display automated regional so that main body thing can be with photo
Dynamic play is carried out, such that it is able to realize wanting to see where technique effect where moved.
The present invention also propose a kind of photo show, photo generating means and method, the dynamic data based on main body object area
With the static data of background area, the photo for shooting and obtaining is synthesized, can identifying user sight line when user checks photo
The main body thing of aiming, and the main body thing aimed at user's sight line carries out dynamic-form, so as to improve the various of picture presentation
Property.
It should be noted that herein, term " including ", "comprising" or its any other variant be intended to non-row
His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and
And also include other key elements being not expressly set out, or also include for this process, method, article or device institute are intrinsic
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there is other identical element in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably implementation method.Based on such understanding, technical scheme is substantially done to prior art in other words
The part for going out contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used to so that a station terminal equipment (can be mobile phone, computer, clothes
Business device, air-conditioner, or network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of photo display device, it is characterised in that described device includes：
First determining module, the region that the sight line for determining user is stopped on photo；
Second determining module, the main body thing of the sight line dwell regions on photo for determining user；
Display module, for pair determine sight line stop region main body thing enter Mobile state present, wherein, the photo be
Identification main body thing and background when shooting, and be integrated with the static information formation of the multidate information and background of main body thing.
2. device according to claim 1, it is characterised in that second determining module includes：
First determining unit, for it there are multiple main body things on the photo in the case of, determines the sight line of user described
Coordinate position in photo；
Second determining unit, for determining one or more main body things including the coordinate position in the photo；
Generation unit, for will include one or more main body things of the coordinate position in the photo for determining source, makees
It is the main body thing of sight line dwell regions on photo of user determined.
3. device according to claim 1, it is characterised in that first determining module includes：
Sensing unit, the optic centre for sensing eyes of user by the front camera in terminal；
Generation unit, for the region in the optic centre preset range of the eyes of user that will be sensed, as the user's
The region that sight line is stopped on photo.
4. a kind of photo generating means, it is characterised in that described device includes：
Identification module, main body object area and background area for identifying the region that is taken；
First acquisition module, for obtaining the dynamic data of the main body object area and the static data of the background area；
Synthesis module, for by the static data of the dynamic data of the main body object area and the background area, synthesizing bat
Take the photograph the photo for obtaining.
5. device according to claim 4, it is characterised in that also include：
Second acquisition module, for before the main body object area in the region that is taken and background area is identified, by terminal
The first camera and second camera, obtain described in be taken the view data in region.
6. device according to claim 5, it is characterised in that first acquisition module includes：
First acquisition unit, for obtaining the dynamic data by main body object area by first camera；
Second acquisition unit, the static data for obtaining the background area by the second camera.
7. a kind of terminal, it is characterised in that including：Photo display device any one of claims 1 to 3, and/or,
Photo generating means any one of claim 4 to 6.
8. a kind of photo display methods, it is characterised in that methods described includes：
Determine the region that the sight line of user is stopped on photo；
Determine the main body thing of sight line dwell regions on photo of user；
Pair determine sight line stop region main body thing enter Mobile state presentation, wherein, the photo be shoot when recognize
Main body thing and background, and be integrated with the static information formation of the multidate information and background of main body thing.
9. method according to claim 8, it is characterised in that in the case of there are multiple main body things on the photo,
Determine that the sight line of the user main body thing of dwell regions on photo includes：
Determine coordinate position of the sight line of user in the photo；
Determine one or more main body things including the coordinate position in the photo；
One or more main body things of the coordinate position will be included in the photo for determining source, as the user for determining
Sight line dwell regions on photo main body thing.
10. a kind of photograph generation method, it is characterised in that methods described includes：
Identify main body object area and the background area in the region that is taken；
Obtain the dynamic data of the main body object area and the static data of the background area；
By the dynamic data of the main body object area and the static data of the background area, the photo for shooting and obtaining is synthesized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710206286.2A CN106851114B (en) | 2017-03-31 | 2017-03-31 | Photo display device, photo generation device, photo display method, photo generation method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710206286.2A CN106851114B (en) | 2017-03-31 | 2017-03-31 | Photo display device, photo generation device, photo display method, photo generation method and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106851114A true CN106851114A (en) | 2017-06-13 |
| CN106851114B CN106851114B (en) | 2020-02-18 |
Family
ID=59142817
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710206286.2A Active CN106851114B (en) | 2017-03-31 | 2017-03-31 | Photo display device, photo generation device, photo display method, photo generation method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106851114B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107767430A (en) * | 2017-09-21 | 2018-03-06 | 努比亚技术有限公司 | One kind shooting processing method, terminal and computer-readable recording medium |
| CN111083553A (en) * | 2019-12-31 | 2020-04-28 | 联想(北京)有限公司 | Image processing method and image output equipment |
| CN113849142A (en) * | 2021-09-26 | 2021-12-28 | 深圳市火乐科技发展有限公司 | Image display method and device, electronic equipment and computer readable storage medium |
| CN117037279A (en) * | 2023-08-25 | 2023-11-10 | 北京智芯微电子科技有限公司 | Action detection and counting method and device, heterogeneous chip, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102110369A (en) * | 2010-12-21 | 2011-06-29 | 汉王科技股份有限公司 | Jaywalking snapshot method and device |
| CN104954689A (en) * | 2015-06-30 | 2015-09-30 | 努比亚技术有限公司 | Method and shooting device for acquiring photo through double cameras |
| CN106162355A (en) * | 2015-04-10 | 2016-11-23 | 北京云创视界科技有限公司 | video interactive method and terminal |
| CN106453864A (en) * | 2016-09-26 | 2017-02-22 | 广东欧珀移动通信有限公司 | Image processing method and device and terminal |
-
2017
- 2017-03-31 CN CN201710206286.2A patent/CN106851114B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102110369A (en) * | 2010-12-21 | 2011-06-29 | 汉王科技股份有限公司 | Jaywalking snapshot method and device |
| CN106162355A (en) * | 2015-04-10 | 2016-11-23 | 北京云创视界科技有限公司 | video interactive method and terminal |
| CN104954689A (en) * | 2015-06-30 | 2015-09-30 | 努比亚技术有限公司 | Method and shooting device for acquiring photo through double cameras |
| CN106453864A (en) * | 2016-09-26 | 2017-02-22 | 广东欧珀移动通信有限公司 | Image processing method and device and terminal |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107767430A (en) * | 2017-09-21 | 2018-03-06 | 努比亚技术有限公司 | One kind shooting processing method, terminal and computer-readable recording medium |
| CN111083553A (en) * | 2019-12-31 | 2020-04-28 | 联想(北京)有限公司 | Image processing method and image output equipment |
| CN111083553B (en) * | 2019-12-31 | 2021-08-17 | 联想(北京)有限公司 | Image processing method and image output equipment |
| CN113849142A (en) * | 2021-09-26 | 2021-12-28 | 深圳市火乐科技发展有限公司 | Image display method and device, electronic equipment and computer readable storage medium |
| CN113849142B (en) * | 2021-09-26 | 2024-05-28 | 深圳市火乐科技发展有限公司 | Image display method, device, electronic equipment and computer readable storage medium |
| CN117037279A (en) * | 2023-08-25 | 2023-11-10 | 北京智芯微电子科技有限公司 | Action detection and counting method and device, heterogeneous chip, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106851114B (en) | 2020-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106502693B (en) | A kind of image display method and device | |
| CN104902212B (en) | A kind of video communication method and device | |
| CN106131322A (en) | Dual-screen mobile terminal plays the method and device of sound | |
| CN106911850A (en) | Mobile terminal and its screenshotss method | |
| CN106789589A (en) | One kind shares processing method, device and terminal | |
| CN107087074A (en) | A kind of method, device and terminal for adjusting screen intensity | |
| CN107016639A (en) | A kind of image processing method and device | |
| CN106843468A (en) | A kind of man-machine interaction method in terminal and VR scenes | |
| CN106851114A (en) | A kind of photo shows, photo generating means and method, terminal | |
| CN106406737A (en) | A screen operating method and device and a mobile terminal | |
| CN105242483B (en) | The method and apparatus that a kind of method and apparatus for realizing focusing, realization are taken pictures | |
| CN106993084A (en) | The method, device and mobile terminal that a kind of control information is shown | |
| CN106383707A (en) | Picture display method and system | |
| CN106131327A (en) | Terminal and image-pickup method | |
| CN106993134A (en) | A kind of video generation device and method, terminal | |
| CN108076231A (en) | A kind of movement exchange householder method and device | |
| CN107071161A (en) | The aggregation display method and mobile terminal of icon in a kind of status bar | |
| CN104731484B (en) | The method and device that picture is checked | |
| CN106125898A (en) | The method and device of screen rotation | |
| CN106454087B (en) | A kind of filming apparatus and method | |
| CN105391864B (en) | Device and method based on pressure control mobile terminal vibration | |
| CN104750388B (en) | Screen extended method and device | |
| CN106535181A (en) | Mobile terminal and information management method thereof | |
| CN106775386A (en) | Rimless mobile terminal and its touch control method | |
| CN106412158A (en) | Character photographing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |