WO2013073196A1

WO2013073196A1 - Image editing device, image editing program, electronic information terminal device, pointing device, and input system

Info

Publication number: WO2013073196A1
Application number: PCT/JP2012/007389
Authority: WO
Inventors: 栗山　孝司; 嘉明宮川; 正善田中
Original assignee: 株式会社ニコン
Priority date: 2011-11-18
Filing date: 2012-11-16
Publication date: 2013-05-23

Abstract

This image editing device is characterized by being provided with: a display unit having a display region on which an image is displayed; a setting unit for setting a control point on the image displayed on the display region of the display unit when manipulating the image; a resetting unit for resetting the control point on a portion of a region on the image displayed on the display region when the size of the image displayed on the display unit is larger than the size of the display region; and a display control unit for displaying the image on the display region and for displaying the control point set by means of the setting unit or the control point reset by means of the resetting unit in accordance with the state in which the image is displayed.

Description

Image editing apparatus, image editing program, electronic information terminal, pointing device, and input system

The present invention relates to an image editing apparatus, an image editing program, an electronic information terminal, a pointing device, and an input system.

Generally, there is provided an image editing apparatus that processes an image while changing the display magnification of the image displayed on the editing screen or rotating the displayed image. In such an image editing apparatus, an enlargement / reduction button or a rotation button provided on the editing screen is operated to enlarge / reduce the image to an intended display magnification, or to rotate the image, In some cases, the image is enlarged / reduced or rotated by dragging the pointer with the control point provided on the screen. When this control point is used, when a part of the image protrudes from the editing screen, the control point provided at the peripheral edge of the image also protrudes from the editing screen. For this reason, there has been proposed a method in which a grid is superimposed on an image and the image is enlarged / reduced or rotated by dragging in a predetermined direction with the pointer in contact with the displayed grid. (See Patent Document 1).

Japanese Patent Laid-Open No. 11-259668

In this way, when displaying a grid, even if part of the image protrudes from the editing screen, the grid is displayed on the editing screen, so operations such as enlarging, reducing, and rotating the image using the grid are performed. Although it is possible to display a grid on the editing screen, it is not common. For this reason, it is possible to use a control point when the entire image can be displayed in the editing screen, and to display a grid when a part of the image protrudes from the editing screen. It is not preferable in terms of operation to change the input operation for the same function depending on the size of the image, the position of the image on the editing screen, and the rotation angle.

It is an object of the present invention to provide an image editing apparatus and an image editing program that can perform image editing by a general operation regardless of the state of the image.

In order to solve the above-described problem, an image editing apparatus according to the present invention includes a display unit including a display area for displaying an image, and the image displayed in the display area of the display unit. A setting unit for setting a control point when operating the image, and a partial region of the image displayed in the display region when the size of the image displayed on the display unit is larger than the size of the display region A resetting unit for resetting the control point, and displaying the image in the display area, and the control point set by the setting unit according to a display state of the image, or the resetting A display control unit for displaying any one of the control points reset by the unit.

Further, the control point is composed of a control point for scaling the image or a control point for rotating the image. In this case, when the size of the image displayed on the display unit is larger than the size of the display region, the resetting unit controls the partial region of the image displayed on the display region. It is preferable to reset the points.

In addition, the image processing unit further includes an image processing unit that performs a trimming process on the image. When the image on which the trimming process has been performed by the image processing unit is displayed, the resetting unit performs the trimming process. The control point set for the previous image is reset to the control point set for the image on which the trimming process has been executed.

In this case, when the trimming process by the image processing unit is performed again, the display control unit may display an image immediately before the trimming process and a control point set before the trimming process. preferable.

Further, the display control unit displays the display mode of the first area cut out by the trimming process and the second area excluding the first area in different display modes.

In addition, the image editing apparatus according to the present invention moves a display unit that displays a plurality of images in a superimposed manner and any one of the plurality of images, and once cancels the registration with the other images. A display control unit that changes a display order of the superimposed images when the moved image is superimposed on the other image.

The display unit includes a display area for displaying the plurality of images, and a permission unit that allows the display order to be changed in response to the moved image reaching the outer periphery of the display area. It is to be prepared.

Further, the display order is changed depending on the positional relationship of the other image with respect to the moved image.

In this case, when the display control unit moves the moved image so as to approach the other image, when one image is located within a predetermined range with respect to the moved image, It is preferable that the display order of the moved image and the display order of the one image are switched.

In addition, when the display control unit moves the moved image so as to approach the other image, two images are located within a predetermined range with respect to the moved image. In this case, it is preferable to change the display order of the superimposed images so that the display order of the moved image is between the display orders of the two images.

Further, an operation member that is operated when moving any of the plurality of images is further provided. In this case, the operation member is preferably a touch panel.

Further, the image editing program of the present invention includes a setting step for setting a control point when operating the image with respect to the image displayed in the display area, and the size of the displayed image is the display area. A resetting step of resetting the control point for a partial area of the image displayed in the display area when the image is larger than the size of the image, displaying the image in the display area, According to a display state, causing the computer to execute a display step of displaying either the control point set by the setting step or the control point reset by the resetting step. Can be read by a computer.

The image editing program according to the present invention includes a display step of displaying a plurality of images in a superimposed manner, and moving any one of the plurality of images to temporarily cancel the registration with the other images. The computer can execute a display control process for changing the display order of the superimposed images when the moved image is superimposed on the other image. .

The electronic information terminal of the present invention includes a display device that displays a plurality of pages in units of pages, a touch panel that receives an input operation on the page displayed on the display device, and an input operation that is received by the touch panel. And first determination means for determining whether or not an input operation for separating at least a part of the page displayed on the display device has been performed based on an operation direction at the time of the input operation, and the first determination Display control means for separating and displaying at least a part of the page on the display device when it is determined that an input operation for separating at least a part of the page is performed by the means. .

Further, the display control means is a transmission destination for transmitting the content input to at least a part of the page to another electronic information terminal when at least a part of the page is displayed on the display device. When the touch panel accepts an input operation for displaying a list and selecting a destination from the destination list, an electronic information terminal serving as the destination for the content input to at least a part of the page A transmission means for transmitting to the machine is provided.

In this case, after the touch panel receives an input operation for selecting a target transmission destination from the transmission destination list, at least one of the pages based on the input operation received on the touch panel and the operation direction at the time of the input operation. Second determination means for determining whether or not an input operation for transmitting the content input to the electronic information terminal as the target transmission destination has been performed, wherein the transmission means includes the second When it is determined that an input operation for transmitting the content input to at least a part of the page by the determination unit to the electronic information terminal serving as the target transmission destination is performed, at least a part of the page It is preferable to transmit the content input to the electronic information terminal as the target transmission destination.

In addition, when at least a part of the separated page is displayed on the display device, an input operation accepted by the touch panel performs an input operation to delete the content input to at least a part of the page. A third determination unit that determines whether or not the page has been received, and at least a part of the page when the third determination unit determines that an input operation for deleting at least a part of the page has been performed. Content deletion means for deleting the input content is provided.

In addition, the pointing device of the present invention is operated when the input unit is in contact with or close to the display screen of the electronic information terminal that accepts the input operation, and the input unit is in contact with or close to the display screen. A first operation unit; a device-side reception unit that receives color information on the display screen from the electronic information terminal at a position where the input unit is in contact with or close to the first operation unit; and the device And a color display unit for displaying a color based on the color information received by the side receiving unit.

Further, based on the color information received by the device-side receiving unit, based on the operation time of the first operation unit, the number of operations of the first operation unit, or the pressure applied when operating the first operation unit. A device-side control unit that displays the level of the color on the color display unit is provided.

In addition, when a plurality of color information is received before and after the time, the color display in the color display unit is received later in time than the color display based on the color information received earlier in time. It has a single color mode for updating to a color display based on color information.

Further, when a plurality of color information is received before and after the time, the display of the color in the color display unit is changed from the display of the color based on the color information received earlier in time. It has a color mixing mode for updating to a color display obtained by mixing colors based on each.

In this case, in the color mixture mode, the operation time of the first operation unit, the number of operations of the first operation unit, or the first operation unit when receiving a plurality of pieces of color information obtained before and after time. Based on the pressure applied during the operation, a ratio setting unit that sets a ratio when colors based on the plurality of color information are mixed, and a ratio set by the ratio setting unit is used to change the time. And a generation unit that generates color information of a color obtained by mixing colors based on a plurality of color information received.

Further, the color display unit displays a moving image showing a state in which colors based on a plurality of color information received before and after the time are mixed.

Further, when performing the input operation using the storage unit that stores at least one or more color information received by the device-side receiving unit or the color information generated by the generation unit, and the at least one or more color information And a second operation unit operated by

The input system of the present invention includes the above-described pointing device and an electronic information terminal having a touch panel on the display screen, and the pointing device displays color information used when performing the input operation. A device-side transmission unit configured to transmit to the electronic information terminal, wherein the electronic information terminal receives an operation of the first operation unit of the pointing device, and an input unit of the pointing device comes into contact or proximity A terminal-side transmission unit that transmits color information at a position to be transmitted toward the device-side reception unit, and a terminal-side reception that receives color information transmitted from the device-side transmission unit during an input operation using the pointing device And the color information received by the terminal-side receiving unit using the pointing device. Characterized in that it and a terminal-side controller to be displayed on the display screen drawing based on.

It is a perspective view which shows the external appearance in the 2nd state of a portable electronic information terminal. In a portable electronic information terminal, it is a perspective view which shows an external appearance when a fastener is removed. It is a perspective view which shows the external appearance in a 1st state of a portable electronic information terminal. It is a functional block diagram which shows the electrical constitution of a portable electronic information terminal. It is explanatory drawing which shows an example of the display screen in the 1st state of a portable electronic information terminal. It is a perspective view which shows input operation using an electronic pen. (A) The perspective view which shows the case where the image displayed on a library screen is selected using an electronic pen, (b) moves the selected image from a 2nd display part to a 1st display part using an electronic pen. It is a perspective view which shows the movement locus | trajectory when letting it be made. It is a figure which shows an example of the operation bar as a control point displayed with respect to the image to edit. (A) When operating an expansion / contraction bar, (b) It is a figure shown about the case where a rotation bar is operated. (A) It is a figure which shows the image before enlarging using an expansion / contraction bar, (b) The image after enlarging by operating an expansion / contraction bar. It is a figure which shows an example of the expansion / contraction bar and rotation bar reset after enlarging. It is a figure which shows an example of the expansion / contraction bar and rotation bar in case the vertex of an image is displayed when the displayed image is expanded. It is a figure which shows the state which reset the expansion / contraction bar and the rotation bar, when the vertex of an image is displayed when the displayed image is expanded. It is a flowchart which shows the flow of a process in the case of enlarging or reducing an image, or rotating an image. It is a flowchart which shows the flow of a process in the case of enlarging or reducing an image, or rotating an image. It is a figure which shows the relationship between the range of the image cut out by trimming processing, the operation bar set before and after trimming processing, and the operation bar set when performing re-trimming processing. It is a figure which shows the state by which two images have been arrange | positioned overlapping. It is a figure which shows the state which moved one image toward the periphery of the edit screen among two images. It is a figure which shows the state in which the display order of the image switched. It is a figure which shows the state by which the three images have been arrange | positioned overlapping. It is a figure which shows the state which moved any one image of three images toward the periphery of an edit screen. It is a figure which shows the state which moved the image close | similar to two other images. It is a figure which shows the state which inserted the moved image between the other two images. It is a figure which shows the state which moved the image close to one of the other two images. It is a figure which shows the state which switched the display order of the moved image and another image. It is a flowchart which shows the flow of the process at the time of image composition. It is a flowchart which shows the flow of the process which changes the display order of an image. It is a flowchart which shows the flow of the process which rearranges a target image. In the page displayed on a 1st display part, it is a figure which shows the area | region in which handwriting input operation is possible, and the area | region which isolate | separates a page. (A) is a figure which shows an example in case the perforation displayed in order to cut | disconnect a page consists of a straight line along a y direction, (b) is a line along the y direction and a perforation along the x direction. It is a figure which shows an example in the case of consisting of a combination with a straight line. (A) is a figure which shows an example of input operation which separates a page, (b) is a figure which shows an example of the display in the 1st display part and 2nd display part after performing input operation which separates a page. It is a figure which shows an example of the display in the 1st display part at the time of transmitting mail. (A) is a figure which shows the case where "x" which shows deleting the separated page is input, (b) is a figure which shows an example of input operation in the case of deleting the page which inputted "x". . It is a flowchart which shows the flow of the process which transmits the content input by handwriting by mail, and the process which deletes the content input by handwriting. It is a perspective view which shows the external appearance of an electronic pen. It is a functional block diagram which shows the electric constitution of an electronic pen. It is a flowchart which shows the flow of a process in an electronic pen when drawing. It is a flowchart which shows the flow of the process in a portable electronic information terminal when drawing. (A) The figure which shows an example of the display of the 1st display part in the case of performing a color extraction process by operation of a finger, (b) The display of the extracted color when a finger is slid on the 1st display part It is a figure which shows an example which moves according to a finger | toe. It is a flowchart which shows the flow of a process at the time of extracting a color and performing drawing.

Hereinafter, the portable electronic information terminal of the present invention will be described.

As shown in FIGS. 1 to 3, the portable electronic information terminal 10 of the present invention has an appearance simulating a system notebook with a belt. The portable electronic information terminal 10 includes an apparatus main body 15, a belt 16 and a pen holder 17.

The apparatus body 15 includes a first housing 20, a second housing 21, and a hinge part 22. The apparatus main body 15 can be held in a folded state. In addition, the apparatus main body 15 rotates at least one of the first casing 20 and the second casing 21 of the folded apparatus main body 15 relative to the other casing, thereby causing the apparatus main body 15 to rotate. Can be expanded.

Here, the portable electronic information terminal 10 having a folded structure of two folds is illustrated, but the present invention is not limited to this, and is a portable electronic information terminal having a folded structure of three or more folds. Also good. Further, in addition to the portable electronic information terminal having a folding structure, the portable electronic information terminal having a slide structure that is configured by a plurality of casings and that can slide each of the plurality of casings relatively. Even so, the present invention can be achieved.

Hereinafter, a state in which the apparatus main body 15 is folded in two will be referred to as a second state, and a state in which the housing main body 15 is expanded will be referred to as a first state. Here, when the portable electronic information terminal 10 is in the second state, a first display unit 25 and a second display unit 28, which will be described later, are stored in a state of facing each other.

The first housing 20 includes a first display unit 25 on the surface 20a. The first housing 20 includes a lens surface 26 of an imaging unit 51 and a light emitting surface 27 of a flash device 57, which will be described later, on a surface 20b opposite to the surface 20a. The lens surface 26 and the light emitting surface 27 are disposed at the end opposite to the end where the hinge portion 22 is provided in the x direction in FIG. 2 and at the approximate center of the first housing 20 in the y direction in FIG. The A female member 31 of a fastener 30 protruding from the surface 20b is provided on the outer peripheral edge of the lens surface 26.

The second housing 21 includes a second display unit 28 on the surface 21a. Further, the second casing 21 includes a belt 16 on the side surface 21b. The belt 16 is provided at the substantially center in the y direction in FIG. 3 at the end opposite to the one end connected to the first housing 20 by the hinge 22 in the x direction in FIG. That is, one end of the belt 16 is a fixed end attached to the second housing 21, and the other end is a free end. The length of the belt 16 is such that, for example, when the electronic pen 40 is attached to the pen holder 17 and the belt 16 is wound around the apparatus body 15 on the first housing 20 side, the position of the free end of the belt 16 is The length is set to be closer to the hinge portion 22 than the position of the female member 31 of the fastener 30.

A pen holder 17 is provided on the fixed end side of the belt 16. An electronic pen 40 called a stylus pen is attached to the pen holder 17. Although the electronic pen 40 is attached to the pen holder 17, the present invention is not limited to this, and a fountain pen or a ball pencil may be attached in addition to the electronic pen 40. The electronic pen 40 is used when inputting to the first display unit 25 and the second display unit 28.

The male member 32 of the fastener 30 is provided on the free end side of the belt 16 described above. The position at which the male member 32 of the fastener 30 provided on the belt 16 is provided is the female member of the fastener 30 provided on the first housing 20 when the belt 16 is wound around the outer periphery of the apparatus main body 15. 31 is a position where it can be fitted.

As described above, the fastener 30 is composed of, for example, a snap button type fastener including the female member 31 provided in the first housing 20 and the male member 32 provided on the free end side of the belt 16. . The fastener 30 is formed by fitting a male member 32 provided on the belt 16 to a female member 31 provided on the first housing 20 when the portable electronic information terminal 10 is not used. Any one of the first housing 20 and the second housing 21 is prevented from rotating with respect to the other. Further, the lens surface 26 of the imaging unit 51 is covered by fitting the female member 31 and the male member 32 of the fastener 30 together. Therefore, the fastener 30 also functions as a lens cap (lens cover). Further, when the female member 31 and the male member 32 of the fastener 30 are fitted together, a power switch 63 described later is turned off, and when the fitting between the female member 31 and the male member 32 is released, the power switch 63 is turned on. Become.

FIG. 4 is a functional block diagram showing an electrical configuration of the portable electronic information terminal 10. The portable electronic information terminal 10 includes an imaging unit 51, an A / D converter 52, a buffer memory 53, an image processing circuit 54, a first display unit 25, a second display unit 28, a display control circuit 55, a controller 56, a flash. A device 57, a tilt sensor 58, a CPU 59, a built-in memory 60, a data memory 61, a communication unit 62, a power switch 63, a power circuit 64, and a power device 65 are provided. The A / D converter 52, the buffer memory 53, the image processing circuit 54, the display control circuit 55, the controller 56, the flash device 57, the tilt sensor 58, the CPU 59, the built-in memory 60, the data memory 61, and the communication unit 62 are respectively Connection is made via a bus 66.

The image pickup unit 51 includes an image pickup optical system 68 and an image pickup element 69, which are composed of unit parts held by a holder (not shown). The imaging optical system 68 may be composed of a single lens or a plurality of lenses. For example, a CCD image sensor or a CMOS image sensor is used as the imaging element 69. The image pickup optical system 68 and the image pickup element 69 are driven and controlled by the CPU 59. The A / D converter 52 converts the image signal output from the image sensor 69 from an analog image signal to a digital image signal. The digital image signal converted by the A / D converter 52 is written in the buffer memory 53.

The image processing circuit 54 performs well-known image processing such as white balance processing and gradation conversion processing on the image signal written in the buffer memory 53. In addition to this, the image processing circuit 54 also executes processing based on image editing, such as image trimming processing, image rendering processing, and image composition processing.

The first display unit 25 includes a display device 70 and a touch panel 71. As the display device 70, for example, an LCD or an organic EL display is used. The touch panel 71 is, for example, an electromagnetic induction type touch panel. The touch panel 71 is disposed on the back side of the display device 70. By using an electromagnetic induction type touch panel as the touch panel 71, an electromagnetic wave generated by the electronic pen 40 is detected when the electronic pen 40 contacts or approaches the first display unit 25. Accordingly, the position of the input switch 41 or the input switch 42 of the electronic pen 40 that is in contact with or close to the first display unit 25 and the inclination of the electronic pen 40 are detected. In addition, when the input switch 41 or the input switch 42 of the electronic pen 40 is brought into contact with the first display unit 25, the writing force is determined based on the strength of the electromagnetic wave that changes depending on the pressure applied to the input switch 41 or the input switch 42 that is in contact. Detect pressure.

In addition, although the electromagnetic induction type touch panel is mentioned as the touch panel 71 provided in the 1st display part 25, it is not necessary to be limited to this. For example, when a stylus pen that is a method other than the electromagnetic induction method is not used as the electronic pen 40, a touch panel corresponding to the method used for the electronic pen may be used. That is, this touch panel 71 is a combination of an electromagnetic induction type touch panel and any one of a resistive type and capacitive type touch panel in addition to a resistive type and capacitive type touch panel. May be. By using such a touch panel, an input operation with a user's finger can be performed in addition to an input operation with the electronic pen 40.

As with the first display unit 25, the second display unit 28 includes a display device 72 and a touch panel 73. As the display device 70, for example, an LCD or an organic EL display is used for the display device 72. As the touch panel 73, for example, a resistive film type touch panel is used. The touch panel 73 is disposed on the front surface of the display device 72. The touch panel 73 detects a position where an input operation is performed with the electronic pen 40 or the user's finger, in other words, a position where the electronic pen 40 or the user's finger contacts. In addition, as the touch panel 73 used for the 2nd display part 28, although the resistive film type touch panel is mentioned as an example, it is not necessary to be limited to this, As with the touch panel 71 provided in the 1st display part 25, An electromagnetic induction type touch panel may be used, or both a resistive film type touch panel and an electromagnetic induction type touch panel may be used in combination.

The display control circuit 55 executes display control for each of the display device 70 and the display device 72. The controller 56 drives the touch panel 71 and the touch panel 73 and outputs coordinate signals based on detection signals from the touch panel 71 and touch panel 73 to the CPU 59.

The flash device 57 is a device that emits a flash toward the subject during shooting. As the inclination sensor 58, for example, a gyro sensor or an acceleration sensor is used. A detection signal from the tilt sensor 58 is input to the CPU 59. The CPU 59 determines the tilt state of the apparatus main body 15 based on the detection signal from the tilt sensor 58.

The CPU 59 controls each part of the portable electronic information terminal 10 by executing a control program stored in the built-in memory 60. For example, in response to the detection signal from the controller 56 described above, the CPU 59 acquires information such as the position coordinates of the input switch 41 or the input switch 42 of the electronic pen 40, the writing pressure, and the tilt of the electronic pen 40. The CPU 59 outputs a control signal to the image processing circuit 54 and the display control circuit 55 based on the position coordinates and writing pressure information of the input switch 41 or the input switch 42 of the electronic pen 40. Thereby, the process based on the input with the electronic pen 40 is performed. The processing based on the input by the electronic pen 40 includes, for example, image editing processing such as image trimming processing, image drawing processing, image composition processing, drawing, screen display switching, and movement of the displayed image. And the like.

Further, the CPU 59 determines the posture of the apparatus main body 15 from the information on the tilt of the electronic pen 40 and the detection signal from the tilt sensor 58. Then, the CPU 59 determines whether or not to change the orientation of the screen displayed on each of the first display unit 25 and the second display unit 28 based on the result of determining the posture of the apparatus main body 15. For example, when it is determined that the orientation of the screen displayed on each of the first display unit 25 and the second display unit 28 is to be changed, the CPU 59 controls the display of a control signal for changing the orientation and position of the screen. Output to the circuit 55. Thereby, the orientation of the screen displayed on each of the first display unit 25 and the second display unit 28 is changed based on the tilt of the apparatus main body 15 or the tilt of the electronic pen 40.

The built-in memory 60 stores a control program executed by the CPU 59 and various data. The data memory 61 stores image data, illustration image data, sticker image data, WEB data, etc., which will be described later, classified according to the type of data.

The communication unit 62 transmits / receives data and signals to / from the external device 74 using any one of wired communication and wireless communication methods. Reference numeral 74a denotes a communication unit provided in an external device. Here, examples of the external device 74 include an image pickup apparatus represented by a digital camera, a portable electronic information terminal, a computer, and the like.

The power switch 63 is provided to turn on / off the main power of the portable electronic information terminal 10. The power switch 63 is turned off when the female member 31 of the fastener 30 is fitted to the male member 32, and is turned on when the fitting between the female member 31 and the male member 32 of the fastener 30 is released. Become. As the power switch 63, either a mechanical switch or an electronic switch is used. You may make it provide the power switch 63 used as the power switch floor by the fastener 30 separately.

The power supply circuit 64 executes control for supplying power only to the CPU 59 when the power switch 63 is turned off. The power supply circuit 64 supplies power from the power supply device 65 to each part of the portable electronic information terminal 10 when the power switch 63 is turned on. The control of the power supply device 65 in the power supply circuit 64 is executed in response to a drive signal from the CPU 59.

FIG. 5 shows a display screen when the portable electronic information terminal 10 is in use. The portable electronic information terminal 10 displays screens corresponding to different functions on the first display unit 25 and the second display unit 28 described above. The screens displayed on the first display unit 25 and the second display unit 28 are linked to each other.

The first display unit 25 displays a work screen. Examples of the work screen include an editing screen and a shooting screen. The editing screen is a screen for performing editing operations such as drawing, handwriting input of characters, image trimming, and image synthesis. The shooting screen is a screen that displays a through image captured by the imaging unit 51 and an image obtained by shooting. These screens are displayed from the tab display. That is, the above-described editing screen and shooting screen are provided with tabs. In FIG. 5, the tab name “edit” indicates the editing screen, and the tab name “camera” indicates the shooting screen. FIG. 5 shows a case where an edit screen is displayed.

Switching between the edit screen and the shooting screen is performed by bringing the input switch 41 or the input switch 42 of the electronic pen 40 close to or in contact with the position of the tab used, or the input switch 41 or the input switch of the electronic pen 40. This is executed by moving the electronic pen 40 in the −x direction or the x direction in a state where any one of 42 is close to or in contact with the first display unit 25. Hereinafter, an operation of moving the electronic pen 40 in the −x direction or the x direction in a state where either the input switch 41 or the input switch 42 of the electronic pen 40 is brought close to or in contact with the first display unit 25 will be described. 40 is referred to as an operation. In addition, since the editing screen may be a plurality of screens instead of a single screen, switching between the editing screens is also performed by performing an operation with the electronic pen 40. As a display used for switching between screens, for example, a moving image display imitating an operation of turning a page of a notebook is cited.

When the screen displayed on the first display unit 25 is switched from the editing screen to the shooting screen, the above-described imaging unit 51 is activated. Through images are acquired at predetermined time intervals by the activation of the imaging unit 51. The through images are sequentially displayed on the first display unit 25. As a result, live view display is executed on the first display unit 25. When an input operation using the electronic pen 40 is executed during the live view display, an imaging process is executed. The imaging process using the electronic pen 40 will be described later. When the imaging process is executed, an image obtained by the imaging process is displayed on the first display unit 25. Then, when the screen displayed on the first display unit 25 is switched from the shooting screen to the editing screen by an input operation using the electronic pen 40, the driving of the imaging unit 51 is stopped.

The second display unit 28 displays the library screen. Examples of the library screen include an image list screen, an illustration image list screen, a seal image list screen, and a WEB screen. The image list screen displays a list of images (including still images and moving images) stored in the portable electronic information terminal 10, and the illustration image list screen displays a list of illustration images obtained by drawing. This is the screen to be displayed. Also, the sticker image list screen is a screen for displaying a list of decoration images (hereinafter referred to as sticker images) used at the time of image synthesis, and the WEB screen is a screen for displaying a list of WEB data (for example, mail address data). In FIG. 5, the tab name “photo” indicates the image list screen, the tab name “illustration” indicates the illustration image list screen, the tab name “seal” indicates the seal image list screen, and the tab name “WEB” indicates the WEB screen. Is.

The switching of the screen in the library screen is executed by a tab selection operation using the electronic pen 40 or an operation using the electronic pen 40, similarly to the screen switching on the work screen. Also in this case, when there are a plurality of screens in each tab, the screen switching display is executed by an operation with the electronic pen 40. Note that the addition and deletion of tabs on the library screen described above can be performed by an input operation using the electronic pen 40.

FIG. 6 shows an example of an editing operation by an input operation of the electronic pen 40. As described above, when the screen displayed on the first display unit 25 is an editing screen, in addition to input functions such as drawing and handwriting input of characters, editing functions such as image trimming and image composition are executed. be able to. For example, when drawing or handwriting input of characters, the electronic pen 40 is used to input characters intended by the user or draw a picture. The line type, line color, and the like can be changed by selecting the setting items displayed on the first display unit 25 using the electronic pen 40, for example.

As described above, when an electromagnetic induction type touch panel is used as the touch panel 71 used for the first display unit 25, the touch panel is disposed on the back side of the display device 70. For this reason, when performing a drawing operation, a character input operation, or a selection operation using the electronic pen 40, the position of the tip of the electronic pen 40 and the actual input operation are performed under the influence of the thickness of the display device 70 and the like. The position that is displayed may shift. For this reason, it is preferable to display the actual input operation position (pointing position) in the electronic pen 40 when the input switch 41 or the input switch 42 of the electronic pen 40 approaches.

Next, a case where an image displayed on the image list screen displayed on the second display unit 28 is edited will be described. For example, as illustrated in FIG. 7A, when the image 75 is an editing target among the images displayed on the library screen displayed on the second display unit 28, the user uses the electronic pen 40 to display the image. 75 is selected, and the electronic pen 40 is operated in the F direction. By performing an operation with the electronic pen 40, the selected image 75 moves in the same direction as the operation with the electronic pen 40 (in this case, the F direction), and is stopped at a predetermined position on the first display unit 25. . That is, by performing the above-described operation, the selected image is thrown from the library screen displayed on the second display unit 28 to the editing screen displayed on the first display unit 25 (see FIG. 7B). Note that the moving direction and speed of the moving image and the stop position are set according to the moving direction and moving speed of the electronic pen 40.

In addition, when a plurality of images are moved from the library screen displayed on the second display unit 28 to the editing screen displayed on the first display unit 25, the images may overlap on the editing screen. In this case, the moving location of each image is adjusted so as to be shifted by a preset distance.

For an image moved from the library screen displayed on the second display unit 28 to the editing screen displayed on the first display unit 25, for example, drawing, character handwriting input, image trimming, image synthesis, etc. The editing operation can be executed. In addition, when moving an image from the editing screen displayed on the first display unit 25 to the library screen displayed on the second display unit 28, the first display unit 25 is switched from the library screen displayed on the second display unit 28. As in the case of moving the image to the editing screen displayed on the screen, the operation is performed by operating the electronic pen 40 while the image is selected with the electronic pen 40.

Next, the image editing operation will be described. FIG. 8 shows an example when an image is displayed on the editing screen of the first display unit 25. When the image 80 displayed on the editing screen of the first display unit 25 is selected, an operation bar (enlargement / reduction bar) 81 for enlargement or reduction along each side of the selected image 80 is provided on the outer periphery of the image 80. 82, 83, 84 and operation bars (rotation bars) 85, 86, 87, 88 for rotation along the four corners of the image 80 are displayed. The enlargement / reduction bars 81, 82, 83, 84 and the rotation bars 85, 86, 87, 88 are examples of control points set when an image is operated.

Of these operation bars, the enlargement / reduction bars 81, 82, 83, 84 are operated when the image 80 is enlarged or reduced. When any one of the enlargement / reduction bars 81, 82, 83, 84 is moved in either the direction away from the center C of the image 80 or the direction approaching the center C, the image is enlarged or centered on the center C of the image 80, for example. Reduced.

FIG. 9A shows a case where, for example, the enlargement / reduction bar 84 is operated by the electronic pen 40. When the enlargement / reduction bar 84 is moved away from the center C of the image 80 by the electronic pen 40 (x direction), the image 80 displayed on the editing screen has a size indicated by a two-dot chain line from a size indicated by a solid line in the drawing. Expanded to On the other hand, when the enlargement / reduction bar 84 is moved in the direction approaching the center C of the image 80 (−x direction) by the operation of the electronic pen 40, the image 80 displayed on the editing screen becomes a dotted line from the size indicated by the solid line in the figure. Reduced to the size indicated by. 9A illustrates the case where the enlargement / reduction bar 84 is operated with the electronic pen 40, the same applies to the case where other enlargement / reduction bars are operated. Here, in the scaling of the image, the aspect ratio is fixed.

Here, the image having a fixed aspect ratio is enlarged or reduced. However, it is not necessary to fix the aspect ratio when the image is enlarged or reduced, and the image is enlarged or reduced only in the moving direction of the moving enlargement / reduction bar. It is also possible to make it. Specifically, for example, when the enlargement / reduction bar 84 is moved in the direction away from the center C of the image 80 (x direction) or in the direction approaching the center C of the image (−x direction), only in the lateral direction of the image 80 The image 80 is enlarged or reduced.

Further, the image C is enlarged or reduced with the center C of the image 80 as a base point, but the present invention is not limited to this, and the base point is one of the two corners of the image 80 opposite to the moved enlargement / reduction bar. Or may be enlarged or reduced.

Rotation bars 85, 86, 87, 88 are operated when the image 80 is rotated. As shown in FIG. 9B, when any of the rotation bars 85, 86, 87, 88 is moved in the R1 direction or the R2 direction by the electronic pen 40, for example, the image is rotated around the center C of the image 80. Is done. Here, FIG. 9B shows a case where the image displayed on the solid line in the figure is rotated to the position indicated by the two-dot chain line with the center C of the image 80 as the base point when the rotation bar 86 is rotated in the R1 direction. Is illustrated. The same applies when other rotating bars are moved in the R1 direction or the R2 direction. Here, when any operation of the rotation bar is performed, the image 80 is rotated with the center C of the image 80 as a base point. However, the present invention is not limited to this, for example, the vertex of the image 80 Of 80a, 80b, 80c, and 80d (see FIG. 10B), it is also possible to rotate with a vertex at a position facing the rotation bar as a base point.

Here, in the operation of the operation bar with the electronic pen 40, the display mode of the operated operation bar is not described, but the display of the operated operation bar is displayed differently from the display of other operation bars. It's okay. In this case, for example, the color of the operated operation bar is displayed in a color different from the colors of other operation bars so that the operated operation bar can be easily recognized, or only the operated operation bar is displayed. Other operation bars may be hidden or displayed semi-transparently. In addition, a comment corresponding to the operation bar to be operated can be displayed in the vicinity of the operation bar.

Some operations on the operation bar described above may cause part of the image 80 to be edited to protrude from the editing screen of the first display unit 25. As shown in FIG. 10A, when the enlargement / reduction bar 81 is moved in the H direction using the electronic pen 40, the image 80 is enlarged according to the amount of movement of the enlargement / reduction bar 81. When the enlargement / reduction bar 81 is continuously moved in the H direction using the electronic pen 40, any of the enlargement / reduction bars 81, 82, 83, 84 and any of the rotation bars 85, 86, 87, 88 are edited. It may stick out.

FIG. 10B shows a state where both ends in the longitudinal direction of the image 80 protrude from the edit screen displayed on the first display unit 25. In this state, the expansion / contraction bars 83, 84 and the rotation bars 85, 86, 87, 88 protrude from the editing screen. Enlargement / reduction bars 81 and 82 are displayed for the image 80 displayed on the editing screen. In such a case, the enlargement /

reduction bar

83, 84 or the rotation bar protruded by reducing the image 80 using any of the enlargement / reduction bars 81, 82, or by shifting the position of the image 80 displayed on the editing screen. One of 85, 86, 87, and 88 needs to be displayed.

For this reason, when the image protrudes from the editing screen, an enlargement / reduction bar and a rotation bar are newly set in accordance with a part of the image displayed on the editing screen, and the enlargement / reduction bar and the rotation bar are displayed. As shown in FIG. 11, when both ends in the longitudinal direction of the image 80 protrude from the editing screen, the enlargement / reduction bar 81 ′ along each of the upper edge portion and the lower edge portion of the image 80 displayed on the editing screen is displayed. , 82 ′, enlargement / reduction bars 83 ′, 84 ′ along the vertical direction (y direction) of the editing screen are displayed. Also, rotation bars 85 ', 86', 87 ', 88' are displayed near the four corners of a part of the image 80 displayed on the editing screen. By displaying these operation bars, editing operations such as enlarging or reducing the image 80 or rotating the image 80 can be performed without changing the size of the image displayed on the editing screen.

Note that when the image 80 is enlarged on the editing screen, one of the

vertices

80a, 80b, 80c, and 80d of the image 80 may be displayed depending on the position of the image with respect to the editing screen. FIG. 12 shows a case where the vertex 80a is displayed as a part of the image. In this state, in addition to the enlargement / reduction bars 81 and 83, the rotation bar 85 is displayed as an operation bar for the image 80. That is, as an editing operation on the image 80, an operation for rotating the image 80 in addition to the enlargement or reduction of the image 80 can be executed.

Thus, if any of the vertices of the image 80 is displayed on the editing screen when the image 80 is a polygon such as a rectangle, the operation bar set when the image is selected is displayed. There is no need to newly set an operation bar based on a part of the image displayed on the editing screen. Of course, as shown in FIG. 13, when a polygonal image such as a rectangle protrudes from the editing screen, a new operation bar is set and set for a part of the image displayed on the editing screen. The operation bars (enlargement / reduction bars 91, 92, 93, 94, 95 and rotation bars 96, 97, 98, 99, 100) can be displayed together with the image 80.

Hereinafter, the flow of processing for enlarging or reducing an image or rotating an image will be described with reference to the flowcharts of FIGS. 14 and 15 is executed when an image is displayed on the editing screen.

Step S101 is processing for selecting an image. When an intended image is selected with the electronic pen 40, the input switch 41 of the electronic pen 40 is detected by the touch panel 71. In response to this detection signal, the controller 56 specifies the position coordinates at which the electronic pen 40 is detected. The CPU 59 specifies the image 80 selected by the electronic pen 40 from the position coordinates of each image displayed on the display device 70 and the position coordinates specified by the controller 56.

Step S102 is a process for displaying an enlargement / reduction bar and a rotation bar. The CPU 59 sets the enlargement / reduction bars 81, 82, 83, 84 and the rotation bars 85, 86, 87, 88 with reference to the position coordinates of the image specified in step S101. Then, the CPU 59 outputs information on the selected image and information on the settings of the enlargement / reduction bars 81, 82, 83, 84 and the rotation bars 85, 86, 87, 88 to the display control circuit 55. Receiving these pieces of information, the display control circuit 55 displays enlargement / reduction bars 81, 82, 83, 84 and rotation bars 85, 86, 87, 88 on the outer periphery of the image displayed on the display device 70 (FIG. 9 ( a)).

Step S103 is a process for determining whether or not there is detection by the touch panel. When performing an editing operation using the electronic pen 40, the input switch 41 of the electronic pen 40 is brought close to or in contact with the first display unit 25. At this time, the input switch 41 of the electronic pen 40 is detected by the touch panel 71. By this detection, the controller 56 specifies the position coordinates where the input switch 41 is detected. The controller 56 outputs position coordinate information to the CPU 59. When the position coordinates information is input, the CPU 59 determines that there is detection by the touch panel 71. In this case, the determination result of step S103 is Yes, and the process proceeds to step S104. On the other hand, when position coordinate information is not input from the controller 56, the CPU 59 determines that there is no detection by the touch panel 71. In this case, the determination result of step S103 is No, and the process returns to step S101.

Step S104 is a process of determining whether or not the detection position on the touch panel is within the area of the enlargement / reduction bar. Based on the determination result in step S103, the position coordinate information detected by the touch panel 71 is input from the controller 56 to the CPU 59. The CPU 59 uses the position coordinates input from the controller 56 to determine whether it is included in any of the enlargement / reduction bars 81, 82, 83, 84. For example, when the position coordinates input from the controller 56 are included in any of the enlargement / reduction bars 81, 82, 83, 84, the CPU 59 sets the determination result in step S104 to Yes. In this case, the process proceeds to step S105. On the other hand, when the position coordinates input from the controller 56 are not included in any of the enlargement / reduction bars 81, 82, 83, 84, the CPU 59 sets the determination result in step S104 to No. In this case, the process proceeds to step S115.

Step S105 is a process for determining whether or not the detection position on the touch panel is moving away from the center of the image. As described above, the input switch of the electronic pen 40 that is in proximity to or in contact with the first display unit 25 is detected by the touch panel 71. The CPU 59 specifies the moving direction of the enlargement / reduction bar specified in step S <b> 105 from the position coordinate information output from the controller 56. If the moving direction is a direction away from the position coordinates of the center C of the image, the CPU 59 sets the determination result in step S105 to Yes. In this case, the process proceeds to step S106. On the other hand, if the moving direction is other than the direction away from the position coordinates of the center of the image, the CPU 59 determines No in step S105. In this case, the process proceeds to step S111.

Step S106 is a process for setting the enlargement ratio of the image. The CPU 59 sets the enlargement ratio of the image 80 using the position coordinates of the input detection position. The image processing circuit 54 executes enlargement processing on the image data that is the basis of the displayed image, using the obtained enlargement ratio information.

Step S107 is a process for resetting the enlargement / reduction bar and the rotation bar. The CPU 59 estimates the size of the image to be enlarged using the enlargement rate set in step S106. The CPU 59 compares the size of the image to be enlarged with the size of the editing screen. In this comparison, when the size of the image to be enlarged is a size that fits within the editing screen, the CPU 59 resets the enlargement / reduction bar and the rotation bar in accordance with the size of the image to be enlarged. On the other hand, when the size of the image to be enlarged is a size that protrudes from the editing screen, the CPU 59 executes the following processing.

The CPU 59 determines whether any of the vertices of the image is included in the editing screen. When any of the vertices of the image is included in the edit screen, the CPU 59 resets the enlargement / reduction bar and the rotation bar in accordance with the sides and vertices displayed on the edit screen in the enlarged image. On the other hand, when all the vertices of the image are out of the editing screen (displaced), the CPU 59 enlarges / reduces the rotation bar and the rotation bar according to the area displayed on the editing screen in the enlarged image. To reset. Note that the information of the enlarged / reduced bar and rotation bar that have been reset is read by the display control circuit 55 together with the image data that has been subjected to the enlargement process.

Step S108 is an enlarged display of the image. The display control circuit 55 displays an image based on the input image data by replacing the previously displayed image. At the time of this display, an enlarged image is displayed so that the center C of the previously displayed image matches the center of the enlarged image. Further, the display control circuit 55 displays one of the operation bars on the peripheral edge of the image based on the reset information about the enlargement / reduction bar and the rotation bar. As shown in FIG. 11, when all the vertices of the image 80 protrude from the editing screen, new enlargement / reduction bars 81 ′, 82 ′, 83 ′, 84 ′ and rotation bars 85 ′, 86 ′, 87 ′. , 88 'are displayed. As shown in FIG. 12, when any one of the vertices of the image 80 (vertex 80a in FIG. 12) is displayed, enlargement / reduction bars 81 and 83 and a rotation bar 85 are displayed.

Step S109 is processing for determining whether or not the detection position on the touch panel has changed. As described above, when the electronic pen 40 is detected by the touch panel 71, the position coordinate of the detection position is specified by the controller 56, and the position coordinate information of the detection position is input to the CPU 59. The CPU 59 refers to the input position coordinate information of the detection position to determine whether or not the detection position has changed. When the detection position on the touch panel 71 has not changed, the CPU 59 determines Yes in step S109. In this case, the process proceeds to step S110.

On the other hand, if the detection position on the touch panel 71 has changed, the CPU 59 sets the determination result in step S109 to No. In this case, the process returns to step S105.

Step S110 is a process of determining whether there is a detection on the touch panel. When the electronic pen 40 is not detected on the touch panel 71, the detection signal is not output from the touch panel 71, and the position coordinate information of the detection position is not output from the controller 56 to the CPU 59. The CPU 59 determines whether or not there is a detection on the touch panel 71 depending on whether or not position coordinate information of the detection position is input. When the position coordinate information of the detection position is not input, the CPU 59 determines that the touch panel 71 is not detected. That is, the CPU 59 sets the determination result in step S110 to Yes, and returns to the process in step S101. On the other hand, when the information of the position coordinates of the detection position is input, the CPU 59 determines that the touch panel 71 is detected. That is, the CPU 59 sets the determination result of step S110 to No, and returns to the process of step S104.

If the determination result of step S105 described above is No, the process proceeds to step S111.

Step S111 is a process for setting an image reduction ratio. When the determination result in step S105 is No, the detected position on the touch panel 71 is moving in a direction approaching the center of the image. In this case, the CPU 59 sets the image reduction ratio using the position coordinates of the input detection position. The image processing circuit 54 executes a reduction process on the image data that is the basis of the displayed image, using the obtained reduction ratio information.

Step S112 is resetting of the expansion / contraction bar and the rotation bar. The CPU 59 estimates the size of the image to be reduced using the reduction rate set in step S111. The CPU 59 compares the size of the image to be reduced with the size of the editing screen. In this comparison, when the size of the image 80 to be reduced is a size that can be accommodated in the editing screen, the CPU 59 adjusts the enlargement / reduction bars 81, 82, 83, 84, and the size of the image 80 to be enlarged. The rotation bars 85, 86, 87, 88 are reset. On the other hand, when the size of the image to be reduced is a size that protrudes from the editing screen, the CPU 59 executes the following processing.

The CPU 59 determines whether any of the vertices of the image is included in the editing screen. If any of the vertices of the image is included in the editing screen, the CPU 59 resets the enlargement / reduction bar and the rotation bar in accordance with the sides and vertices displayed on the editing screen in the reduced image. On the other hand, if all the vertices of the image are out of the editing screen (out of), the CPU 59 enlarges / reduces and rotates the bar in accordance with the area displayed on the editing screen in the reduced image. To reset. Note that the information on the reset enlargement / reduction bar and rotation bar is read by the display control circuit 55 together with the image data subjected to the reduction process.

Step S113 is a reduced display of the image. The display control circuit 55 displays an image based on the input image data by replacing the previously displayed image. At the time of this display, an image reduced so that the center C of the previously displayed image coincides with the center of the reduced image is displayed. Further, the display control circuit 55 displays one of the operation bars on the peripheral edge of the image based on the reset information about the enlargement / reduction bar and the rotation bar. When the process of step S113 is performed, the process proceeds to step S109.

Thereby, the image is enlarged or reduced by the operation of the touch panel 71. When the image is enlarged or reduced, the enlargement / reduction bar and the rotation bar are reset according to the area of the image displayed on the editing screen.

If the determination result of step S104 described above is No, the process proceeds to step S115.

Step S115 is a process of determining whether or not the detection position of the touch panel is within the area of the rotation bar. Based on the determination result in step S103, the position coordinate information detected by the touch panel 71 is input from the controller 56 to the CPU 59. The CPU 59 determines whether or not the position coordinates input from the controller 56 are included in any position coordinate range of the rotation bar. For example, when the position coordinates input from the controller 56 are included in the range of any position coordinates of the rotation bar, the CPU 59 sets the determination result in step S115 to Yes. In this case, the process proceeds to step S116. On the other hand, when the position coordinate input from the controller 56 is not included in any position coordinate range of the rotation bar, the CPU 59 determines No in step S115. In this case, the process proceeds to step S110.

Step S116 is a process for determining whether or not the detection position of the touch panel has moved. When position coordinate information is input from the controller 56, the CPU 59 determines that there is detection by the touch panel 71. In this case, the process proceeds to step S117. On the other hand, when position coordinate information is not input from the controller 56, the CPU 59 determines that there is no detection by the touch panel 71. In this case, the determination process of step S116 is executed until the determination result of step S116 is Yes.

Step S117 is a process for setting the rotation angle of the image. The CPU 59 sets the rotation angle of the image 80 based on the position coordinate information output from the controller 56. The image processing circuit 54 performs rotation processing on the image data that is the basis of the displayed image 80 using the information on the obtained rotation angle.

Step S118 is a process for resetting the enlargement / reduction bar and the rotation bar. The CPU 59 determines whether or not the image 80 rotated at the rotation angle set in step S117 fits on the editing screen. In this determination, if the rotated image fits within the editing screen, the CPU 59 re-scales the enlargement / reduction bars 81, 82, 83, 84 and the rotation bars 85, 86, 87, 88 according to the rotated image. Set. On the other hand, when the rotated image 80 protrudes from the editing screen, the CPU 59 executes the following processing.

The CPU 59 determines whether any of the vertices of the image is included in the editing screen. When any of the vertices of the image is included in the editing screen, the CPU 59 resets the enlargement / reduction bar and the rotation bar in accordance with the sides and vertices included in the editing screen in the rotated image. On the other hand, when all the vertices of the image protrude from the editing screen, the CPU 59 resets the enlargement / reduction bar and the rotation bar in accordance with the area displayed on the editing screen in the rotated image. It should be noted that the reset information about the enlargement / reduction bar and the rotation bar is read by the display control circuit 55 together with the image data subjected to the rotation process.

Step S119 is a rotation display of the image. The display control circuit 55 replaces the image displayed on the display device 66 with the newly acquired rotated image. At this time, the center of the newly displayed image is displayed so as to coincide with the center C of the original image 80. Further, the display control circuit 55 displays one of the operation bars on the peripheral edge of the image based on the reset information about the enlargement / reduction bar and the rotation bar.

Step S120 is a process for determining whether or not the detection position on the touch panel has changed. As described above, when the electronic pen 40 is detected by the touch panel 71, the position coordinate of the detection position is specified by the controller 56, and the position coordinate information of the detection position is input to the CPU 59. The CPU 59 refers to the input position coordinate information of the detection position to determine whether or not the detection position has changed. When the detection position on the touch panel 71 has not changed, the CPU 59 determines Yes in step S120. In this case, the process proceeds to step S110.

On the other hand, if the detection position on the touch panel 71 has changed, the CPU 59 sets the determination result in step S120 to No. In this case, the process returns to step S117.

In this way, even when the image is rotated, the operation bar is reset according to the rotation angle of the image.

Next, the image trimming process will be described. For example, when an image is displayed on the editing screen of the first display unit 25, when the electronic pen 40 is moved along the region intended by the user, the inner region is trimmed. For example, as shown in FIG. 16A, when the trimming process is performed on the person image 110, the electronic pen 40 is moved with respect to the person area (see FIG. 16B). When the movement of the electronic pen 40 is completed, the inner area is cut out, and an image 111 based on the cut out area is obtained (see FIG. 16C).

Here, when the image 110 is selected before the trimming process, operation bars (enlargement / reduction bars 81, 82, 83, 84 and rotation bars 85, 86, 87, 88) are displayed along the outer periphery of the rectangular image 110. (See FIG. 16D). On the other hand, for the trimmed image, for example, rectangular operation bars (enlargement / reduction bars 81 ″, 82 ″, 83 ″, 84 ″ and rotation bars 85 ″, 86 so as to circumscribe the trimmed area). ", 87", 88 ") is displayed (see FIG. 16E). If a rectangular area is trimmed with the electronic pen 40, an operation bar is displayed along the outer periphery of the trimmed rectangular area.

In this trimming process, the trimming process once executed may be performed again. In this case, in the image 110, the area cut out by the previously performed trimming process (area corresponding to the image 111) is displayed as it is, and the other area that has not been cut out by the trimming process (FIG. 16 (f) with diagonal lines). The area shown) is translucent. Then, the operation bar display for the image 111 obtained by the trimming process is canceled, and the operation bar is displayed for the original image 110 (see FIG. 16F). When the trimming process is performed again, data relating to the trimmed area and image data may be stored in association with each other.

By performing such a display, the trimming process for the image displayed on the editing screen can be reset to a different area. Further, by displaying the area deleted by the trimming process in a translucent manner, it is possible to execute the trimming process again while confirming the area in the trimming process that has been executed once.

In the present embodiment, a case has been described in which an operation bar including an enlargement / reduction bar and a rotation bar is used as a control point. However, the present invention is not limited to this. Even when a point is provided, the present invention can be applied. In other words, the control point provided at the end of each side (the position to be the vertex) is used as a control point for rotating the image, and the control point provided at the midpoint of each side is used for enlarging or reducing the image. It can be a control point.

In recent years, electronic photo albums that are widely used include those in which images are arranged at predetermined intervals, and those in which a plurality of images are arranged by overlapping a part of images. A photo album in which a plurality of images are arranged by overlapping a part of images tends to be visually effective compared to a photo album in which images are arranged at predetermined intervals. When a plurality of images are arranged by overlapping a part of the images, there is a display that adjusts the gradation of the overlapping images for each layer so that the superimposed state can be recognized (Japanese Patent No. 3380692). .

In such a display method, for example, when there is an image that becomes a hierarchical variable smaller than the hierarchical variable of the designated image, the other hierarchical variable is incremented by 1 and the hierarchical variable of the designated image is changed to 0. The hierarchical structure is changed so that the designated image is the top layer. However, in this method, when changing the hierarchical structure when three or more images are overlapped, it is necessary to repeatedly specify the images a plurality of times, which is troublesome.

Therefore, an image editing apparatus typified by the portable electronic information terminal taken as an example in the present embodiment aims to easily replace the hierarchical structure when a plurality of images are superimposed with a simple operation. .

Hereinafter, a case where one of the three image layers is replaced when three images are displayed on the editing screen in an overlapping manner will be described. The operation of exchanging images is a process executed when, for example, a plurality of images are combined with a part of the images superimposed. When the images are displayed in a superimposed manner, a display order indicating the image hierarchy is assigned to each image.

First, the operation for switching the display order of two images will be described. As shown in FIG. 17, in the editing screen displayed on the first display unit 25, the case where the image P1 is arranged so as to cover a part of the image P2, that is, the image P1 is the uppermost layer. Think. That is, in this case, the display order of the image P1 is “1”, and the display order of the image P2 is “2”.

First, the image P2 displayed on the first display unit 25 is selected using the electronic pen 40. Here, the selection of the image is executed by bringing the input switch 41 of the electronic pen 40 into contact with or close to the area of the image displayed on the editing screen of the first display unit 25. If the electronic pen 40 is moved in the y direction after the selection of the image P2, the image P2 moves in the y direction in accordance with the movement of the electronic pen 40. Due to the movement of the image P2, the superposition of the image P1 and the image P2 is once released. As shown in FIG. 18, when the electronic pen 40 moves to move the lower end of the image P <b> 2 to a position where the lower end of the editing screen of the first display unit 25 comes into contact, the display order of the two images is changed. Allowed.

On the other hand, when the contact or proximity between the electronic pen 40 and the first display unit 25 is released before the lower end of the image P2 is brought into contact with the lower edge of the editing screen of the first display unit 25, Changing the display order of the two images is not permitted. In this case, the moved image P2 may be automatically returned to the original position, or may be held at a position where the contact or proximity between the electronic pen 40 and the first display unit 25 is released.

Thereafter, when the electronic pen 40 is moved in the -y direction, the image P2 moves so as to cover a part of the image P1 (see FIG. 19). That is, the display order of the image P1 and the image P2 is switched. That is, the display order of the image P1 is “2”, and the display order of the image P2 is “1”. At this time, it is not necessary to return to the position before the display order of the image P2 is changed, and the electronic pen 40 and the first display unit 25 may be held at the position when the contact or proximity is released. Note that when the contact or proximity between the electronic pen 40 and the first display unit 25 is released immediately after the change of the display order of the two images is permitted, before the state in which the positions of the images P2 are overlapped is released. It is also possible to automatically return to the position.

Although the image P2 is moved, it is also possible to move the image P1 to cancel the overlapping of the image P1 and the image P2, and to overlap the image P2 and the image P1 again. In this case, the display order of the image P1 is “1” and the display order of the image P2 is “2”. In this case, the display order of the image P1 is “2” and the display order of the image P2 is “1”. Be changed.

Further, the image P2 is moved in the y direction to the lower edge of the editing screen, but is not limited to this, and is moved to any of the upper edge, the left edge, or the right edge of the editing screen. Also good.

Moreover, although the case where the target image is moved to one edge of the editing screen has been described, it is not necessary to be limited to this, for example, when the overlay with another image is canceled, for example, other After being overlaid with an image, changing the display order of the images is allowed when the image is moved to a position separated by a certain distance from another image or moved (slid) by a predetermined amount. It may be.

In addition to the above, instead of moving the selected image, only one of the plurality of images displayed in an overlapping manner on the first display unit 25 is selected by the input operation of the electronic pen 40. When the display order is changed or when the input operation with the electronic pen 40 is a long press operation, the display order of the selected images may be changed.

Here, when a plurality of images overlap, an image with a high display order covers an image with a low display order. Therefore, an image with a low display order is generally displayed in a state hidden behind an image with a high display order. However, an image with a low display order does not need to be hidden in an image with a high display order. For example, each image is displayed so that an image with a low display order can be seen through from an image with a high display order. It is also possible. In this case, mask processing is performed on an image having a high display order, and the transparency of the image is changed. This masking process may be performed only on the entire image or only on an area overlapping with an image with a low display order.

Next, the operation when replacing one of the three image layers will be described. As shown in FIG. 20, a case is considered where three images of an image P3, an image P4, and an image P5 are displayed on the editing screen displayed on the first display unit 25. Consider a case where the display order of the image P3 is “3”, the display order of the image P4 is “2”, and the display order of the image P5 is “1”.

First, the image P5 displayed on the first display unit 25 is selected using the electronic pen 40. When the electronic pen 40 is moved in the G direction in FIG. 21 after the selection of the image P5, the image P5 moves in the same direction as the movement direction of the electronic pen 40. At this time, the superposition of the image P4 and the image P5 is once released. When the electronic pen 40 moves to a position where the upper edge of the image P5 comes into contact with the upper edge of the editing screen, the display order of the image P5 and other images is allowed to be changed.

Thereafter, when the electronic pen 40 is moved in the H direction in FIG. 22, the image P <b> 5 moves in the same direction as the movement direction of the electronic pen 40. Then, when the moving image P5 is brought close to another image, the following processing is executed.

For example, when both the distance D1 from the center C5 of the image P5 to the center C3 of the image P3 and the distance D2 from the center C5 of the image P5 to the center C4 of the image P4 are equal to or less than a preset threshold value, the movement is performed. An image P5 to be inserted is inserted between the images P3 and P4 (see FIG. 23). That is, the display order of the image P3 is changed to “3”, the display order of the image P4 is “1”, and the display order of the image P5 is changed to “2”.

On the other hand, a case where either one of the distance D1 from the center C5 of the image P5 to the center C3 of the image P3 and the distance D2 from the center C5 of the image P5 to the center C4 of the image P4 is equal to or less than a preset threshold value will be described. To do. As shown in FIG. 24, after the image P5 is brought into contact with the upper edge of the editing screen, it is moved in the J direction in FIG. At this time, a case is considered where the distance D1 from the center C5 of the image P5 to the center C3 of the image P3 is equal to or less than the threshold, and the distance D2 from the center C5 of the image P5 to the center C4 of the image P4 exceeds the threshold. In such a case, as shown in FIG. 25, when the moved image P5 is moved to the original position (moved in the K direction in FIG. 25), a part of the image P5 is not only the image P4 but also the image P3. It will be in the state covered by. In this case, the display order of the image P3 is “2”, the display order of the image P4 is “1”, and the display order of the image P5 is “3”. In such a case, the display order of the image P3 and the image P5 is changed, but the display order of the image P3 and the image P4 is maintained without being changed, so that the display order of the image P4 is “1”. It becomes.

Next, the flow of processing when combining a plurality of images will be described with reference to the flowchart of FIG.

Step S201 is a process of reading an image. The CPU 59 reads image data from the data memory 61. The image data read from the data memory 61 is image data selected by the electronic pen 40.

Step S202 is processing for determining whether or not to process the read image. Here, processing the read image includes, for example, image trimming processing, image processing such as gradation correction, and the like. If the input operation with the electronic pen 40 is an operation for processing the image, the CPU 59 sets the determination result in step S202 to Yes. In the case of other operations, the CPU 59 sets the determination result in step S202 to No.

Step S203 is a process for processing an image. The CPU 59 reads the image data designated in step S201 from the data memory 61 and outputs it to the display control circuit 55. The display control circuit 55 displays an image based on the input image data on the display device 70. Thereafter, in accordance with the operation with the electronic pen 40, the processing for the image displayed on the display device 70 of the first display unit 25 is executed. The processed image data is temporarily stored in the buffer memory 53.

Step S204 is a process for determining whether or not another image has been read. If the input operation with the electronic pen 40 is not an operation for reading another image, the CPU 59 sets the determination result in step S204 to Yes, and proceeds to step S205. On the other hand, if the input operation with the electronic pen 40 is an operation for reading out another image, the CPU 59 determines No in step S204 and returns to step S201. That is, the processes in steps S201 to S204 are repeated until all the images necessary for image composition are read out.

Step S205 is a process for temporarily arranging images. The display control circuit 55 temporarily arranges the image read in step S201 to step S204 in the editing screen displayed on the first display unit 25. The temporary placement of the image may be performed using a template for image composition, or the temporary placement of the image may be performed by placing the image read by the operation of the electronic pen 40 at a position intended by the user. Is possible. At this time, the display control circuit 55 temporarily positions each read image so that a part of the image overlaps. Then, the display control circuit 55 gives information related to the display order to each temporarily arranged image.

Step S206 is a process for changing the display order of the images. The processing in step S206 is executed by moving any of the images in the editing screen by operating the electronic pen 40.

Step S207 is a process for finely adjusting the arrangement of the images. When the input switch 41 of the electronic pen 40 comes into contact with or comes close to the first display unit 25, it is detected by the touch panel 71. In response to the detection by the touch panel 71, the controller 56 acquires the position coordinate information of the electronic pen 40. The CPU 59 specifies an image to be displayed on the display device 70 from the position coordinate information acquired by the controller 56. When the electronic pen 40 that is in contact with or close to the first display unit 25 moves, information on the position coordinates of the detected electronic pen 40 is input to the CPU 59. The CPU 59 obtains the movement direction and movement amount of the electronic pen 40 and outputs the obtained movement direction and movement amount of the electronic pen 40 to the display control circuit 55. The display control circuit 55 moves the image selected based on the moving direction and moving amount of the electronic pen 40. In this way, the position of each image displayed on the first display unit 25 is finely adjusted.

Step S208 is a process of recording an image. The CPU 59 acquires the position coordinate information and the display order information of each image when the process of step S207 is executed, and outputs it to the image processing circuit 54. The image processing circuit 54 reads out the image data that is the basis of the displayed image from the data memory 61. Then, the image processing circuit 54 synthesizes these image data based on the position coordinate information and display order information of each image. Then, the image processing circuit 54 records the combined image data in the data memory 61 as, for example, JPEG format image data.

In the flowchart of FIG. 26, the image is read from the data memory 61 by performing the processing of step S201 to step S204. However, the present invention is not limited to this, and is displayed on the library screen of the second display unit 28. A plurality of images may be moved from the second display unit 28 to the first display unit 25.

Next, processing for changing the display order of images will be described based on the flowchart of FIG.

Step S301 is a process of determining whether or not an image whose display order is to be changed (hereinafter referred to as a target image) is selected. When the electronic pen 40 is brought into contact with or close to the touch panel 71, the touch panel 71 detects the position of the electronic pen 40 and outputs a detection signal to the controller 56. The controller 56 acquires position coordinate information from the detection signal output from the touch panel 71. The acquired position coordinate information of the electronic pen 40 is output to the CPU 59. The CPU 59 specifies the image at the position where the electronic pen 40 is detected from the position coordinate information of the electronic pen 40 output from the controller 56 and the position information of the image displayed on the display device 70. Whether or not there is a selection of the target image is determined depending on whether or not there is an image at a position where the electronic pen 40 is detected. For example, if there is an image at the position where the electronic pen 40 is detected, the CPU 59 sets the determination result in step S301 to Yes, and proceeds to step S302. On the other hand, if there is no image at the position where the electronic pen 40 is detected, or if there is no detection of the electronic pen 40, the CPU 59 determines No in step S301 and ends this flowchart.

Step S302 is a process of moving the target image. When the electronic pen 40 is moved, the touch panel 71 detects the position of the moving electronic pen 40. The controller 56 acquires the position coordinate information of the electronic pen 40 based on the detection signal from the touch panel 71. Information on the position coordinates is input to the CPU 59. The CPU 59 outputs the target image information and the input position coordinate information to the display control circuit 55. In response to this, the display control circuit 55 moves the position of the target image displayed on the display device 70 based on the information on the target image and the information on the position coordinates. Accordingly, when the electronic pen 40 that is in contact with or close to the touch panel 71 is moved, the target image moves in the same direction as the electronic pen 40 moves.

Step S303 is processing for determining whether or not the image has moved to the edge of the screen. The CPU 59 acquires information on the size of the editing screen (positional coordinates of the four corners) displayed on the display device 70 and the size of the target image (positional coordinates of the four corners of the image). Further, as described above, position coordinate information is input from the controller 56. From these pieces of information, the CPU 59 determines whether or not the moving target image has reached the end of the editing screen. If the target image to be moved has reached the end of the editing screen, the CPU 59 determines that the target image has moved to the end of the screen. In this case, the determination result of step S303 is Yes, and the process proceeds to step S304. On the other hand, if the target image to be moved has not reached the end of the editing screen, the CPU 59 determines that the target image has not moved to the end of the screen. In this case, the determination result of step S303 is No. In this case, the process proceeds to step S306.

Step S304 is a process of permitting the display order to be changed. As illustrated in FIG. 17, when the target image is arranged so as to overlap with another image, such as a part of the image P1 is covered with another image P2, the CPU 59 sets the determination result in step S303 as Yes. By doing this, it is permitted to change the display order of the images. Then, the CPU 59 executes a process of replacing the display order information of the moving target image with the display order information of other images arranged so as to overlap the target image.

Step S305 is processing for rearranging the target images. As described above, the movement of the electronic pen 40 is detected by the touch panel 71, and the position coordinates at which the electronic pen 40 is detected are acquired by the controller 56. The CPU 59 outputs the position coordinate information acquired by the controller 56 and the target image information to the display control circuit 55. In response to this, the display control circuit 55 displays the target image on the display device 70 in a state where the position of the target image has been moved based on the input position coordinate information. In step S304, a process of switching the display order of the target image and the display order of other images is performed. By performing this process, when the target image is moved so that the target image and another image overlap each other, the target image is rearranged in a state where a part of the other image is covered.

If it is determined in step S303 that the target image has not been moved to the screen edge, the process proceeds to step S306.

Step S306 is a process for determining whether or not to stop changing the display order. The determination process in step S306 is executed based on the operation of the electronic pen 40. If the contact or proximity between the electronic pen 40 and the touch panel 71 is released before the target image is moved to the screen edge, the detection of the electronic pen 40 by the touch panel 71 ends. The CPU 59 executes the determination result of step S306 depending on whether or not position coordinate information is input from the controller 56 in a state where the target image has not reached the screen edge. For example, when the position coordinate information of the electronic pen 40 is not input, the CPU 59 determines that the change of the image display order is to be stopped. In this case, the CPU 59 sets the determination result in step S306 to Yes, and returns to step S301. At this time, the CPU 59 outputs a signal indicating that the target image is returned to the original position to the display control circuit 55. Upon receiving this signal, the display control circuit 55 moves the target image to the original position. Note that the target image may be held at the position where the detection of the electronic pen 40 is completed without being moved to the original position.

On the other hand, if the position coordinate information of the electronic pen 40 is input from the controller 56 to the CPU 59, the CPU 59 determines that the change of the display order is not stopped. In this case, the CPU 59 sets the determination result in step S306 to No, and returns to step S303.

In this way, the display order of the target image and other images can be switched by moving the target image to the edge of the editing screen.

Finally, the flow of processing for rearranging the target image will be described based on the flowchart of FIG.

Step S401 is a process of moving the target image toward another image. When the electronic pen 40 is moved, the touch panel 71 detects the position of the moving electronic pen 40. The controller 56 acquires the position coordinate information of the electronic pen 40 based on the detection signal from the touch panel 71. Information on the position coordinates is input to the CPU 59. The CPU 59 outputs the target image information and the input position coordinate information to the display control circuit 55. In response to this, the display control circuit 55 moves the position of the target image displayed on the display device 70 based on the information on the target image and the information on the position coordinates. Accordingly, when the electronic pen 40 that is in contact with or close to the touch panel 71 is moved, the target image moves in the same direction as the electronic pen 40 moves.

Step S402 is processing for determining whether or not the target image has moved to the vicinity of another image. The CPU 59 refers to the position coordinate information output from the controller 56 and the position coordinates of another image to determine whether or not the target image has moved to the vicinity of the other image. For example, the CPU 59 calculates a distance from the center of the target pixel to the center of another image for each image. Then, the CPU 59 determines that the target image has moved to the vicinity of another image when any of the distances calculated for each image is equal to or less than the determination threshold value in step S402. When the target image has moved to the vicinity of another image, the CPU 59 determines Yes in step S402. In this case, the process proceeds to step S403. On the other hand, when the target image has not moved to the vicinity of another image, the CPU 59 determines No in step S402. In this case, the process returns to step S401.

Step S403 is processing for determining whether there are two images within a predetermined distance. In the process of step S402, the CPU 59 calculates the distance between the center of the target image and the center of another image for each image. The CPU 59 determines whether there are two or more images whose distance from the center of the target image is equal to or less than a threshold value. For example, when there are two images whose distance from the center of the target image is equal to or less than the threshold, the CPU 59 sets the determination result in step S403 to Yes, and proceeds to step S404.

Step S404 is a process of changing the display order of the target images between the display orders of the two images. The CPU 59 refers to information related to the display order of two images close to the target image. Then, the CPU 59 changes the display order of each image so that the display order of the target image is located between the display orders of two images close to the target image. Based on this change in the display order, the moved target image is inserted between two adjacent images. As shown in FIGS. 22 and 23, when the image P5 is the target image, the display order of each image is changed so that the image P5 is inserted between the image P3 and the image P4, and the display is changed. The image P5 is arranged according to the order.

On the other hand, in the determination process of step S403, if there are no two images within the predetermined distance, the CPU 59 sets the determination result of this step S403 to No, and proceeds to step S405.

Step S405 is a process of changing the display order of the target image and the adjacent image. The CPU 59 identifies an image that falls within a predetermined range in the determination process in step S403. The CPU 59 refers to information on the display order of images close to the target image. Then, the CPU 59 changes the display order of the target image and the display order of images close to the target image. When the target image is moved by changing the display order of these images, the target image is inserted between two adjacent images. As shown in FIGS. 24 and 25, if the image P5 is close to the image P3, the display order of the image P5 and the display order of the image P3 are respectively changed. Therefore, the image P5 is arranged so that a part of the moved image P5 is covered with the image P3.

Thus, by moving the target image to the edge of the screen, it is allowed to change the display order of the images arranged in the screen, and the target image is changed to another image whose display order is changed. By bringing them closer, the display order of the target image and other images are automatically switched. According to this, for example, when a plurality of images are superimposed and combined, the display order of the images to be combined can be switched with a simple operation.

In addition, various electronic information terminals such as mobile phones and tablet terminals capable of browsing texts and images are provided. In such an electronic information terminal, when browsing an image or text, an image is switched or pages are turned by an input operation on a touch panel provided in the display unit. In recent years, there has also been provided a device in which characters can be input by handwriting by an input operation on a touch panel using a pen-type pointing device (see Japanese Patent Laid-Open No. 2000-163193). By enabling such an input operation, the user can experience the operation of reading a book and writing characters and drawing using an electronic information terminal.

However, in such an electronic information terminal, when an input character or drawing is deleted or an input character or drawing is transmitted to another electronic information terminal, an operation button associated in advance is operated. Is common. For this reason, when performing these operations, the actual operation cannot be experienced on the portable electronic information terminal. Therefore, the portable electronic information terminal of the present invention aims to experience actual operation on the terminal.

As described above, the portable electronic information terminal 10 of the present invention performs an operation (hereinafter referred to as a handwriting input operation) for performing handwriting input on a page displayed as an editing screen displayed on the first display unit 25. In addition, it is possible to execute an operation of separating a page input by handwriting. Here, the operation of separating the page input by handwriting corresponds to the operation of breaking the page in an actual notebook. Here, the input operation for separating the pages is executed when the content input by handwriting is transmitted to another user or when the content input by handwriting is deleted.

As shown in FIG. 29, the page displayed as the editing screen on the first display unit 25 is composed of an area A1 for performing a handwriting input operation using the electronic pen 40 and an area A2 for performing an input operation for separating the pages. The In the area A1 where the handwriting input operation is performed, in addition to the handwriting input operation, an operation for arranging an image or an illustration image is possible. On the other hand, in the area A2 where the input operation for separating pages is performed, the electronic pen 40 is moved from the upper end of the first display unit 25 to the lower end (y direction in FIG. 29) or from the lower end of the first display unit 25. Only an input operation by moving the electronic pen 40 toward the upper end (-y direction in FIG. 29) can be performed. When the movement of the electronic pen 40 from the upper end portion to the lower end portion of the first display unit 25 is interrupted in the area A2 where the input operation for separating pages is performed, this input operation is invalid. Here, the area A2 where the input operation for separating pages is performed may be displayed on the first display unit 25 or may not be displayed.

In addition, although the area A2 for performing an input operation for separating the page is provided, the present invention is not limited to this, and it is possible to display a perforation indicating a position where the page can be separated. As shown in FIG. 30A, a perforation 120 formed of a straight line along the y direction in FIG. 30A is displayed on the left end portion of the first display unit 25. In this case, the user may move the electronic pen 40 along the perforation 120 after bringing the electronic pen 40 into contact with the first display unit 25 at the upper end or the lower end of the perforation 70. The number of perforations is not necessarily one, and two or more perforations can be displayed.

Further, the perforation is a straight line along the y direction in FIG. 30A, but is not limited to this, and may be a straight line along the x direction in FIG. 30B. In this case, it is also possible to display a perforation 120 composed of a straight line along the y direction and a perforation 121 composed of a straight line extending in the x direction, one end of which intersects the perforation 120. Note that the number of perforations 121 formed of straight lines extending in the x direction is not limited to one, and two or more perforations 121 may be provided.

Hereinafter, the operation when transmitting the contents input by handwriting to the user's intended partner will be described. As shown in FIG. 31A, when a user performs a handwriting input operation on the area A1 of the page displayed as the editing screen using the electronic pen 40, characters and sentences based on the handwriting input operation are edited. Displayed on the screen. After this handwriting input operation is performed, the user brings the electronic pen 40 into contact with the upper end portion of the area A2 of the editing screen. Thereafter, the user moves the electronic pen 40 from the upper end portion of the first display unit 25 to the lower end portion (in the y direction in the figure). When the electronic pen 40 is moved, the first display unit 25 performs a moving image display showing a state of separating (breaking) the page. After moving image display showing a state of separating pages is performed, the separated page 125 is displayed on the first display unit 25 (see FIG. 31B). Note that the electronic pen 40 is moved from the upper end portion to the lower end portion of the area A2 on the editing screen. However, the present invention is not limited to this, and it is directed from the lower end portion to the upper end portion of the area A2 on the editing screen. Even if moved, the page can be separated in the same manner.

As shown in FIG. 31 (b), when the separated page 125 is displayed on the first display unit 25, a destination address list is displayed on the second display unit 28. Here, the destination address list displayed on the second display unit 28 is desirably displayed automatically, but the user may display the address list using the electronic pen 40. When the address list as the transmission destination is displayed on the second display unit 28, the user uses the electronic pen 40 to select the intended partner's address. When the address of the other party is selected, the first display unit 25 displays a moving image indicating that the separated page 125 is folded and sealed. Thereafter, the sealed page 125 is turned over and displayed as an envelope 126. At this time, the name and address of the other party as the transmission destination are attached to the envelope 126 (see FIG. 32).

As shown in FIG. 32, after the user brings the electronic pen 40 into contact with the first display unit 25, an operation of paying the electronic pen 40 toward the upper end side of the first display unit 25 (in the direction of the arrow in FIG. 32). Do. In response to the operation of the electronic pen 40, a moving image showing how the envelope 126 is transmitted to the other party is displayed on the first display unit 25. Note that after this display, a page that has not been handwritten is displayed as an editing screen.

As described above, the operation of separating the page 125 is executed not only when the content input by handwriting is transmitted as an email but also when the content input by handwriting is deleted.

Also when deleting the contents of handwritten input, the electronic pen 40 is brought into contact with the upper end of the area A2 of the page displayed on the first display unit 25 and moved toward the lower end of the area A2. As a result, the page in which characters and sentences are input by handwriting is separated, and the separated page 75 is displayed on the first display unit 25 (see FIG. 31B).

As illustrated in FIG. 33A, after the separated page 125 is displayed on the first display unit 25, the user uses the electronic pen 40 to display “ Enter "x" by handwriting. Based on the input operation of the electronic pen 40, for example, “x” is displayed on the separated page 125 (see FIG. 33B).

In this state, the user brings the electronic pen 40 into contact with the first display unit 25 and executes an operation of paying the electronic pen 40 in either the x direction or the −y direction in FIG. In response to the operation of the electronic pen 40, a moving image showing how the separated page 125 is discarded is displayed. After this moving image is displayed, a page that has not been handwritten is displayed on the first display unit 25 as an editing screen.

Hereinafter, the flow of the process of sending an email using the contents input by handwriting and the process of deleting the contents input by handwriting will be described with reference to the flowchart of FIG. The process of the flowchart in FIG. 34 is executed when the handwriting input operation using the electronic pen 40 by the user is completed. Hereinafter, processing from step S501 to step S510, which will be described later, is processing for transmitting an email using the contents input by handwriting.

Step S501 is processing for determining whether or not there is an input operation for separating pages. The controller 56 receives the detection signal from the touch panel 71 of the first display unit 25, and acquires information indicating the type of the display unit from which the detection signal is output, and coordinate data based on the detection signal. These pieces of information are output from the controller 56 to the CPU 59.

For example, if the coordinate data output from the controller 56 indicates that the input operation of the electronic pen 40 moves from the upper end to the lower end of the area A2, or moves from the lower end to the upper end of the area A2. The CPU 59 determines that the operation is an input operation for separating pages. In this case, the determination result in step S501 is Yes, and the process proceeds to step S502.

On the other hand, if the coordinate data output from the controller 56 does not indicate that the input operation of the electronic pen 40 moves from the upper end to the lower end of the area A2 or moves from the lower end to the upper end of the area A2. The CPU 59 determines that this is not an input operation for separating pages. In this case, the determination result of step S501 is No, and the flowchart of FIG. 34 ends.

Step S502 is a process of displaying a moving image showing a state of separating pages. The CPU 59 instructs the display control circuit 55 to display a moving image that shows how the page is cut off. The display control circuit 55 displays on the display device 70 of the first display unit 25 a moving image based on the moving image data indicating how the page is cut off. Thereby, the moving image which shows a mode that the page is cut off is displayed on the first display unit 25. Note that moving image data indicating a state of separating pages is stored in the data memory 61 in advance.

Step S503 is a process for displaying the separated page. The CPU 59 outputs input data obtained by handwriting input operation of the electronic pen 40 to the display control circuit 55. The display control circuit 55 displays an image based on the image data indicating the separated page on the display device 70 of the first display unit 25 using the image data indicating the separated page and the input data. Thereby, the separated page is displayed. Note that image data indicating the separated page is stored in the data memory 61 in advance.

Step S504 is a process of displaying an address list on the second display unit. The CPU 59 reads the address data stored in the built-in memory 60 and outputs it to the display control circuit 55. The display control circuit 55 refers to the address data and displays the address list on the display device 72 of the second display unit 28.

Step S505 is processing for determining whether or not an input operation indicating address selection has been performed. The controller 56 receives a detection signal from the touch panel 73 of the second display unit 28, and acquires information indicating the type of the display unit from which the detection signal is output and coordinate data based on the detection signal. These pieces of information are output from the controller 56 to the CPU 59.

CPU59 determines whether it is coordinate data based on the detection signal of the touch panel 73 of the 2nd display part 28 from the information which shows the classification of a display part among the information output from the controller 56. FIG. When it is determined that the coordinate data is based on the detection signal of the touch panel 73 of the second display unit 28, the CPU 59 sets the determination result in step S505 to Yes. In this case, the process proceeds to S506. On the other hand, when the coordinate data is not based on the detection signal of the touch panel 73 of the second display unit 28, the CPU 59 sets the determination result of step S505 to No. In this case, the process proceeds to step S511.

Step S506 is a process for generating transmission data. The CPU 59 acquires address data corresponding to the input coordinate data. Further, the CPU 59 generates transmission data by using the input data obtained during the handwriting input operation and the acquired address data.

Step S507 is a process of displaying a moving image showing a state where the page is folded and sealed. The CPU 59 instructs the display control circuit 55 to display a moving image. At the time of this instruction, the CPU 59 outputs address data to the display control circuit 55. The display control circuit 55 displays the moving image based on the moving image data on the display device 70 of the first display unit 25 using the moving image data and the address data indicating that the page is folded and sealed. As a result, after the page is folded and sealed, a moving image showing how the sealed page is turned over is displayed on the first display unit 25. Moving image data showing a state where the page is folded and sealed is stored in the data memory 61 in advance.

Step S508 is processing for determining whether or not there is an input operation indicating transmission. As described above, when mail is transmitted, the user performs an operation of paying the electronic pen 40 in the −y direction in FIG. 32 after bringing the electronic pen 40 into contact with the first display unit 25. By performing this operation, a detection signal for detecting the electronic pen 40 is sequentially output from the touch panel 71 to the controller 56. The controller 56 outputs coordinate data based on the detection signals output sequentially to the CPU 59. The CPU 59 specifies the moving direction of the electronic pen 40 based on the input coordinate data. When the moving direction of the electronic pen 40 is the -y direction in FIG. 10, the CPU 59 determines that there is an input operation indicating transmission. In this case, the determination result of step S508 is Yes, and the process proceeds to step S509. On the other hand, when the moving direction of the electronic pen 40 is other than the −y direction in FIG. 10 or when it is determined that the electronic pen 40 is not moving, the CPU 59 determines that there is no input operation indicating transmission. . In this case, the process is repeatedly executed until the determination result in step S508 becomes Yes.

Step S509 is processing for transmitting transmission data. The CPU 59 transmits transmission data via the communication unit 62.

Step S510 is a process for displaying a moving image showing a state of sending an email. The CPU 59 instructs the display control circuit 55 to display a moving image. The display control circuit 55 displays the moving image based on the moving image data on the display device 70 of the first display unit 25 using the moving image data indicating a state of transmitting the mail. As a result, a moving image showing a state of transmitting the mail is displayed on the first display unit 25. By performing this process, the mail with the contents input by handwriting is transmitted to the portable electronic information terminal owned by the other party intended by the user.

If the determination result in step S505 described above is No, the process proceeds to step S511. In addition, the process of step S511 to step S514 mentioned later becomes a process which deletes the content input by handwriting.

Step S511 is processing for determining whether or not there is an input operation of “x” on the page.

When a handwriting input operation using the electronic pen 40 is performed, input data based on the handwriting input operation is acquired. The CPU 59 determines whether or not the character by handwriting input to the first display unit 25 is “x” using the input data. If the character by handwriting input is “x”, the CPU 59 determines Yes in step S511. In this case, the process proceeds to step S512. On the other hand, when the character by handwriting input is not "x", CPU59 makes the process of step S511 No and returns to step S505.

Step S512 is a process for determining whether or not there is an input operation for deleting the contents input by handwriting. When deleting the content input by handwriting, after the user brings the electronic pen 40 into contact with the first display unit 25, the user pays the electronic pen 40 in either the x direction or the y direction in FIG. Perform the action. By performing this operation, a detection signal for detecting the electronic pen 40 is sequentially output from the touch panel 71 to the controller 56. The controller 56 outputs coordinate data based on the detection signals output sequentially to the CPU 59. The CPU 59 specifies the moving direction of the electronic pen 40 based on the input coordinate data. When the moving direction of the electronic pen 40 is either the x direction or the y direction in FIG. 33B, the CPU 59 determines that there is an input operation for deleting the contents input by handwriting. In this case, the determination result of step S512 is Yes, and the process proceeds to step S513. On the other hand, when the moving direction of the electronic pen 40 is other than the x direction or the y direction in FIG. 33B, or when it is determined that the electronic pen 40 is not moving, the CPU 59 It is determined that there is no input operation for deleting the contents input by handwriting. In this case, the process is repeatedly executed until the determination result in step S512 becomes Yes.

Step S513 is a process for deleting the input content. Input data obtained by handwriting input operation with the electronic pen 40 is stored in the built-in memory 60. The CPU 59 deletes input data stored in the built-in memory 60.

Step S514 is a process of displaying a moving image showing a state of discarding the page. The CPU 59 instructs the display control circuit 55 to display a moving image. The display control circuit 55 displays the moving image based on the moving image data on the display device 70 of the first display unit 25 using the moving image data indicating that the page is discarded. Accordingly, a moving image for discarding the page is displayed on the first display unit 25.

On the other hand, when the portable electronic information terminal 10 receives a mail, the envelope 126 is displayed on the first display unit 25. When an input operation is performed on the first display unit 25 with the electronic pen 40 while the envelope 126 is displayed, a moving image display for opening the envelope 126 is performed, and the opened page is displayed (not shown). ). This display makes it possible to read the received mail.

As described above, in the portable electronic information terminal 10 of the present embodiment, when the content input by handwriting is transmitted to the portable electronic information terminal owned by another user, or when the content input by handwriting is deleted. First, an operation of separating a page input by handwriting by an input operation of the electronic pen 40 is performed. In other words, even in an actual notebook, when the page on which the contents are written is handed over to the other party or when the page is discarded, the operation described above is performed electronically because the target page is broken from the notebook. By causing the user to perform an input operation using the pen 40, it is possible to give the user a feeling as if using an actual notebook.

In this case, after selecting a destination address from the address list, by performing an operation of paying in the -y direction with the electronic pen 40, transmission data based on the contents input by handwriting is transmitted to the target destination. The present invention is not limited to this, and transmission data based on handwritten input content may be automatically transmitted when an input operation for selecting a destination address from an address list is performed.

In addition, after handwriting input “x” on the separated page, the operation of paying in the x direction or the y direction with the electronic pen 40 is performed, and the case where the content input by handwriting is deleted is taken as an example. It is not necessary to be limited to this, and when the operation of paying in the x direction or the y direction with the electronic pen 40 is performed without inputting “x” by hand on a separated page, the content input by handwriting is deleted. Also good. In addition to this, the handwritten input content may be deleted by handwriting “x” on the separated page.

In addition, after performing a handwriting input operation on a page displayed on the editing screen, the content written on the page is sent as an email to another portable electronic information terminal, or the content written on the page Although the case of deleting is described, the same processing can be performed even when a notepad, a tag, or the like is displayed on the first display unit 25.

In the above-described embodiment, the case where the position for separating the page is set in advance has been described. However, if it can be recognized that the page is separated by the input operation of the electronic pen 40, the position where the page can be separated is set in advance. There is no need. By not setting the position where the page can be separated in advance, it is possible to transmit the contents written down at the edge of the page to other users.

In addition, although the case where the page displayed on the edit screen is separated and the mail is transmitted is described, it is not limited to this, for example, an image displayed on the edit screen or a part of the screen displaying the WEB The same operation is performed when the area is cut and the cut portion is transmitted as mail. Thereby, it is possible to transmit not only the text written by the user but also an image or a part of the image to an intended partner.

Here, in the present embodiment, a general stylus pen is taken as an example of the electronic pen used in the input operation to the portable electronic information terminal 10 and explained.

Generally, a touch panel is mounted on an electronic information terminal such as a mobile phone or a tablet terminal. In such an electronic information terminal, in addition to a touch panel input operation by a user's finger, an input operation can be performed using a pen-type pointing device called a stylus pen. Hereinafter, the pen-type pointing device will be described as an electronic pen.

By the way, when drawing is performed in an electronic information terminal, it is common to display a selection palette for selecting a color to be used for drawing on the electronic information terminal. Due to the display of the selection palette, the drawing space in the electronic information terminal is reduced. For this reason, among the above-described electronic pens, an electronic pen having a function of selecting the color used for drawing on the electronic pen side has been proposed (see Japanese Patent Application Laid-Open No. 2004-103042). In this electronic pen, the selected color is displayed by a color developing device, and the user is made aware of the color used when drawing.

However, the colors set in the selection palette and the colors that can be selected with the electronic pen are often preset colors or colors set by changing the numerical values of the R, G, and B colors. Illustration drawing is suitable for drawing using such preset colors, but is not suitable for drawing using colors generated by mixing a plurality of colors, such as watercolor paintings and oil paintings.

Therefore, it is an object of the present invention to provide a pointing device and an input system that can perform drawing while using a color generated by mixing a plurality of colors.

In this case, transmission / reception of data between the electronic pen and the portable electronic information terminal is executed between the communication unit of the portable electronic information terminal and a wireless communication unit described later.

Next, an electronic pen used during an input operation to the portable electronic information terminal 10 will be described. As described above, the electronic pen 130 is a pen-type pointing device, and for example, an electromagnetic induction type electronic pen is used.

As shown in FIG. 35, the electronic pen 130 includes an input switch 131 at one end in the longitudinal direction and a color acquisition button 132 at the other end. The input switch 131 is in contact with or close to a display unit (the first display unit 25 or the second display unit 28) provided in the apparatus body 15 when performing an input operation to the portable electronic information terminal 10. The At this time, an electromagnetic wave generated by an electromagnetic coil provided in the vicinity of the input switch 131 of the electronic pen 130 is detected by a digitizer (in this embodiment, a touch panel) provided in the display unit, whereby the electronic pen 130 is detected. The position of the input switch 131 and the tilt of the electronic pen 130 are detected.

Further, when an input operation is performed using the electronic pen 130, if the input switch 131 of the electronic pen 130 is pressed against the display unit, pressure is applied to the input switch 131. When pressure is applied to the input switch 131, the inductance of the built-in electromagnetic coil changes, and the strength of the electromagnetic wave generated by the electromagnetic coil changes. Based on the change in the intensity of the electromagnetic wave, the writing pressure of the electronic pen 130 to be input can be detected.

The color acquisition button 132 is operated when acquiring color information of illustrations, images, and characters displayed on the first display unit 25 when drawing on the first display unit 25. Specifically, the color acquisition button 132 is operated in a state where the input switch 131 is in contact with the first display unit 25, and the display device 70 of the first display unit 25 corresponding to the position where the input switch 131 is in contact. The color information of the pixel is acquired. Hereinafter, the function of acquiring color information displayed on the first display unit 25 of the portable electronic information terminal 10 is referred to as a dropper function.

The electronic pen 130 includes a mode switching button 133, a selection / storage button 134, and a color display area 135 in addition to the input switch 131 and the color acquisition button 132 described above. The mode switching button 133 switches a mode to be used between the single color mode and the mixed color mode. The single color mode is a mode in which color information newly acquired by the above-described dropper function is set as color information used for drawing. On the other hand, the color mixture mode is based on the color based on the already acquired color information and the newly acquired color information when the color information is already acquired with the dropper function when the color information is already acquired. In this mode, color information when color is mixed is generated, and the generated color information is set as color information used for drawing. Here, the color mixture based on the color information based on the already acquired color information and the color based on the newly acquired color information is executed by subtractive color mixing.

The selection / storage button 134 is operated when storing color information acquired using the dropper function or when drawing using the stored color information. FIG. 5 shows a case where three

color storage buttons

134 a, 134 b, and 134 c are provided as the selection / storage button 134. That is, in the case of the electronic pen 130 of FIG. 35, it is possible to store a maximum of three pieces of color information acquired using the dropper function or three pieces of color information generated in the color mixture mode. Here, the number of selection / storage buttons 134 need not be limited to three, but may be one or two, or four or more.

Although the details will be described later, these selection / storage buttons 134 include a display unit, and the display unit displays colors. Here, the color displayed on the display unit is a color based on the color information associated with each selection / storage button 134 among the color information acquired using the dropper function. By displaying these colors, the user can visually recognize the color information stored in association with each selection / storage button 134. When the selection / storage button 134 does not emit light, it indicates that the color information is not associated and stored.

The color display area 135 displays the color used when drawing on the first display unit 25 and the color acquired by the dropper function. Here, the portion corresponding to the color display area 135 of the electronic pen 130 is made of, for example, a translucent or transparent synthetic resin.

For example, when the dropper function is used in the single color mode, the display in the color display area 135 is changed from the color display based on the already obtained color information to the color display based on the newly acquired color information.

On the other hand, when the dropper function is used when the color mixture mode is set, the display of the color display area 135 is newly acquired from the color display based on the already obtained color information and the displayed color. The display is switched to a color display that is a mixture of colors based on the color information.

FIG. 36 is a diagram showing an electrical configuration of the electronic pen. The electronic pen 130 includes a controller 141, and each unit is controlled by the controller 141. The controller 141 receives ON signals from the color acquisition switch 142, the mode changeover switch 143, and the selection switch 145, and the controller 141 executes processing according to the ON signals from these switches. In FIG. 36, the power source for supplying power is omitted.

The color acquisition switch 142 is provided inside the color acquisition button 132. The color acquisition switch 142 is turned on when the color acquisition button 132 is operated, and an ON signal is output to the controller 141. In response to this, the controller 141 is brought into contact with the first display unit 25 among the pixels of the display device 70 of the first display unit 25 from the portable electronic information terminal 10 via the wireless communication unit 155. The color information of the pixel corresponding to the position of the input switch 131 is acquired.

The mode change switch 143 is provided inside the mode change button 133 described above. The mode switch 143 is turned on when the mode switch button 133 is operated, and an on signal is output to the controller 141. In response to this, the controller 141 switches between the single color mode and the mixed color mode.

The above-described selection /

storage buttons

134a, 134b, and 134c are constituted by push-on / push-off type operation buttons. Since the configuration of the selection /

storage buttons

134a, 134b, and 134c is the same, only the configuration of the selection / storage button 134a will be described below.

The selection / storage button 134a includes a selection switch 145, a driver 146, and an LED 147. The selection switch 145 is turned on by the push-on operation of the selection / storage button 134a and turned off by the push-off operation. Based on the push-on operation of the selection / storage button 134 a, the selection switch 145 is turned on and an on signal is output to the controller 141. In response to the ON signal from the selection switch 145, the controller 141 reads out color information corresponding to the selection / storage button 134a and information such as the pulse width and period of each color component based on the color information from the data storage unit 152. . Then, the controller 141 outputs information such as the pulse width and cycle of each color component to the driver 146. The driver 146 causes the LED 147 to emit light based on the input information. Here, the LED 147 is a full-color LED in which three primary colors of R, B, and G are combined.

The driver 150 and the LED 151 are arranged inside the color display area 135 described above. Similar to the LED 147 built in the selection / storage button 134, the LED 151 is composed of a full-color LED in which three primary colors of R color, B color, and G color are combined. Note that FIG. 36 shows an example in which three

LEDs

151a, 151b, and 151c are arranged so that the level of the displayed color (remaining amount, ratio, etc.) can be expressed.

The data storage unit 152 stores color information obtained from the portable electronic information terminal 10 or color information obtained by mixing colors based on a plurality of color information. The color information is stored in association with one of the selection / storage buttons 134. In addition to the color sample data 153, the data storage unit 152 stores control data (pulse width, period, etc.) 154 for causing each color registered in the color sample data 153 to emit light.

The wireless communication unit 155 transmits / receives data to / from the communication unit 62 provided in the portable electronic information terminal 10. Here, the wireless communication unit 155 communicates with the portable electronic information terminal 10 by wireless communication, for example, wireless communication using a wireless LAN, infrared communication, or wireless communication using Bluetooth (registered trademark). Send and receive data.

The controller 141 described above has functions such as a ratio setting unit 156 and a color generation unit 157 when the color mixture mode is selected. The ratio setting unit 156 sets a ratio for mixing colors based on color information acquired before and after the time in the color mixture mode. As described above, when the color information is acquired using the dropper function, it is necessary to operate the color acquisition button 132. The ratio setting unit 156 is acquired based on the time when the color acquisition button 132 is operated, the number of times the color acquisition button 132 is operated, the pressure when the color acquisition button 132 is operated, and the like. The color capacity for each color information is calculated. Then, the ratio setting unit 156 sets a ratio when colors based on the plurality of pieces of color information are mixed from the color capacity obtained for each of the plurality of pieces of color information. In other words, the ratio setting unit 156 includes a counter that counts the number of times the color acquisition switch 142 is turned on, and a timer that measures a duration when the color acquisition switch 142 is kept on. The pressure when the color acquisition button 132 is operated may be output from a pressure sensor (not shown).

The color generation unit 157 generates color information when the color based on the already acquired color information and the color based on the newly acquired color information are mixed using the ratio obtained by the ratio setting unit 156 To do. Based on the generated color information, the controller 141 controls the light emission of the LED 147 of the corresponding selection / storage button 134 and the LED 151 of the color display area 135. When storing the mixed color information, the controller 141 writes the generated color information and the selection / storage button 134 that is turned on in association with each other into the data storage unit 152.

Next, the flow of processing in the electronic pen 130 when drawing will be described with reference to the flowchart of FIG.

Step S601 is a process of determining whether any of the selection switches is turned on. If an ON signal is input from any of the selection switches 145 provided for each selection / storage button 134, the controller 141 sets the determination result in step S601 to Yes. In this case, the process proceeds to step S602. On the other hand, if there is no ON signal input from any of the selection switches 145 provided for each selection / storage button 134, the controller 141 sets the determination result in step S601 to No. In this case, the process proceeds to step S604.

Step S602 is processing for determining whether or not there is color information. If the determination result in step S601 is Yes, step S602 is executed. The controller 141 determines whether the selection switch 145 that outputs the ON signal is the selection switch 145 provided in any of the selection /

storage buttons

134a, 134b, and 134c. Then, the controller 141 refers to the data storage unit 152 and determines whether or not the color information associated with the specified selection / storage button 134 is stored. If there is color information associated with the selected selection / storage button 134, the controller 141 sets the determination result in step S602 to Yes. In this case, the process proceeds to step S603. On the other hand, if there is no color information associated with the specified selection / storage button 134, the controller 141 sets the determination result in step S602 to No. In this case, the process proceeds to step S604.

Step S603 is a process for displaying a color. In step S602, if there is color information associated with the selected selection / storage button 134, the process of step S603 is executed. The controller 141 reads out color information associated with the selection / storage button 134 from the data storage unit 152. In addition, the controller 141 reads the color sample table 153 and the control data 154 stored in the data storage unit 152 and outputs control data based on the color information to the driver 150. In response, the driver 150 controls the light emission of the

LEDs

151a, 151b, and 151c. As a result, among the selection /

storage buttons

134a, 134b, and 134c, the color stored in association with the operated selection / storage button 134 is displayed in the color display area 135.

In step S602, if there is no color information associated with the specified selection / storing button 134, the above-described processing in step S603 is not executed, so that the

LEDs

151a, 151b, and 151c are not emitted, and color display is performed. Color display is not performed in area 135.

Step S604 is processing for determining whether or not a color information request signal has been received. For example, when an input operation is performed on the first display unit 25 of the portable electronic information terminal 10 using the electronic pen 130, the input switch 131 of the electronic pen 130 is brought into contact with the first display unit 25. As described above, the first display unit 25 includes the touch panel 71 and detects that the input switch 131 is in contact. By detecting that the input switch 131 is in contact, a request signal for color information is transmitted from the portable electronic information terminal 10 to the electronic pen 130. The controller 141 determines whether or not a color information request signal has been received via the wireless communication unit 155. When the color information request signal is received, the controller 141 sets the determination result in step S604 to Yes, and proceeds to step S605. On the other hand, if the color information request signal has not been received, the controller 141 determines No in step S604 and proceeds to step S607.

Step S605 is processing for determining whether or not there is color information. The controller 141 determines whether or not color display is being performed in the color display area 135. For example, when displaying a color in the color display area 135, the controller 141 sets the determination result in step S605 to Yes. In this case, the process proceeds to step S606. On the other hand, if no color is displayed in the color display area 135, the controller 141 sets the determination result in step S605 to No. In this case, the process proceeds to step S607.

Step S606 is a process of transmitting color information. The controller 141 reads color information based on the color displayed in the color display area 135 from the data storage unit 152. The controller 141 transmits the color information to the portable electronic information terminal 10 through the wireless communication unit 155. Accordingly, when the electronic pen 130 is used to draw on the first display unit 25 of the portable electronic information terminal 10, a straight line or a curve using the color set by the electronic pen 130 can be drawn. It becomes possible.

Step S607 is processing for determining whether or not the color acquisition switch is turned on. As described above, in the electronic pen 130, the color information displayed on the first display surface 25 can be acquired by the dropper function. When the color acquisition button 132 is operated by the user, the color acquisition switch 142 provided inside the color acquisition button 132 is turned on, and the ON signal is output to the controller 141. The controller 141 determines whether or not the ON signal from the color acquisition switch 142 is input. For example, when an ON signal is input from the color acquisition switch 142, the controller 141 sets the determination result in step S607 to Yes. In this case, the process proceeds to step S608. On the other hand, when the ON signal from the color acquisition switch 142 is not input, the controller 141 determines No in step S607. In this case, the process proceeds to step S617.

Step S608 is processing for transmitting a request signal for color information. The controller 141 outputs a color information request signal to the portable electronic information terminal 10 via the wireless communication unit 155.

Step S609 is processing for determining whether or not color information is received. For example, when the above-described color acquisition switch 142 is turned on while the input switch 131 of the electronic pen 130 is in contact with the first display unit 25 of the portable electronic information terminal 10, the portable electronic information is transferred from the electronic pen 130. A color information request signal is output to the terminal 10. In response to the color information request signal, the portable electronic information terminal 10 acquires the color information of the pixel corresponding to the coordinate data with which the input switch 131 of the electronic pen 130 is abutted. Then, the acquired color information is transmitted to the electronic pen 130.

The color information transmitted from the portable electronic information terminal 10 is received by the wireless communication unit 155 of the electronic pen 130. In this case, the controller 141 determines Yes in step S609, and proceeds to step S610. On the other hand, when the color information transmitted from the portable electronic information terminal 10 is not received by the wireless communication unit 155 of the electronic pen 130, the controller 141 sets the determination result in step S609 to No. In this case, the determination process of step S609 is repeatedly performed until the determination result of step S609 becomes Yes.

Step S610 is processing for determining whether or not the mode is the single color mode. The electronic pen 130 can be switched between the single color mode and the mixed color mode by operating the mode switching button 133. The controller 141 reads out the mode information of the electronic pen 130 stored in the data storage unit 152 and determines whether or not the mode is the single color mode. If the mode information is information indicating a single color mode, the controller 141 sets the determination result in step S610 to Yes. In this case, the process proceeds to step S611. On the other hand, if the mode information is information indicating the color mixture mode, the controller 141 sets the determination result in step S610 to No. In this case, the process proceeds to step S614.

If the electronic pen 130 is set to the single color mode, the determination result of step S610 is Yes, and the process proceeds to step S611.

Step S611 is processing for determining whether or not a color is displayed in the color display area. The controller 141 executes the determination process in step S611 depending on whether or not the LED 151 is emitting light. That is, when the LED 151 is caused to emit light, the controller 141 sets the determination result in step S611 to Yes. In this case, the process proceeds to step S612. On the other hand, if the LED 151 is not emitting light, the controller 141 sets the determination result in step S611 to No. In this case, the process proceeds to step S613.

Step S612 is a process for changing the color display. When the dropper function is used when the monochrome mode is set, the controller 141 changes the color displayed in the color display area 135 from the color based on the previously acquired color information. A process of switching to a color based on information is executed. The controller 141 reads control data based on the newly acquired color information from the data storage unit 152. Then, control data based on the newly acquired color information is output to the driver 150. In response to this, the driver 150 controls the light emission of the

LEDs

151a, 151b, and 151c using the newly input control data. As a result, the color displayed in the color display area 135 is changed.

Step S613 is a process for displaying a color. Step S613 is processing performed when color display is not executed in the color display area 135. The controller 141 reads out control data 154 corresponding to the acquired color information from the data storage unit 152. Then, the control data 154 based on the acquired color information is output to the driver 150. In response to this, the driver 150 controls the light emission of the

LEDs

151a, 151b, and 151c using the input control data 154. As a result, the acquired color is displayed in the color display area 135.

If No in step S610, that is, if the electronic pen 130 is set to the color mixture mode, the process proceeds to step S614.

Step S614 is processing for determining whether or not a color is displayed in the color display area. The controller 141 executes the determination process in step S614 depending on whether the

LEDs

151a, 151b, and 151c are emitting light. That is, when the

LEDs

151a, 151b, and 151c are caused to emit light, the controller 141 sets the determination result in step S614 to Yes. In this case, the process proceeds to step S615. On the other hand, if the

LEDs

151a, 151b, and 151c are not emitting light, the controller 141 sets the determination result in step S614 to No. In this case, the process proceeds to step S616.

Step S615 is processing for generating color information. As described above, the electronic pen 130 is set to the color mixture mode. First, the controller 141 obtains a ratio when the color based on the previously obtained color information is mixed with the color based on the newly acquired color information. Specifically, the controller 141 sets a ratio for mixing colors based on color information acquired before and after in time. The controller 141 acquires a plurality of colors acquired based on the time when the color acquisition button 132 is operated, the number of times the color acquisition button 132 is operated, the pressure when the color acquisition button 132 is operated, and the like. Calculate the color capacity for each piece of information. Then, the ratio setting unit 156 in the controller 141 sets a ratio when colors based on the plurality of pieces of color information are mixed from the color capacities obtained for each of the plurality of pieces of color information. The color generation unit 157 in the controller 141 generates color information of mixed colors obtained by mixing the color based on the color information already obtained using the obtained ratio and the color based on the newly acquired color information.

Step S616 is a process for displaying a color. For example, when the process of step S115 (process for generating color information) is being performed, the controller 141 reads the control data 154 corresponding to the color information generated in step S615 from the data storage unit 152, and sends it to the driver 150. Output. If the determination result in step S614 is No, the controller 141 reads the control data 154 associated with the newly acquired color information from the data storage unit 152 and outputs the control data 154 to the driver 150. The driver 150 displays the

LEDs

151a, 151b, and 151c based on the input control data. As a result, color display is executed in the color display area 135.

Step S617 is processing for determining whether any of the selection switches is on. As described above, when the selection / storage button 134 is pushed on, the selection switch 145 is turned on and an on signal is output to the controller 141. The controller 141 determines whether an ON signal is output from any of the selection switches 145 of the selection /

storage buttons

134a, 134b, and 134c. If an ON signal is output from any of the selection switches 145 of the selection /

storage buttons

134a, 134b, and 134c, the controller 141 sets the determination result in step S617 to Yes. In this case, the process proceeds to step S618. On the other hand, when the ON signal is not output from any of the selection switches 145 of the selection /

storage buttons

134a, 134b, and 134c, the controller 141 sets the determination result of step S618 to No. In this case, the processing flow of the flowchart shown in FIG. That is, if the determination result in step S617 is No, the color information displayed in the color display area 135 is not stored.

Step S618 is processing for storing color information. The controller 141 stores the selection / storage button 134 in which the selection switch 145 for outputting the ON signal is built in and the color information in association with each other in the data storage unit 152.

Step S619 is a process of changing the color display. The controller 141 refers to the control data 154 stored in the data storage unit 152 and causes the LED 147 incorporated in the selection / storage button 134 associated with the color information to be stored to emit light. As a result, the color display of the push-on selection / storage button 134 is changed.

As described above, in the single color mode, when the dropper function is used in the state where the color information has been acquired first, the color display based on the previously obtained color information is changed to the newly acquired color information. Switch to the color display based on. Further, when the dropper function is used in a state where the color information is not acquired, a color is displayed based on the newly acquired color information.

In the color mixture mode, if the color information has been acquired first, the color based on the color information and the color based on the color information newly acquired using the dropper function are mixed to newly Color information is generated, and a color based on the generated color information is displayed in the color display area 135.

In this way, information on the colors used for the illustrations and characters displayed on the first display unit 25 is acquired by the electronic pen 130, and the acquired colors are used as they are or a plurality of acquired colors are mixed. Can be used in That is, since it is not necessary to display a color palette on the display unit in order to select a color to be used, a space for drawing can be secured. In addition, when information on a plurality of colors is acquired sequentially, color information when colors based on these color information are mixed is generated, so that a feeling of drawing while actually mixing paints is obtained. It becomes possible.

Hereinafter, the flow of processing when drawing using the electronic pen 130 is performed on the editing screen displayed on the first display unit 25 of the portable electronic information terminal 10 will be described with reference to the flowchart of FIG. In the flowchart of FIG. 38, the case where the electronic pen 130 of this embodiment is set in the portable electronic information terminal 10 is described.

Step S701 is processing for determining whether or not there is detection by the touch panel. As described above, the first display unit 25 includes the touch panel 71, and when the input switch 131 of the electronic pen 130 is brought into contact with the touch panel 71, a detection signal is output from the touch panel 71 toward the controller 56. The controller 56 outputs coordinate data based on the detection signal of the touch panel 71 to the CPU 59. The CPU 59 determines whether or not there is a detection by the touch panel 71 based on whether or not coordinate data is output from the controller 56. For example, if there is a coordinate signal output from the controller 56, the CPU 59 determines that there is detection by the touch panel 71, and the process proceeds to step S702. On the other hand, for example, when there is no output of coordinate data from the controller 56, the CPU 59 determines that there is no detection by the touch panel 71, and proceeds to step S710.

Step S702 is a process of transmitting a color information request signal. The CPU 59 transmits a color information request signal via the communication unit 62.

Step S703 is processing for determining whether or not color information is received. If the color information transmitted from the electronic pen 130 is received by the communication unit 62, the CPU 59 determines Yes in step S703. On the other hand, when the color information transmitted from the electronic pen 130 is not received by the communication unit 62, the CPU 59 sets the determination result of step S703 to No. In this case, the determination process of step S203 is repeatedly executed until the determination result of step S703 becomes Yes.

Step S704 is processing for setting color information at the time of drawing. The CPU 59 sets the color information received from the electronic pen 130 as color information when drawing (illustrations, characters) executed on the editing screen.

Step S705 is processing for determining whether or not the position detected by the touch panel has changed. The CPU 59 refers to the coordinate data output from the controller 56 and determines whether or not the position detected by the touch panel 71 has changed. If the position detected by the touch panel 71 has changed, the CPU 59 sets the determination result in step S705 to Yes. In this case, the process proceeds to S706. On the other hand, if the position detected by the touch panel 71 has not changed, the CPU 59 sets the determination result in step S705 to No. In this case, the process proceeds to step S708.

Step S706 is a drawing process. The CPU 59 outputs the coordinate data output from the controller 56 and the set color information to the display control circuit 55. The display control circuit 55 obtains a movement locus from the coordinate signal output from the controller 56, and displays the obtained movement locus so as to be superimposed on the editing image that is the basis of the editing screen. At this time, the obtained movement locus is displayed in a color based on the set color information. That is, by performing the process of step S706, the movement locus based on the movement of the electronic pen 130 is displayed in the color set by the electronic pen 130. Thereby, a character, an illustration, etc. are drawn.

Step S707 is processing for determining whether there is detection by the touch panel. When the contact of the input switch 131 of the electronic pen 130 with the touch panel 71 is released, the detection by the touch panel 71 is released. That is, the output of coordinate data from the controller 56 to the CPU 59 is stopped. The CPU 59 determines whether there is no detection by the touch panel 71 based on whether or not the output of the coordinate data is stopped. For example, when the output of the coordinate data is stopped, the controller 56 determines that there is no detection by the touch panel 71. In this case, the determination result of step S707 is Yes, and the process proceeds to step S710.

On the other hand, if the output of the coordinate data is not stopped, the controller 56 determines that the touch panel 71 has detected the coordinate data. In this case, the determination result of step S707 is No, and the process proceeds to step S705.

If the determination result of step S705 is No, the process proceeds to step S708.

Step S708 is a process for determining whether or not a color information request signal has been received. When the color acquisition button 132 by the electronic pen 130 is operated, the color acquisition switch 142 is turned on, and a request signal for color information is transmitted from the electronic pen 130. The CPU 59 determines whether or not the color information request signal is received by the communication unit 62. If the color information request signal is received by the communication unit 62, the CPU 59 sets the determination result in step S708 to Yes. In this case, the process proceeds to step S709.

On the other hand, if the color information request signal is not received by the communication unit 62, the CPU 59 sets the determination result in step S708 to No. In this case, the process proceeds to step S710.

Step S709 is a process of transmitting color information. The CPU 59 outputs the coordinate data output from the controller 56 to the display control circuit 55. The display control circuit 55 acquires the color information of the pixel of the display device 70 of the first display unit 25 corresponding to the coordinate data, and outputs it to the CPU 59. The CPU 59 outputs the acquired color information to the communication unit 62. In response to this, the communication unit 62 transmits the color information to the electronic pen 130.

Step S710 is processing for determining whether or not to end the editing screen. For example, if the input operation of the electronic pen 130 indicates screen switching instead of drawing, the CPU 59 determines Yes in step S710. In this case, the flow of the flowchart of FIG. 38 ends. On the other hand, for example, if the input operation of the electronic pen 130 performs drawing, the CPU 59 sets the determination result in step S710 to No. In this case, the process returns to step S701.

Thus, when drawing using the electronic pen 130 in the portable electronic information terminal 10, color information is acquired from the electronic pen 130, and processing based on the drawing is executed. Further, when the color is acquired by the electronic pen 130, the color information of the pixel on the editing screen displayed on the first display unit 25 is transmitted to the electronic pen 130. By this transmission, the color used when drawing on the electronic pen 130 side is set. That is, in the portable electronic information terminal 10, there is no need to display a color palette, so that it is possible to widen the space for the user to draw on the editing screen.

In the present embodiment, whether or not the color palette is displayed is not described, but the color palette may be displayed or may not be displayed. Further, display / non-display of the color palette may be switched. In this case, for example, a tab for a color palette is displayed on the outer peripheral edge of the first display unit 25. Then, the color palette may be displayed by performing an operation of pulling out the tab with the electronic pen 130, and the color palette may be hidden by performing an operation of pushing the tab with the electronic pen 130. Here, the operation for switching the display / non-display of the color palette is not limited to the above, and a button for switching the display / non-display of the color palette may be provided. In this way, by switching between display and non-display of the color palette, it is possible to cope with a case where there is no color intended by the user among colors used for illustrations, characters, etc. displayed on the first display unit 25. It becomes.

In the present embodiment, a plurality of LEDs 151 are arranged inside a color display area 135 made of a transparent or translucent synthetic resin. However, the present invention is not limited to this, and a liquid crystal display device, an organic EL display, etc. It is also possible to display colors using a display device.

By using such a display device, it is possible to display a state in which the color based on the color information acquired using the dropper function and the color based on the already acquired color information are mixed. In this case, a program and data for displaying a moving image showing how the newly acquired color is mixed with the already acquired color may be stored in the data storage unit.

Further, by providing a display device such as a liquid crystal display device or an organic EL display, it is also possible to express an image that absorbs a color based on the acquired color information when the color acquisition button 132 is operated. Further, in the color mixture mode, it is possible to display a color based on the already acquired color information in advance and display an image that is gradually mixed when a dropper function is newly used.

In addition, since the size of a display device such as a liquid crystal display device or an organic EL display used for the electronic pen 130 is small, it is difficult for the user to visually recognize the animation display described above. Therefore, even when these display devices are used, the display may be switched to the color display based on the acquired color information or the color display based on the generated color information, as in the present embodiment.

In this embodiment, the color based on the color information obtained when the dropper function is used and the color based on the color information mixed by the dropper function are displayed in the entire color display area. However, the capacity of the acquired color is simulated based on the operation time of the color acquisition button 132 when the dropper function is used, the number of operations of the color acquisition button 132, or the pressure when the color acquisition button 132 is operated. It is also possible to determine the number of LEDs that emit light according to the obtained capacity. Such a process can be applied in the single color mode or the mixed color mode.

In this case, the time of sliding contact with the input switch 131 of the electronic pen 130 and the first display unit 25 of the portable electronic information terminal 10 at the time of drawing is measured, and the number of LEDs that emit light is determined according to the measured time. It can be reduced. That is, in the color display area, the display of the remaining amount of the acquired color information can be displayed in a pseudo manner.

In the present embodiment, in the single color mode, the color acquisition button 132 is operated to switch to the color display based on the newly obtained color information, and in the mixed color mode, the color information is acquired every time using the dropper function. The color mixed with is displayed. In other words, in the color mixture mode, the process of mixing the previously obtained color and the newly acquired color is repeatedly executed, so it is not possible to mix colors between colors intended by the user. Therefore, a reset button is displayed on the display device 70 of the first display unit 25 or the color information stored in the electronic pen 130 is initialized so that colors can be mixed with colors intended by the user. A reset button may be provided.

In this embodiment, the case where the electronic pen 130 has both the single color mode and the mixed color mode is described. However, the present invention is not limited to this, and either the single color mode or the mixed color mode is used. It may be an electronic pen equipped with.

In the present embodiment, the eyedropper function of the electronic pen 130 is enabled for the first display unit 25, but the present invention is not limited to this, and the color used for the library screen displayed on the second display unit 28. It is also possible to acquire the information.

The portable electronic information terminal shown in the present embodiment has been described on the premise of an input operation using an electronic pen made of a slitus pen, but in addition to this, an input operation with a user's finger can also be accepted. In this case, the user may be able to extract an intended color with a finger or using a general electronic pen. Here, as a method of extracting the color with the finger or the electronic pen 40, for example, a processing command is displayed on the first display unit 25 in advance, and after the processing command is selected, the color intended by the user is displayed. A method of performing an operation of abutting a finger or the electronic pen 40 on a region that is present, or a method of performing a predetermined operation (for example, continuously abutting twice) on a region where an intended color is displayed with the finger or the electronic pen 40 Can be mentioned.

As shown in FIG. 39 (a), an example will be described in which the user extracts a color at a predetermined position in the image P6 when the image P6 is displayed on the first display unit 25. The user's finger is brought into contact with the portion where the color intended by the user is displayed. In FIG. 39A, the position indicated by reference numeral 170 is the position where the user's finger abuts. Then, when the user's finger is brought into contact with the intended position of the first display unit 25, the finger is brought into contact with the peripheral region (hatched region 171 shown in FIG. 39A) at the contacted position. It is displayed in the color of the position. In addition, although the area | region of the peripheral part of the position which the finger contact | abutted is displayed with the color of the position which the finger contact | abutted, it is not necessarily limited to this, The position of the position where the finger contact | abutted It is also possible to provide a display frame in the vicinity for displaying the color of the position where the finger is in contact, and display the color of the position where the finger is in contact with this display frame.

For example, when moving the extracted color to another position, the user slides the finger in contact with the first display unit 25 to the intended position. A region 171 in which the extracted color is far displayed moves in accordance with the sliding of the finger (see FIG. 39B). When an input operation related to drawing is performed after sliding the finger to a position intended by the user, drawing using the extracted color can be performed. Hereinafter, drawing includes writing characters in addition to drawing illustrations and drawings.

Hereinafter, the flow of processing when drawing a color intended by the user with a finger or a pointer and performing drawing will be described based on the flowchart of FIG. The processing of this flowchart is executed when the editing screen is displayed on the first display unit 25.

Step S801 is processing for determining whether or not there is an input operation for performing color extraction. As described above, when the finger or the electronic pen 40 comes into contact with the first display unit 25, the touched position is detected by the touch panel 71 of the first display unit 25. As a result, the detected position information is output from the controller 56 to the CPU 59. Based on the position information output from the controller 56, the CPU 59 determines whether or not the input operation is an input operation for performing color extraction.

For example, when a control command is displayed, if the position information output from the controller 56 is within the area where the control command for color extraction displayed on the first display unit 25 is displayed, color extraction is performed. It is determined that the input operation to be performed has been performed. In this case, the CPU 59 sets the determination result in step S801 to Yes, and proceeds to step S802. On the other hand, when the position information output from the controller 56 is outside the area where the color extraction control command displayed on the first display unit 25 is displayed, it is determined that the input operation for performing color extraction has not been performed. . In this case, the CPU 59 determines No in step S801 and proceeds to step S806.

Here, a case where a control command is displayed as an input operation for performing color extraction is illustrated, but the present invention is not limited to this, and a finger or an electronic pen 40 is continuously displayed on the first display unit 25 a plurality of times. When the contact operation is an input operation for performing color extraction, the determination process in step S801 may be determined based on whether or not the position information output from the controller 56 has been continuously output a plurality of times.

Step S802 is processing for extracting color information. The CPU 59 outputs a signal for obtaining the color information to the display control circuit 55 together with the position information output from the controller 56. In response to this, the display control circuit 55 acquires pixel color information based on the input position information from the image displayed on the first display unit 25. Thereby, the color information of the position where the input operation is performed is extracted.

Step S803 is a process for displaying the extracted color information. The display control circuit 55 synthesizes the color information of the pixels included in the predetermined range area with respect to the input position information and the extracted color information. In this case, it is only necessary to display the extracted color information much, so it is necessary to synthesize the extracted color information as it is with the color information (R, G, B values, etc.) of the pixels included in the predetermined range of area. Rather, a value obtained by multiplying the extracted color information (R, G, B values) by a predetermined coefficient α (0 <α <1) is used as the color information (R, G) of the pixels included in the region of the predetermined range. , B value, etc.). Also, the color information of the pixels included in the predetermined range area is specified by the finger without combining the color information of the pixels included in the predetermined range area with respect to the input position information and the extracted color information. It may be replaced with position color information.

Step S804 is a process for determining whether or not the position of the input operation has been moved. Since the position where the user's finger or the electronic pen 40 abuts is detected by the touch panel 71, when the user's finger or the electronic pen 40 slides, the position of the abutting user's finger or the electronic pen 40 is sequentially changed to the controller. 56 to the CPU 59. In response to this, the CPU 59 determines whether or not the input position information has changed. If the position information has changed, the CPU 59 determines Yes in step S804. In this case, the process proceeds to step S805. On the other hand, if the position information has not changed, the CPU 59 determines No in step S804. In this case, the process proceeds to step S806.

Step S805 is processing to move the display position of the color information. The CPU 59 outputs the position information output from the controller 56 to the display control circuit 55. In response to this, the display control circuit 55 moves the area (the above-described predetermined area) where the extracted color information is displayed based on the input position information. Then, the extracted color information and the color information of the pixels included in the moved predetermined range area are synthesized. Then, the display control circuit 55 displays the target pixel using the synthesized color information. As a result, the position where the extracted color information is displayed sequentially changes.
Step S806 is processing to determine whether or not there is a drawing input operation. When it is determined from the position information input from the controller 56 to the CPU 59 that the user's finger or electronic pen 40 input operation is an input operation based on drawing, the CPU 59 sets the determination result in step S806 to Yes. In this case, the process proceeds to step S807. On the other hand, when the input operation of the finger or the electronic pen 40 by the user cannot be determined as the input operation based on the drawing, the CPU 59 sets the determination result in step S806 to No. In this case, the process proceeds to step S808.

Step S807 is processing for displaying a drawing based on the input operation. In step S806, if the input operation is based on drawing, the CPU 59 outputs position information input based on the input operation and a signal indicating the type of drawing to the display control circuit 55. The display control circuit 55 executes a drawing process based on the input signal and information. At this time, if there is extracted color information, the display control circuit 55 performs drawing processing using the color information. As a result, a drawing that matches the locus of the input operation based on the finger or the electronic pen 40 is displayed on the first display unit 25.

Step S808 is processing for determining whether or not to end the drawing input operation. Based on the position information output from the controller 56 based on the input operation of the user's finger or the electronic pen 40, the CPU 59 determines whether or not the drawing input operation has ended. If the CPU 59 can determine from the position information output from the controller 56 that the drawing input operation is completed, the CPU 59 sets the determination result in step S808 to Yes. In this case, the process of the flowchart shown in FIG. 40 ends. On the other hand, when the CPU 59 cannot determine when the drawing input operation is completed, the CPU 59 determines No in step S808. In this case, the process returns to step S801.

In this manner, color extraction processing can be performed by operating the finger or the electronic pen 40, and drawing can be performed using the extracted color information.

In the present embodiment, a portable electronic information terminal comprising two display units, the first display unit 25 and the second display unit 28, is taken as an example. However, the present invention is not limited to this, and one display is possible. It may be a portable electronic information terminal comprising parts.

In this embodiment, the electronic pen 130 that performs an input operation on the portable electronic information terminal 10 is taken as an example. However, the present invention is not limited to this. For example, when drawing is performed using a computer or the like. It can be used for a pen-type pointing device to be used.

In the present invention, the portable electronic information terminal and the electronic pen used in the portable electronic information terminal are described as examples. However, the present invention is not limited to this, and the computer and the computer It is good also as a pointing device used for it.

In this embodiment, the image editing process in the portable electronic information terminal is described. However, the image editing program can be executed by a computer. That is, the procedure of the flowcharts of FIGS. 14 and 15, the procedure of the flowcharts of FIGS. 26 to 28, the procedure of the flowchart of FIG. 34, the procedure of the flowchart of FIG. 38, and the procedure of the flowchart of FIG. It may be a computer-readable image editing program that can be executed by a computer. In this case, the image editing program is preferably stored in a computer-readable storage medium such as a memory card, an optical disk, or a magnetic disk.

Claims

A display unit having a display area for displaying an image;
A setting unit for setting a control point when operating the image with respect to the image displayed in the display area of the display unit;
A resetting unit for resetting the control point with respect to a partial region of the image displayed in the display region when the size of the image displayed on the display unit is larger than the size of the display region; ,
A control point for displaying the image in the display area and either the control point set by the setting unit or the control point reset by the resetting unit according to the display state of the image A display control unit for displaying
An image editing apparatus comprising:
The image editing apparatus according to claim 1,
The image editing apparatus according to claim 1, wherein the control point includes a control point for scaling the image or a control point for rotating the image.
The image editing apparatus according to claim 2,
The resetting unit resets the control point with respect to a partial region of the image displayed in the display region when the size of the image displayed on the display unit is larger than the size of the display region. An image editing apparatus characterized by setting.
The image editing apparatus according to any one of claims 1 to 3,
An image processing unit that performs a trimming process on the image;
When the image on which the trimming process has been performed by the image processing unit is displayed, the resetting unit performs the trimming process on the control points set for the image before the trimming process is performed. An image editing apparatus for resetting a control point set for an image.
The image editing apparatus according to claim 4,
The display control unit displays an image immediately before executing the trimming process and a control point set before the trimming process when the trimming process by the image processing unit is performed again. Image editing device.
The image editing apparatus according to claim 5, wherein
The display control unit displays the display mode of the first region cut out by the trimming process and the second region excluding the first region in different display modes. .
A display unit for displaying a plurality of images in a superimposed manner;
Display of an image to be superimposed when any one of the plurality of images is moved to cancel the overlay with another image and then the moved image is superimposed on the other image A display control unit for changing the order;
An image editing apparatus comprising:
The image editing apparatus according to claim 7, wherein
The display unit includes a display area for displaying the plurality of images,
An image editing apparatus comprising: a permission unit that permits the display order to be changed in response to the moved image reaching the outer periphery of the display area.
In the image editing apparatus according to claim 7 or 8,
The image editing apparatus, wherein the display order is changed according to a positional relationship of the other image with respect to the moved image.
The image editing apparatus according to claim 9, wherein
The display control unit moves the moved image when one image is located within a predetermined range with respect to the moved image when the moved image is moved closer to the other image. An image editing apparatus, wherein the display order of the images and the display order of the one image are switched.
The image editing apparatus according to claim 9, wherein
The display control unit moves the moved image when the two images are located within a predetermined range with respect to the moved image when the moved image is moved closer to the other image. An image editing apparatus, wherein the display order of the images to be superimposed is changed so that the display order of the two images is between the display orders of the two images.
The image editing apparatus according to any one of claims 7 to 11,
An image editing apparatus, further comprising an operation member operated when moving any of the plurality of images.
The image editing apparatus according to claim 12, wherein
The image editing apparatus, wherein the operation member includes a touch panel.
A setting step for setting a control point when operating the image with respect to the image displayed in the display area;
A resetting step of resetting the control point for a partial area of the image displayed in the display area when the size of the image to be displayed is larger than the size of the display area;
While displaying the image in the display area, the control point of either the control point set by the setting step or the control point reset by the resetting step according to the display state of the image A display process for displaying,
A computer-readable image editing program that can be executed on a computer.
A display process for displaying a plurality of images in a superimposed manner;
Display of an image to be superimposed when any one of the plurality of images is moved to cancel the overlay with another image and then the moved image is superimposed on the other image A display control process for changing the order; and
A computer-readable image editing program that can be executed on a computer.
A display device that displays a plurality of pages in units of pages;
A touch panel that accepts an input operation on a page displayed on the display device;
First determination for determining whether an input operation for separating at least a part of the page displayed on the display device is performed based on an input operation received on the touch panel and an operation direction at the time of the input operation Means,
Display control means for separating and displaying at least a part of the page on the display device when it is determined by the first determination means that an input operation for separating at least a part of the page has been performed;
An electronic information terminal comprising:
The electronic information terminal according to claim 16, wherein
The display control means displays a destination list for transmitting contents input to at least a part of the page to another electronic information terminal when at least a part of the page is displayed on the display device. Display
When the touch panel receives an input operation for selecting a target transmission destination from the transmission destination list, the content input to at least a part of the page is transmitted to the electronic information terminal serving as the target transmission destination. An electronic information terminal comprising transmission means for performing
The electronic information terminal according to claim 17, wherein
After the touch panel receives an input operation for selecting a target transmission destination from the transmission destination list, input to at least a part of the page based on the input operation received on the touch panel and the operation direction at the time of the input operation Second determination means for determining whether or not an input operation for transmitting the received content to the electronic information terminal serving as the target transmission destination has been performed,
When the transmission means determines that an input operation for transmitting the content input to at least part of the page by the second determination means to the electronic information terminal serving as the target transmission destination has been performed. In addition, the electronic information terminal transmits the content input to at least a part of the page to the electronic information terminal as the target transmission destination.
The electronic information terminal according to claim 16, wherein
When at least a part of the separated page is displayed on the display device, is the input operation accepted by the touch panel performed an input operation that deletes the content input to at least a part of the page? Third determination means for determining whether or not;
Content deletion means for deleting content input to at least part of the page when it is determined by the third determination means that an input operation for deleting at least part of the page has been performed. An electronic information terminal.
An input unit that is in contact with or close to the display screen of the electronic information terminal that accepts input operations;
A first operation unit that is operated when the input unit is in contact with or close to the display screen;
A device-side receiver that receives color information on the display screen from the electronic information terminal at a position where the input unit is in contact with or close to the first operation unit;
A color display unit for displaying a color based on the color information received by the device-side receiving unit;
A pointing device comprising:
The pointing device according to claim 20,
Based on the operation time of the first operation unit, the number of operations of the first operation unit, or the pressure applied during operation of the first operation unit, the color based on the color information received by the device-side receiving unit A pointing device comprising a device-side control unit for displaying a level on the color display unit.
The pointing device according to claim 20 or 21,
When a plurality of color information is received before and after the time, the color information received after the time from the color display based on the color information received earlier in time is displayed. A pointing device having a single color mode for updating to a color display based on
The pointing device according to any one of claims 20 to 22,
When a plurality of color information is received before and after the time, the color display in the color display unit is changed from the color display based on the color information received earlier in time to each of the plurality of color information. A pointing device characterized by having a color mixing mode for updating to a color display obtained by mixing colors based on.
The pointing device according to claim 23.
In the color mixture mode, the operation time of the first operation unit, the number of operations of the first operation unit, or the operation of the first operation unit when a plurality of pieces of color information obtained before and after are received respectively. A ratio setting unit that sets a ratio when mixing colors based on the plurality of color information based on the applied pressure;
A generation unit that generates color information of a color obtained by mixing colors based on a plurality of pieces of color information received before and after using the ratio set by the ratio setting unit;
A pointing device comprising: a pointing device.
25. A pointing device according to claim 23 or claim 24.
The pointing device according to claim 1, wherein the color display unit displays a moving image showing a state in which colors based on a plurality of color information received before and after the time are mixed.
The pointing device according to any one of claims 23 to 25,
A storage unit that stores at least one or more pieces of color information received by the device-side receiving unit or color information generated by the generating unit;
A second operation unit operated when performing the input operation using the at least one color information;
A pointing device characterized by further comprising:
A pointing device according to any one of claims 20 to 26;
An electronic information terminal equipped with a touch panel on the display screen;
Consisting of
The pointing device is
A device-side transmission unit that transmits color information used when performing the input operation to the electronic information terminal;
The electronic information terminal is
A terminal-side transmission unit that receives the operation of the first operation unit of the pointing device and transmits color information at a position where the input unit of the pointing device is in contact with or close to the device-side reception unit;
A terminal-side receiving unit that receives color information transmitted from the device-side transmitting unit during an input operation using the pointing device;
Using the color information received by the terminal-side receiving unit, a terminal-side control unit that displays a drawing based on an input operation using the pointing device on the display screen;
An input system comprising: