JP5656496B2 - Display device and display method - Google Patents

Description

The present invention relates to a display device such as changing the size or position of the image displayed on the Viewing surface.

  Conventionally, projectors, televisions, displays, and the like are known as display devices. These display devices have been equipped with a function of enlarging or reducing a part of a display image (for example, Patent Document 1). There has also been proposed a projector that can capture characters written on a display screen and synthesize them with an image being projected (for example, Patent Document 2).

JP 2006-246306 A JP 2003-143348 A

  However, the projector disclosed in Patent Document 2 does not take into consideration a case where characters or the like are captured in a state where an image being projected is enlarged or reduced or a display position of the image being projected is changed. For this reason, for example, if characters written in a state in which the image being projected is enlarged or reduced or a display position of the image being projected is changed are photographed and synthesized as they are, it means that There was a case that the composite image without.

Accordingly, the present invention can detect that the written-out write only on the display screen is performed, the display state of the image at that time (for example, enlargement, reduction, or location) for recording information relating to The purpose is to do so.

Display device according to the present invention is a display device, display means for displaying an image on a display surface, and changing means for changing the magnification related to the image displayed on the display surface,-out writing on the display surface write detecting means for detecting that the body has been made, when the image on the display surface by said display means is displayed, said display written-out on the surface write only is performed is detected by the detection means Accordingly, a recording unit that records information indicating an enlargement ratio regarding the image displayed on the display surface on a recording medium, and after the enlargement ratio regarding the image displayed on the display surface is changed by the changing unit. When the operation is performed on the display device, the display device includes control means for using the information to return to the enlargement ratio before being changed by the changing means .

According to the present invention, it is possible to detect that the written-out write only on the display surface is performed, the display state of the image at that time (for example, enlargement, reduction, or location) for storing information related to.

1 is a block diagram illustrating a configuration of a projector 100 according to a first embodiment. 6 is a flowchart illustrating a control flow of a control unit 101 of the projector 100 according to the first embodiment. FIG. 3 is a diagram illustrating a state of a display surface on which projection display is performed using the projector 100 according to the first embodiment.

  Hereinafter, examples of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to the following embodiments. The embodiments of the present invention show preferred modes of the invention and do not limit the scope of the invention.

  In this embodiment, a projector having a function of enlarging or reducing a projected image and / or a function of changing the projection position of the projected image will be described as an example of the display device. The projector 100 according to the present embodiment can detect whether or not there are characters and images written by a user or the like on the screen (display surface). The projector 100 according to the present embodiment can record information related to the display state (enlarged or reduced or display position state) of the display image when such a character or image is detected. Therefore, for example, the projector 100 according to the present embodiment can display an image again later in an enlarged or reduced state or a display position in accordance with characters or images written on the display surface.

  In the present embodiment, an example in which a projected display image is electronically enlarged or reduced or a display position is changed by image processing will be described. However, for example, the zoom lens may optically execute the enlargement or reduction of the projection display image, or the shift lens may optically execute the display position of the projection display image. . In other words, the present invention can be applied to electronically enlarging or reducing an image or optically enlarging or reducing an image. Similarly, the present invention can be applied to an apparatus that electronically changes an image display position or an apparatus that optically changes an image display position.

  In this embodiment, a projector will be described. However, the projector has a function of enlarging or reducing a display image or a function of changing the display position of an image, and can detect a character or an image written on a display surface. Any display device may be used. For example, a television, a display, a mobile phone, a smartphone, a communication terminal, a laptop computer, a compact camera, a video camera, or the like may be used. Further, the present invention is a system comprising a display device having a function of enlarging or reducing a display image or a function of changing the display position of an image, and a detection device having a function of detecting characters or images written on the display surface. Also good. Similarly, in addition to a combination of a projector and a detection device, a combination of a detection device with a television, a display, a mobile phone, a smartphone, a communication terminal, a laptop computer, a compact camera, a video camera, or the like may be used.

  Hereinafter, the main configuration of the projector 100 according to the present embodiment will be described with reference to FIG.

  First, the control unit 101 includes a CPU and a memory or a microcomputer chip, and controls each functional block of the projector 100. The operation unit 102 receives a user instruction and transmits an instruction signal to the control unit 101. The bus 110 is for sending image data, control signals, and the like to each block of the projector 100.

  The recording / reproducing unit 120 reproduces moving image data, still image data, presentation data, document data, table data, and other data recorded on the recording medium 121. The recording / playback unit 120 can also read the moving image data and still image data recorded in the recording medium 121 and thumbnail data recorded in the header of other data. Here, the recording medium 121 only needs to be able to record data such as moving image data, still image data, presentation data, document data, and table data. For example, the recording medium may be any type of recording medium such as a magnetic disk, an optical disk, and a semiconductor memory, and may be a removable recording medium or a built-in recording medium. The recording / reproducing unit 120 transmits each reproduced data to the image processing unit 160 described later under the control of the control unit 101.

  The image input unit 130 receives image data from an external device such as a camera, a personal computer, or a mobile phone. For example, it is a terminal for inputting an image such as a high-definition multimedia interface (HDMI) (registered trademark) terminal such as an RGB terminal, a video terminal, and a D terminal.

  The communication unit 140 receives a control signal or image data from an external device such as a camera, a personal computer, or a mobile phone. For example, any communication such as wireless wired LAN, USB, Bluetooth (registered trademark) is possible. Further, if the terminal of the image input unit 130 is, for example, a High-Definition Multimedia Interface (HDMI) (registered trademark) terminal, CEC communication may be performed via the terminal.

  The display unit 150 is a liquid crystal panel or the like attached to the exterior of the projector 100, and displays an operation screen, a warning screen, or the like by the display control unit 151. The display unit 150 may be anything as long as it can display an image. For example, it may be a CRT display, an organic EL display, or an LED display.

  In addition, the image processing unit 160 displays the number of pixels, the number of frames, and the image shape of the image indicated by the moving image data and the still image data transmitted from the control unit 101, the recording / playback unit 120, the image input unit 130, the communication unit 140, and the like. To change. In addition to moving image data and still image data, images indicated by presentation data, document data, and table data may be processed. When the user operates the operation unit 102 to input a trapezoidal correction processing instruction, the image processing unit 160 changes the shape of the image data and that controlled by the control unit 101. In addition, a gravity sensor (not shown) that can detect the direction of gravity is provided, the inclination of the projection optical system is calculated from the inclination of the apparatus obtained by the gravity sensor, and based on the inclination angle, the keystone correction process is performed. The degree of deformation of the image data may be adjusted. Further, the image processing unit 160 electronically cuts and enlarges a part of the display image, electronically reduces the display image, or displays the display image on the display surface based on a user instruction. The position where the image is displayed can be moved.

  The liquid crystal control unit 170 forms an image to be projected and displayed on the liquid crystal unit 171 based on the image indicated by each of the data processed by the image processing unit 160. In the case of moving image data, an image is formed in the liquid crystal unit 171 every time one frame image transmitted from the image processing unit 160 is received. In the case of still image data, an image to be projected and displayed based on the image transmitted from the image processing unit 160 may be continuously displayed on the liquid crystal unit 171. For example, the image processing unit 160 may display the same image at 60 frames / second. May continue to be transmitted. Here, the liquid crystal unit 171 includes a single liquid crystal panel or a plurality of liquid crystal panels, a color filter (or a spectroscope, a dichroic mirror), a polarizing plate, and the like. A projected display image can be formed by applying a voltage for which a display image is controlled by the liquid crystal control unit 170 to the liquid crystal panel. Since the image formed on the liquid crystal panel can control the light transmittance, a visible image is formed by the light from the light source 181 described later being transmitted through the liquid crystal panel.

  The light source control unit 180 performs light amount control, on / off control, and the like of the light source 181. The light source 181 is configured by, for example, a high-pressure mercury lamp, a halogen lamp, an LED, or the like. A light beam from the light source 181 passes through a liquid crystal panel, a polarizing plate, a color filter, and the like of the liquid crystal unit 171 and is guided to the projection unit 190.

  The projection unit 190 includes a lens group that projects light that has passed through the liquid crystal unit 171 onto a screen (not shown). There may be a plurality of lenses or a single lens. The lens group of the projection unit 190 includes a zoom lens for optically enlarging or reducing the size of an image displayed on the display surface, and a shift lens for changing the display position on the display surface. It is. These lenses are moved by a lens drive motor (not shown), and the lens drive motor moves the position of the lens based on the control of the control unit 101. The lens group of the projection unit 190 may include an anti-vibration lens. The vibration of the apparatus is detected by a vibration sensor attached to the main body of the projector 100, and the control unit 101 controls the lens drive motor according to the detection result to move the position of the image stabilizing lens, thereby Reduce blur.

  The display control unit 151, the image processing unit 160, the liquid crystal control unit 170, and the light source control unit 180 of this embodiment may be a single chip or a plurality of chips that can perform the same processing. Alternatively, the same processing may be performed by a microcontroller that realizes the function of the control unit 101.

  Here, the normal operation of the projector 100 of the present embodiment will be described.

  When the user turns on the projector 100 using the operation unit 102 or a remote controller (not shown), power is supplied to each unit of the projector 100 from the power supply unit (not shown). Next, when the user gives an instruction to read and project still image data or moving image data (image data) from the recording medium 121 using the operation unit 102 or a remote controller (not shown), the control unit 101 instructs the recording / reproducing unit 120 from the recording medium. The designated image data is reproduced from the recording medium 121. The reproduced image data is transmitted to the image processing unit 160 under the control of the control unit 101. The image data input to the image input unit 130 and the communication unit 140 is also transmitted to the image processing unit 160 under the control of the control unit 101. The image data generated by the control unit 101 is also transmitted to the image processing unit 160. The image data referred to here includes the above-described presentation data, document data, and table data.

  The image processing unit 160 adjusts the number of pixels, the number of frames, the shape, the size (enlargement and reduction), the display position, and the like of the image indicated by the image data, and the liquid crystal control unit 170 under the control of the control unit 101. Send the processed image to. The liquid crystal control unit 170 adjusts the voltage applied to the liquid crystal panel of the liquid crystal unit 171 based on the received image, and causes the liquid crystal panel of the liquid crystal unit 171 to form an image. Then, the light source control unit 180 starts power supply to the light source 181 under the control of the control unit 101 and causes the light source 181 to emit light. The amount of light from the light source 181 is controlled by an image formed on the liquid crystal panel and input to the projection unit 190. The projection unit 190 projects the input light beam onto a screen (not shown).

  In this way, the image data recorded on the recording medium 121 is projected on the screen. Here, when a plurality of still image data and / or a plurality of moving image data are recorded on the recording medium 121, the control unit 101 displays a plurality of still image data and / or thumbnail images of the plurality of moving image data. Can be generated and displayed. At this time, the control unit 101 may control the recording / playback unit 120 so as to read the thumbnail image from the header of each moving image data or still image data, or perform image processing on a reduced image of each moving image data or still image data. It may be generated by the unit 160.

  In this embodiment, in addition to the above-described configuration, an imaging unit 165 and an imaging control unit 166 are further provided. The imaging unit 165 can image the screen (display surface) projected by the projection unit 190. The imaging unit 165 includes a photoelectric conversion element such as a CCD or CMOS sensor, an image forming circuit that converts an electronic signal obtained by the photoelectric conversion element into image data, and forms an image. The imaging control unit 166 controls the aperture, sensitivity, exposure time, and the like necessary for imaging by the imaging unit 165, and causes the imaging unit 165 to perform shooting according to an instruction from the control unit 101. Further, the image data obtained by the imaging unit 165 is captured by the control unit 101. The control unit 101 can compare a plurality of image data obtained by the imaging unit 165, compare with the image data being displayed, and analyze the image data.

  In the present embodiment, the control unit 101 transmits an imaging instruction to the imaging control unit 166 at the timing of switching the display image and the timing of instructing the enlargement or reduction of the image, and the imaging control unit 166 includes the imaging unit 165. Shoot the screen (display surface). You may make it image | photograph at the timing of the instruction | indication which changes the display position of a display image besides expansion and reduction.

  And the control part 101 can detect whether the character, the image, etc. are written on the display surface by acquiring and comparing the image data obtained at each timing. When the writing is detected, the control unit 101 records the enlargement / reduction state of the image in the image processing unit 160, the state of the display position, and the like in a memory or a recording medium (not shown) included in the control unit 101, or the recording medium 121. .

  For example, when the “return” button is operated, the control unit 101 reads a memory or a recording medium (not shown) included in the control unit 101, an enlarged or reduced state recorded on the recording medium 121, a display position state, and the like. put out. Then, the information regarding the state of the display image is transmitted to the image processing unit 160, and the image processing unit 160 returns to the state of the original display image according to the recorded information.

  By doing in this way, the projector 100 according to the present embodiment can restore the association between the characters and the like written on the display surface and the projected image.

  In the present embodiment, an example in which the projected display image is electronically enlarged or reduced or the display position is changed will be described. However, for example, the zoom lens may optically execute the enlargement or reduction of the projection display image, or the shift lens may optically execute the display position of the projection display image. . In that case, when the writing is detected, the control unit 101 records information on the position of the zoom lens as information indicating the state of enlargement or reduction, and information on the position of the shift lens as information on the display position.

  Here, a characteristic operation of the projector 100 according to the present embodiment will be described with reference to FIGS. FIG. 2 is a flowchart for explaining the operation from the start to the end of the projection of the projector 100 according to the present embodiment, which is an operation controlled by the control unit 101 of the projector 100. In the following embodiments, an example of enlarging an image being projected and displayed will be described, but enlargement may be replaced with reduction. Furthermore, it may be replaced with an example of changing the display position of the image. Further, it may be replaced with one that performs both enlargement or reduction and change of the display position. In the present embodiment, a display screen, which is a projection screen, that can be written by a user such as a whiteboard is used.

  In the present embodiment, an example in which a plurality of still image data recorded on the recording medium 121 is reproduced will be described. “Switching display image” indicates that a still image based on different still image data is displayed. Show. However, presentation data composed of a plurality of pages may be reproduced. In this case, “switching of display images” indicates that different pages are displayed.

  First, the power switch of the operation unit 102 of the projector 100 is operated, and power is supplied to each unit of the projector 100. Then, the control unit 101 controls the recording / reproducing unit 120 to read the specified still image data from the recording medium 121 according to a user instruction input to the operation unit 102. Then, the control unit 101 controls the recording / reproducing unit 120 to transmit the read still image data to the image processing unit 160. The image processing unit 160 adjusts the number of pixels so that the entire surface of the input still image is projected in consideration of the set distortion correction and the like, transmits the image to the liquid crystal control unit 170, and transmits the display surface through the projection unit 190. Projected and displayed on the screen (S201).

  Next, the control unit 101 of the projector 100 instructs the imaging control unit 166 to perform imaging by the imaging unit 165 in order to capture the display surface on which the still image is projected and displayed. The imaging unit 165 performs imaging, acquires image data (A) indicating an image on the display surface after the image is displayed, and the imaging control unit 166 transmits the obtained image data (A) to the control unit 101. (S202).

That is, the image data (A) in S202 is an image as shown in FIG. That is, the image data (A) is an image obtained by capturing an image of a display surface on which a still image indicating the entire reproduced still image data is displayed. (At this time, no instruction to enlarge the image has been entered yet.)
Thereafter, the control unit 101 determines whether or not the display image has been switched by the user's operation of the operation unit 102 (S203). That is, it is determined whether different still image data is designated by the user and projected and displayed on the display surface. Here, when the display image is switched (Yes in S203), the control unit 101 returns to the process of S202, causes the display surface to be captured again, and acquires new image data (A). Next, when the display image cannot be switched (No in S203), the control unit 101 determines whether or not an instruction to enlarge the display image is input by an operation of the operation unit 102 by the user (S204). If an instruction to enlarge the display image is not input (No in S204), the control unit 101 returns to the process of S203 and determines whether the display image has been switched. When an instruction for enlarging the display image is input (Yes in S204), the control unit 101 of the projector 100 uses the image capturing unit 165 to capture the display surface on which the still image is projected and displayed. An instruction is given to execute imaging. The imaging unit 165 captures an image, acquires image data (B) indicating an image on the display surface after the image is displayed, and the imaging control unit 166 transmits the obtained image data (B) to the control unit 101. (S205). At this time, enlargement of the projected display image is not executed.

  At this time, since characters and the like are not written on the display surface, the image data (B) in S205 is an image as shown in FIG. That is, the image data (A) taken immediately after the display image is displayed or switched, and the image data (B) at the time when the enlargement instruction is received, unless characters or the like are written on the display surface. The images are almost the same. When a character or the like is written on the display surface, a difference of the written character or the like occurs between the image data (A) and the image data (B).

  Next, the control unit 101 compares the image data (A) with the image data (B) and extracts a difference (S206). There are various methods for extracting the difference between the image data (A) and the image data (B). For example, there are the following methods.

  A pixel value at the same pixel position of the image data (A) and the image data (B) is detected, and an absolute value of a difference between the pixel values at the same pixel position is calculated. This is performed for all pixels, for example, and the sum of absolute values of differences between the respective pixel values is calculated.

  That is, it is assumed that the image data (A) and the image data (B) are images of X × Y dots, and the pixel value of each pixel of the image A is a (x, y) (x = 0 to X−1). , Y = 0 to Y−1), and the pixel value of each pixel of the image B is b (x, y) (x = 0 to X−1, y = 0 to Y−1). Then, the sum total of absolute values of differences between the respective pixel values is expressed by the following expression.

  Then, the control unit 101 determines whether or not the difference between the image data (A) and the image data (B) is larger than a predetermined threshold (S207). That is, it is determined whether or not the sum of absolute values of differences between the pixel values exceeds a predetermined value. This predetermined value may be set in advance to such a value that a certain amount of writing can be detected, or may be changed by setting the accuracy. That is, when the accuracy is increased, the predetermined value is lowered, and when the accuracy is roughened, the predetermined value can be increased.

  In this embodiment, it is used whether or not the sum of absolute values of pixel value differences for each pixel is larger than a predetermined value. However, after executing the binarization processing of the image, the number of pixels having a difference is determined. Whether the number is greater than a predetermined number may be used. In addition to this, any method may be used as long as the difference between the image data (A) and the image data (B) can be detected.

  Since the brightness of the room may change, the average value is calculated from the sum of the pixel values of multiple areas in each image, and the difference between the average values is calculated as the difference between the pixel values for each pixel. In doing so, an error due to the brightness of the image may be corrected.

  At the present time, as described above, since there is no writing of characters or the like on the display surface, there is no difference between the image data (A) and the image data (B), and the absolute value of the difference between the pixel values for each pixel is The sum is almost zero and is not larger than a predetermined value (threshold value). Therefore, at this point, the control unit 101 determines that the difference is not greater than a predetermined value (threshold value) (No in S207), and the control unit 101 cuts out a part of the still image indicated by the still image data. The image processing unit 160 is controlled to enlarge (S221). Then, the image processing unit 160 transmits the enlarged image to the liquid crystal control unit 170. As a result, an image obtained by enlarging a part of the still image indicated by the still image data is projected and displayed from the projection unit 190 on the display surface. In this embodiment, the control unit 101 controls the image processing unit 160 to cut out and enlarge a part of the image. However, the control unit 101 may enlarge a part of the projection display image displayed in a predetermined area on the display surface by controlling the operation of the zoom lens of the projection unit 190. By this enlargement process, for example, an enlarged image as shown in FIG. 3B is projected and displayed on the display surface.

  Next, the control unit 101 determines whether or not the user has operated the operation unit 102 to input an instruction to end projection display (S222). Here, when an instruction to end the projection display is input (Yes in S222), the control unit 101 controls the recording / reproducing unit 120 to end the reproduction of the still image data. Further, the projector 100 may be turned off depending on circumstances. If no instruction to end projection display is input, the control unit 101 returns to the determination of S203.

  Here, on the display surface as shown in FIG. 3B on which an enlarged image of the still image indicated by the still image data is projected and displayed (such as a whiteboard as described above), the user can display characters and images. The explanation will be continued as if it were written. FIG. 3C shows a display surface in which characters and images are written by the user.

  If the display image is not switched (No in S203) and an instruction to enlarge the display image is input (Yes in S204), the control unit 101 causes the imaging control unit 166 to capture an image using the imaging unit 165. Give instructions to run. The imaging unit 165 captures an image, acquires image data (B) indicating an image on the display surface after the image is displayed, and the imaging control unit 166 transmits the obtained image data (B) to the control unit 101. (S205). At this time, enlargement of the projected display image is not executed.

  This time, since the user has written characters and images on the display surface, the image data (B) obtained in S205 is an image as shown in FIG. That is, there is a difference between written characters and images between the image data (A) taken immediately after the display image is displayed or switched and the image data (B) at the time of receiving the enlargement instruction. It will be.

  Next, the control unit 101 compares the image data (A) with the image data (B) and extracts a difference (S206). By the method described above, the sum of absolute values of differences between pixel values for each pixel is calculated. Then, the control unit 101 determines whether or not the difference between the image data (A) and the image data (B) is larger than a predetermined threshold (S207).

  As described above, since characters and images are written by the user on the display surface this time, there is a difference between the image data (A) and the image data (B) by the amount of characters and images. The difference calculated by the above calculation is larger than a predetermined value (threshold value). That is, the total sum of the pixel value differences for each pixel is larger than a predetermined value (threshold value). It is assumed that the predetermined threshold is set to a value that can detect the difference between the images in FIGS. 3C and 3B of this embodiment.

  Therefore, the control unit 101 determines that the difference is larger than the predetermined value (Yes in S207), and the control unit 101 records information on the current display image enlargement ratio in the memory of the control unit 101. Alternatively, the recording / reproducing unit 120 is controlled to record on the recording medium 121 (S208). In the present embodiment, an example of recording information related to an enlargement ratio will be described. However, instead of the enlargement ratio, an enlarged display position, that is, a cutout position (display position) may be used. Moreover, the information of both the enlargement ratio and the cutout position (display position) may be used. The information on the display position may be information indicating which coordinate is in the upper left of the entire display screen in a state where the image is not enlarged, or may be information on the coordinates of the four corners of the enlarged image. good. Further, it may be information indicating which coordinate of the still image indicated by the original still image data is on the upper left, and indicates which coordinate on the still image indicated by the original still image data is enlarged. Information on the coordinates of the four corners may be used. In the present embodiment, the description is given of recording information on the enlargement ratio and display position of the display image enlarged by the image processing unit 160 in a memory or a recording medium such as the recording medium 121. However, if the zoom lens can be used to enlarge and reduce the image, information on the optical enlargement or reduction rate using the zoom lens may be recorded. Further, if the display position can be optically changed by the shift lens, the optical shift amount by the shift lens may be recorded as information on the display position. Further, it may be only information about the reduction rate, only information about the enlargement rate, or only information about the display position. Further, information obtained by combining these pieces of information may be used. Further, information on the electronic enlargement ratio, reduction ratio, and display position may be combined with information on the optical enlargement ratio, reduction ratio, and display position.

  Next, the image processing unit 160 is controlled to cut out and enlarge a part of the still image indicated by the still image data (S209). Then, the image processing unit 160 transmits the enlarged image to the liquid crystal control unit 170. As a result, an image obtained by enlarging a part of the still image indicated by the still image data is projected and displayed from the projection unit 190 on the display surface. In this embodiment, the control unit 101 controls the image processing unit 160 to cut out and enlarge a part of the image. However, the control unit 101 may enlarge a part of the projection display image displayed in a predetermined area on the display surface by controlling the operation of the zoom lens of the projection unit 190. In this embodiment, the example in which the instruction to enlarge is input in S204 has been described, but an instruction to reduce may be used.

  In this embodiment, as described above, information on the enlargement ratio of the display image when a character or the like is detected on the display surface is recorded. For example, when the “return” button is operated, the display surface is displayed. It is possible to read out the enlargement ratio when a character or the like is detected and return to the same display again.

  For this reason, the control unit 101 enlarges the display image, and then operates the “return” button to display the fact that the original enlargement ratio can be restored on the display image. The superimposition screen is transmitted to the unit 160 and superposed on the display image (S210).

  Next, the control unit 101 determines again whether the display image has been switched by the operation of the operation unit 102 by the user (S211).

  Then, the control unit 101 determines whether or not the “return” button has been operated by the user's operation of the operation unit 102 (S212). If the “return” button is not operated (No in S212), the control unit 101 performs the determination in S211 again. On the other hand, when the “return” button is operated (Yes in S212), the control unit 101 reads information on the enlargement ratio recorded in the memory or the recording medium 121 described above (S213). Then, the control unit 101 transmits the read enlargement factor to the image processing unit 160, and causes the enlargement factor of the display image to return to the enlargement factor when the user writes characters or images on the display surface (S214).

  With this operation, as shown in FIG. 3C, the display surface can return to a display in which the characters and images written on the display surface correspond to the projected display images again. If an image when the image is not enlarged is displayed on the display surface without performing such an operation, for example, characters and images written on the display surface and the projection unit of the projector 100 are displayed as shown in FIG. In some cases, the projected image does not correspond to the user and the user is confused. However, according to the present embodiment, the characters and images written on the display surface correspond to the display images, so that the user is not confused.

  Note that after returning the enlargement ratio, the control unit 101 determines whether or not the user has operated the operation unit 102 to input an instruction to end projection display (S222). Here, when an instruction to end the projection display is input (Yes in S222), the control unit 101 controls the recording / reproducing unit 120 to end the reproduction of the still image data. Further, the projector 100 may be turned off depending on circumstances. If no instruction to end projection display is input, the control unit 101 returns to the determination of S203.

  In the present embodiment, an example of enlarging an image being projected and displayed has been described, but enlargement may be replaced with reduction. Furthermore, it may be replaced with an example of changing the display position of the image. Further, it may be replaced with one that performs both enlargement or reduction and change of the display position.

  In S208 of this embodiment, the example in which the image processing unit 160 records the electronic image enlargement ratio has been described. However, the electronic image reduction ratio may be recorded, and the display position may be related. Display coordinates may be recorded as information. Further, when the image is optically enlarged or reduced, or the display position is changed, information on the position of the zoom lens may be recorded as the enlargement ratio or reduction ratio of the zoom lens. Further, information on the position of the shift lens may be recorded as information on the display position.

  In addition, in this embodiment, an example in which the image is magnified many times has not been described. However, every time there is an instruction to enlarge, reduce, or change the display position, an image of the display surface is captured, and characters or characters are displayed on the display surface. Whether an image or the like is written may be detected every time the image is enlarged or reduced. If written, information on the enlargement ratio, reduction ratio, and display position may be recorded each time.

  Although the projector has been described in the present embodiment, it has a function of enlarging or reducing the display image or a function of changing the display position of the image, and can detect a character or an image written on the display surface. Any display device may be used. For example, a television, a display, a mobile phone, a smartphone, a communication terminal, a laptop computer, a compact camera, a video camera, or the like may be used. Further, the present invention is a system comprising a display device having a function of enlarging or reducing a display image or a function of changing the display position of an image, and a detection function having a function of detecting characters or images written on the display surface. Also good. Similarly, in addition to a combination of a projector and a detection device, a combination of a detection device with a television, a display, a mobile phone, a smartphone, a communication terminal, a laptop computer, a compact camera, a video camera, or the like may be used. The detection device referred to here is, for example, an imaging device having an imaging unit 165, an imaging control unit 166, and communication means built in the projector 100. Then, when the imaging device receives an imaging instruction from the control unit 101 of the projector 100 from the communication unit at the timing of S202 or S205, the imaging device performs imaging of the display surface. Then, a difference is extracted from the obtained display screen image as in S206 and S207, and it is determined whether or not the difference exceeds a threshold value. Then, the determination result is such that the communication unit can be transmitted to the projector 100. The processes of S206 and S207 may be executed by the control unit 101 of the projector 100. Therefore, when the imaging apparatus receives the imaging instruction of the control unit 101 of the projector 100 from the communication unit at the timing of S202 or S205, the imaging device performs imaging of the display surface and transmits the obtained image to the projector 100. May be. Then, the control unit 101 of the projector 100 may execute the processes of S206 and S207 based on the received image. Such a display system may be used.

  Further, as another example of the detection device, a device such as a touch panel screen disposed on the display surface may be used. In this apparatus, when a user writes a character or an image on the touch panel, the user's writing can be detected on the touch panel side. When used in combination with this apparatus, the projector 100 does not need to perform imaging using the imaging unit 165 and the imaging unit 166. In addition, there is no need to compare captured images. That is, the operations of S202 and S205 to S207 can be omitted. Instead, when an enlargement instruction is received in S204, the control unit 101 communicates with the communication unit of the touch panel through the communication unit 140, and inquires whether the user's writing has been detected on the touch panel side. Thereby, it is possible to determine whether or not characters or images are written on the display surface. If it is written, the control unit 101 executes the processing from S208 to S214. That is, the present invention detects writing of characters and images arranged on the display surface without detecting whether characters or images are written on the display surface based on an image obtained by imaging the display surface. Even if it is a thing, it is applicable.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

Claims (12)

A display device,
Display means for displaying an image on a display surface;
Changing means for changing an enlargement ratio relating to an image displayed on the display surface ;
Detecting means for detecting that the written-out write only on the display surface is performed,
If the image is displayed on the display surface by said display means, in accordance with particular detected by the display written-out on the surface write only has been performed the detecting means are displayed on said display surface A recording means for recording information indicating an enlargement ratio regarding the image on a recording medium ;
When an operation is performed on the display device after the enlargement ratio relating to the image displayed on the display surface is changed by the changing means, the information is used to return to the enlargement ratio before being changed by the changing means. And a control means . The display device according to claim 1, wherein the control unit controls whether to record the information on the recording medium according to whether writing is greater than a predetermined value. The display device according to claim 1, wherein the changing unit includes a zoom lens for changing an enlargement ratio related to an image displayed on the display surface. A display device,
Display means for displaying an image on a display surface;
Changing means for changing a reduction ratio relating to an image displayed on the display surface;
Detecting means for detecting that writing has been performed on the display surface;
In the case where an image is displayed on the display surface by the display means, a reduction related to the image displayed on the display surface in response to detection by the detection means that writing has been performed on the display surface. Recording means for recording information indicating a rate on a recording medium;
When an operation is performed on the display device after the reduction ratio relating to the image displayed on the display surface is changed by the changing means, the information is used to return to the reduction ratio before being changed by the changing means. Control means and
A display device comprising: The display device according to claim 4, wherein the control unit controls whether or not to record the information on the recording medium, depending on whether or not the writing is greater than a predetermined value. The display device according to claim 4, wherein the changing unit includes a zoom lens for changing a reduction ratio related to an image displayed on the display surface. A display device,
Display means for displaying an image on a display surface;
Changing means for changing a position relating to an image displayed on the display surface;
Detecting means for detecting that writing has been performed on the display surface;
When an image is displayed on the display surface by the display means, a position relating to the image displayed on the display surface in response to detection by the detection means that writing has been performed on the display surface Recording means for recording information on the recording medium;
When the display device is operated after the position relating to the image displayed on the display surface is changed by the changing means, the control means returns to the position before being changed by the changing means using the information. When
A display device comprising: The display device according to claim 7, wherein the control unit controls whether or not to record the information on the recording medium, depending on whether or not the writing is larger than a predetermined value. The display device according to claim 7, wherein the changing unit includes a shift lens for changing a position of an image displayed on the display surface. A display method of a display device having display means for displaying an image on a display surface, and changing means for changing the magnification an image that is displayed on the display surface,
And Luz steps to detect that the written-out write only have been performed on the display surface,
If the image is displayed on the display surface by said display means, magnification an image of said display written-out on the surface write only is performed in response especially been detected, are displayed on the display surface and Luz steps be recorded on the information recording medium shown a
When the display device is operated after the enlargement ratio related to the image displayed on the display surface is changed, the information is used to return to the enlargement ratio before the change. A display method characterized by that. A display method for a display device, comprising: display means for displaying an image on a display surface; and change means for changing a reduction ratio related to the image displayed on the display surface,
Detecting that writing has been performed on the display surface;
When an image is displayed on the display surface by the display means, information indicating a reduction ratio related to the image displayed on the display surface in response to detection that writing has been performed on the display surface Recording on a recording medium;
When the display device is operated after the reduction ratio relating to the image displayed on the display surface is changed, the information is used to return to the reduction ratio before the change;
A display method characterized by comprising: A display method for a display device, comprising: display means for displaying an image on a display surface; and change means for changing a position relating to the image displayed on the display surface,
Detecting that writing has been performed on the display surface;
When an image is displayed on the display surface by the display means, information indicating a position related to the image displayed on the display surface is detected in response to detection that writing has been performed on the display surface. Recording on a recording medium;
A step of returning to the position before the change using the information when the display device is operated after the position related to the image displayed on the display surface is changed;
A display method characterized by comprising: