JP5329691B2 - Camera and camera control method - Google Patents

Description

The present invention relates to a camera and a camera control method , and more particularly to a camera having a scene shooting function provided by an external service such as a virtual space and a camera control method .

In recent years, there have been increasing opportunities to enjoy images by transmitting images using personal computer (PC) communication, the Internet, mobile phone lines, and the like, taking advantage of the ease of image transmission of digital cameras. On the Internet, there is a service for forming a virtual space different from the actual living space and providing an image of the virtual space. In this virtual world, buildings are built and land is developed by virtual residents who live in the virtual world, and the landscape changes every moment. An increasing number of people are enjoying the experience in a virtual reality space as if it were an everyday landscape.

As what captures such a computer graphic (CG) image, for example, in Patent Document 1, a name of a structure that should be visible in a computer image is acquired from a map information management unit for a captured image. In addition, a report support system that displays the structure name superimposed on a captured image is disclosed. According to this report support system, it is possible to instantly extract various information of each structure.
JP 2000-50156 A

In the report support system disclosed in Patent Document 1, a virtual space that is a composite display of a CG image and a real image and is constructed on the net like a virtual real space can be operated by the same operation as a conventional camera. It is not possible to shoot, and the virtual reality experience cannot be recorded in memories just like a real experience.

  In other words, in the virtual world, landscapes are constantly changing by virtual residents, and in landscapes that change at a speed faster than reality, there is a desire to record their experiences at a certain time as images. is there. However, there was no camera that could capture both the virtual world experience and the real experience with the same feeling.

This onset Ming has been made in view of such circumstances, and aims to provide a scene generated by the computer graphics, a camera and a camera control method that can be taken by the same operation as the real scene To do.

Camera according to the first invention for achieving the above object, an imaging device, a display unit, a detectable motion detector motion detection information regarding camera movement of Kageji Ta, the output of the image pickup device The virtual image of the virtual space transmitted from the external device is switched according to the image based on the image and the motion detection information transmitted from the camera and displayed on the display unit, and the imaging according to the instruction of the release unit An image recording unit that records an image based on an element or the virtual image, and the display control unit outputs an output of the imaging element from a virtual image in the virtual space in accordance with imaging of the predetermined image in the virtual space. Switching to an image based on the above.

Camera according to the second invention, in the first invention, the display control means in accordance with taking a predetermined image in the real world, from the image based on the output of the image pickup device to the virtual image picture of the virtual space It is characterized by switching.
According to a third aspect of the present invention, there is provided a camera according to the first aspect, further comprising a determination unit capable of determining whether or not communication with the external device is possible, and for the external device, a virtual image of the virtual space. It is characterized by requiring.

In order to achieve the above object, a camera control method according to a fourth aspect of the invention is to detect motion detection information related to camera motion during shooting, to detect an image based on the output of an image sensor, and to transmit the motion detection information from the camera The virtual image of the virtual space transmitted from the external device is switched and displayed on the display means, and the output of the image sensor is output from the virtual image of the virtual space according to the shooting of the predetermined image in the virtual space. The image based on the image sensor is switched, and the image based on the image sensor or the virtual image is recorded in accordance with an instruction from the release unit .

ADVANTAGE OF THE INVENTION According to this invention, the camera which can image | photograph the scene produced | generated by computer graphics by operation similar to a real scene, and the control method of a camera can be provided. In addition, switching from the virtual image in the virtual space to the image based on the output of the image sensor is performed according to the shooting of the predetermined image in the virtual space, so that switching from virtual to real can be performed with a natural interface. .

Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied and a virtual space service system according to the drawings. The camera according to the first embodiment of the present invention is connected to a virtual service via a communication network such as a telephone line or the Internet. When the captured image and the captured information satisfy a predetermined condition, the virtual space can be entered. When entering the virtual space, the scene is displayed on the display of the camera, and if there is a favorite image, the user can record the still image by performing a release operation in the same way as normal camera shooting. it can.

  FIG. 1 is a block diagram of a digital camera and its surroundings according to an embodiment of the present invention. A camera 100 used by a user includes a photographic lens 2, an AF (autofocus) control unit 2a, an aperture 2b, an aperture control unit 2c, an image sensor 3, and an analog front end (hereinafter referred to as AFE) unit 4. Yes. The taking lens 2 has a focus lens inside, and forms an image of the incident subject 20 on the image sensor 3.

  The AF control unit 2a performs image processing in an image processing unit 5 to be described later, detects an in-focus position of the photographic lens 2, detects it by a so-called hill-climbing method, drives the focus lens, and moves it to the in-focus position. Note that the hill-climbing method is a method for detecting the in-focus position (focus position) from the contrast signal peak of the photographed image. In addition to the hill-climbing method, for example, a known focusing method such as a phase difference method or a triangulation method can be used. It may be replaced. When the in-focus position is reached by AF, the distance can be determined by detecting the photographing lens 2 at this time. In this case, when the photographing lens 2 is a zoom lens, the distance is determined in consideration of the zoom position and the like.

  A diaphragm 2b that provides the effects of a shutter and a diaphragm is provided in or near the photographing lens 2. The diaphragm 2b is opened to a predetermined aperture at the time of photographing, and is closed when the exposure is finished to finish the exposure. The aperture control unit 2c drives the aperture 2b to set the aperture diameter. By changing the aperture, the depth of field of the lens changes, so you can change the expression by adjusting the blurring of the background, etc. Can do. The image pickup device 3 is a CCD or CMOS sensor having a large number of light receiving surfaces (pixels), and receives an image from the subject 20 via the photographing lens 2 and converts it into an image signal.

  The analog front end (AFE) unit 4 includes analog-to-digital conversion (AD) means, and converts a signal from the image sensor 3 into a digital signal. The AFE unit 4 performs various processes on the image signal output from the image sensor 3. The AFE unit 4 is also provided with a function of reading several pixels of the image pickup device 3 together and reading them together. For example, when the signal level of each pixel is small, such as 4 pixels (2 × 2) and 9 pixels (3 × 3), several pixel signals can be added to improve the S / N. Sensitivity can also be increased.

  Sensitivity can be increased by such an operation, and it is possible to devise photography such as increasing the shutter speed. When the shutter speed is high, it is possible to shoot as if the moving subject is stopped.

  The AFE unit 4 has a function of selecting signals output from the image sensor 3 and can extract image data in a limited range from the light receiving range. In general, when pixel signals thinned out from the pixels of the image sensor 3 are extracted, high-speed reading is possible. Thus, the image signal for composition confirmation is processed at high speed by the image processing unit 5 and displayed on the display panel 8 via the display control unit 8a, thereby enabling framing.

  The output of the AFE unit 4 is connected to the image processing unit 5. The image processing unit 5 corrects the color, gradation, and sharpness of the input signal. Further, it has an intensifying unit that amplifies the image signal obtained from the image sensor 3 to a predetermined level and sets the correct gray level and the correct gray level. This is a digital operation so that the digitized signal level becomes a predetermined level. In addition, the image processing unit 5 includes a resizing unit 5b that processes a signal from the image sensor 3 to a size that can be displayed on the display panel 8 so that a live image can be displayed on the display unit in real time. By this function, an image incident on the image sensor can be confirmed prior to shooting, and the timing and photo opportunity at the time of shooting can be determined while viewing this.

  In addition, the image processing unit 5 has an image determination function for determining characteristics of an image input from the image sensor using the signal of the image processing unit 5. For example, a shape determination unit 5a that detects the shape of an object being captured from contour information obtained by processing image information, or a distance determination unit 5c that determines the distance of the subject by determining the contrast of the signal level of the image. In addition, the system includes a motion detection unit 5d that examines changes in the image with time and detects the movement of the camera and the subject. These are used to determine what kind of photograph the user is going to take at the time of taking a picture and optimize the taking control.

  The image processing unit 5 has a function of determining the contrast of the image described above, and controls autofocus in conjunction with the focusing unit of the photographic lens. The distance determination unit 5c described above can determine the distance of the subject, the distance of the background, and the like based on the information on the lens position when the photographing lens 2 is focused.

  Further, the camera 100 is provided with a compression unit 6, a recording unit 9a, a recording medium 9, a transmission / reception unit 9c, a reception setting unit 9d, a transmission setting unit 9e, a display panel 8, a display control unit 8a, and a multi-image processing unit 8b. ing. The compression unit 6 compresses the signal output from the image processing unit 5 at the time of shooting. The compression unit 6 includes MPEG (Moving Picture Experts Group) 4 and H.264. A still image compression unit such as a compression unit for moving images including a compression core unit such as H.264 and a JPEG (Joint Photographic Experts Group) core unit is provided. The compression unit 6 also performs image expansion when reproducing an image recorded on the recording medium 9 on the display panel 8.

  The recording unit 9 a records the compressed image signal on the recording medium 9. The recording medium 9 is a storage recording medium that can be attached to and detached from the camera. In recording an image signal, time information when a photograph is taken may also be recorded. The photographing time information is measured by a clock unit 1t in the MPU 1 described later, and the MPU 1 associates with the image.

  The captured image data recorded on the media 9 or the recording unit 9a is transferred to another device such as a server 33 that manages images by the transmission / reception unit 9c via the communication line 32 such as the Internet or a telephone line, or directly or A virtual space service provider can be connected via the server 33. The transmission / reception unit 9c is connected to a reception setting unit 9d and a transmission setting unit 9e. The reception setting unit 9d is a designation unit that designates a reception destination, and the transmission setting unit 9e is a designation that designates a transmission destination. Part.

  The display panel 8 is composed of, for example, a liquid crystal or an organic EL, and displays a subject image for observation at the time of photographing, and displays an expanded recorded image at the time of reproduction. The display panel 8 displays a CG image of the virtual space received via the transmission / reception unit 9c.

  The display control unit 8 a controls display on the display panel 8. The multi-image processing unit 8b is a control unit for displaying a plurality of images on the display panel 8. By this multi-image processing unit 8b, it is possible to display characters of a destination address and various warnings on the captured image and the captured image. The display panel 8 displays a list of images that have been taken and transmitted, and from there, an image to be uploaded to a blog service or the like operated by the server 34, or a layout for uploading and displaying the image on a blog can be selected. You may do it.

  The camera 100 is provided with an auxiliary light emitting unit 11, an MPU (Micro Processing Unit) 1, a release switch 1a, a mode switch 1b, and another switch 1c. The auxiliary light emitting unit 11 includes a white LED and a Xe discharge light emitting tube, and the amount of light can be controlled by the amount of current. Depending on the situation, the subject 20 is irradiated with light to prevent lack of brightness and uneven brightness.

  The MPU 1 is a control unit that controls the entire camera. A release switch 1a, a mode switch 1b, another switch 1c, and a ROM (not shown) storing a program and the like are connected to the MPU 1. A clock unit 1t for detecting the date and time is provided in the MPU 1, and the shooting date and time of the photo is detected and associated with the captured image. Note that the switches 1b and 1c are generically displayed switches, and are actually composed of a large number of switch groups.

  Each switch 1a-1c detects a user's operation, and notifies the result to MPU1 which is a calculation control means consisting of a microcontroller. The MPU 1 switches the operation according to the operation of these switches. The MPU 1 functions as a shooting control unit that controls the AF control unit 2a, the aperture control unit 2c, and the like when shooting, and further captures a CG image of the virtual space received via the Internet or the like when shooting the virtual space. Recording is performed on the recording unit 9a and the recording medium 9.

  As described above, the camera 100 can receive provision of a virtual space service by using the transmission / reception unit 9c. This service provides the virtual space configured by CG, and the user creates a graphic of the building on the virtual land in this virtual space, as if it is presenting a city-like landscape is there. Such a service is a virtual world to the last, but the latest 3D technology gives you the feeling of walking in it, giving you a real-world experience.

  Therefore, even if you enter such a space, you will be offended if you set up with an unnatural interface. It is desirable that a natural interface that enters the virtual space after photographing the real space is required, and it is possible to shoot while going back and forth without being conscious of the reality and the virtual reality. Therefore, it is desired to devise a technique that allows the user to shift to shooting in a virtual space while enjoying actual shooting. In the present embodiment, when shooting is performed that satisfies a predetermined condition, a server that provides the virtual space is accessed to enter the virtual space. The condition determination unit 1d connected to the MPU 1 determines whether or not the condition for real to virtual transition is satisfied.

  Next, with reference to FIG. 2, an explanation will be given focusing on the exchange of image data and information among the camera 100, the server 33, and the server 34 that provides the virtual space. FIG. 2 shows the internal structure of the server 33, and the exchange of images transmitted by the camera 100 and CG image data transmitted from the server 33.

  The server 33 is linked to a server 34 that provides a virtual space CG, and a CG library 34 a for generating a virtual space CG is provided in the server 34. The server 33 is a server that is the access destination of the camera 100, and when receiving access from the camera 100, the server 33 is connected to the receiving unit 33 c for receiving data and connected to the receiving unit 33 c to store the data. A recording unit 33b for recording is provided.

  The receiving unit 33c is connected to a condition determining unit 33a that determines whether an image to which the received information such as shooting conditions is attached satisfies a predetermined condition. Further, the condition determination unit 33a is connected to a cooperation unit 33f for cooperation with the server 34 according to the determination result. The cooperation unit 33 f is connected to the server 34 and receives virtual space CG data from the server 34. The cooperation unit 33f is connected to the transmission unit 33b, and the transmission unit 33b transmits CG data to the camera 100.

  The operation of the system according to this embodiment will be described with reference to FIG. The captured image captured by the camera 100 is received by the receiving unit 33c and stored in the recording unit 33d. The image recorded in the recording unit 33d can be opened to the public and viewed. In addition, the received photographed image is determined by the condition determination unit 33a as to whether or not a predetermined condition described later with reference to FIG. 3 is satisfied.

  When the predetermined condition is satisfied in this determination unit, the image having the predetermined scenery is selected through cooperation with the server 34 having the CG library 34a in the virtual space through the cooperation unit 33f, and the CG image is transmitted through the transmission unit 33b. Data 36 is transmitted to the camera 100. Upon receiving the virtual space image data 36, the camera 100 displays the virtual space image as a moving image on the display panel 8 provided on the back of the camera or the like (see FIG. 4). In normal use, the display panel 8 displays a through image acquired via the photographing lens 2 or a reproduced image of a recorded captured image. In this embodiment, in addition to these images, a virtual image is displayed. An image of the space is also displayed.

  As a result, it is possible to obtain the effect of wandering in a virtual space after actual shooting. Here, a display image as if a real landscape continues is prepared so that it can be further penetrated from there. When the photographed image in the lens moves, it is detected by the motion detector 5d in the image processor 5, and the landscape changes as shown in FIGS. 4A to 4B according to the detection result. You can do it. At this time, by transmitting the detection result in the motion detection unit 5 to the server 33, the server 33 transmits an image of the virtual space corresponding to the motion to the camera 100.

  When the landscape of the virtual space is displayed on the display panel 8, the camera 100 can shoot the virtual space. When a photographing operation is performed in this state, a landscape image in the virtual space is photographed as a still image and recorded in the recording unit 9a and the recording medium 9. Note that still image data representing an image in a high-quality virtual space may be transmitted from the server 34 to the camera 100 by transmitting a photographing signal.

  As described above, the camera 100 according to the present embodiment can shoot both real and virtual spaces. Next, a transition method between the real and virtual spaces will be described with reference to FIG. There are various transition methods from the real world to the virtual space, but three examples are given here.

  The first example is a transition method based on a change in shooting position. Photographing is performed at a location A shown in the map of FIG. The condition determination unit 1d determines from the shooting position information detected by the GPS that the photographer is shooting while moving to the lower left on the map of FIG. Next, it is determined that the user wants to take a picture at the place C, and the place C is actually the sea, but is linked to the service that formed the virtual city so that this virtual landscape can be taken. In this way, it is possible to shoot in a space where actual shooting is not possible. If the condition determination unit 1d or the condition determination unit 33a of the server 33 has an image determination function as will be described later, and the shooting location can be specified by this image determination function, it is necessary to attach shooting position information to the shot image. Disappears.

  The second example is a transition method based on a change in time information. In addition to the change in location as shown in FIG. 3 (a), as shown in FIG. 3 (b), if the next shooting is performed at a predetermined date and time, the next shooting is performed. You may make it become virtual space imaging | photography. For example, if you take a picture of a weekend destination on a weekend and take the picture the next day on a Sunday, the next Monday will return from the destination, but you may not be actually at the destination, If the CG image configured as described above can be photographed, it is possible to perform photographing with the reverberation after returning from the trip.

  The third example is a transition method based on the shooting of the shooting prohibited area. In this case, as shown in FIG. 3C, a sign prohibiting photographing is photographed from a distance and photographed a little closer. If the server 33 determines that it is such an image, the signboard tip is actually a shooting-prohibited area, but it is possible to deliver an image of the landscape ahead of the signage-prohibited signboard and shoot it in a pseudo manner. Service can be performed. In fact, even a cultural property that is prohibited from entry can be viewed and photographed in a pseudo manner, so that it is possible to provide services that help protect cultural properties.

  Next, the operation of the camera 100 will be described using the flowchart shown in FIG. Here, the determination of the transition from the real world to the virtual space is not performed by the condition determination unit 33a in the server 33, but is performed by the condition determination unit 1d in the camera 100. First, it is determined whether or not the photographed image satisfies a predetermined condition for transitioning to the virtual space, that is, whether or not the condition as shown in FIGS. 3A to 3C is satisfied (S1). ). As a result of the determination, if the predetermined condition is not satisfied, the process proceeds to step 2 and the subsequent camera control is performed.

  As normal camera control, first, a through image display is performed (S2). Here, in the through image display, the subject image formed on the image sensor 3 by the photographing lens 2 is photoelectrically changed, and image data based on the subject image is displayed on the display panel 8 as a moving image. Next, a release operation is performed, and it is determined whether or not to perform shooting (S4). As a result of the determination, when shooting is performed, still image data is acquired (S5), and image data is recorded on the recording unit 9a or the recording medium 9 (S6).

  Next, the image taken in step S5 is determined (S7). The determination here is made by the condition determination unit 1d and is a determination as to whether or not the transition condition to the virtual space as described above with reference to FIG. 3 is satisfied. As a result of the determination, if a predetermined condition is satisfied, a setting that satisfies the condition is made (S8 → S9). Note that the condition determination in step S7 is not only a transition from the real world to the virtual space but also a condition determination including the case of returning from the virtual space to the real world, and when the condition is satisfied when in the virtual space. Is changed from “satisfying condition” to “not satisfying” in step 9.

  If it is determined in step S9 that the condition is satisfied, the flow is returned, and since the predetermined condition is satisfied in the determination of returning to step S1 again, the process proceeds to step S3a. Step S3a is a step of moving from actual shooting to display of the virtual space. The server 33 requests the virtual space image data from the server 33 and reproduces and displays the transmitted virtual space image on the display panel 8 (S3a).

  Subsequently, whether or not the user moves and moves the camera 100 is detected by the motion detection unit 5d based on the image signal output from the image pickup device 3, and moves in the virtual space when moving. Thus, the image is switched (S3b). In step S4, when the user wants to photograph a scene in the virtual space, the above-described photographing operation step is executed. That is, the steps after S4 are common and the photographing operation is common so that photographing can be enjoyed without any difference from actual photographing.

  If it is determined in step S4 that shooting is not being performed, the process proceeds to step S11 to determine whether or not playback is to be performed. When the user desires to reproduce an image, the mode is switched to the reproduction mode by the mode changeover switch 1b or the like, so that determination is made by detecting these switches. If the result of determination is playback, playback is performed (S12). The subject image and the virtual space image acquired by the photographing lens 2 and the image sensor 3 can be reproduced, displayed on the display panel 8, and enjoyed.

  According to the present embodiment, it is possible to provide a camera that can shoot a scene that cannot be shot with a normal camera by the same operation as the normal camera. That is, in the present embodiment, when an image of a virtual space generated by computer graphics is received via the transmission / reception unit 9c and displayed on the display panel 8, a release operation is performed in the same manner as in normal shooting. The image in the virtual space can be recorded on the recording unit 9a or the recording medium 9.

  Further, according to the present embodiment, the motion detection unit 5d of the image processing unit 5c is based on the image signal from the imaging device 3 while the virtual space image received by the transmission / reception unit 9c is displayed on the display panel 8. The server 33 is requested to request an image so that the image in the virtual space moves in accordance with the detected motion. Therefore, the user can freely look around the virtual space through the display panel 8 of the camera 100.

  Furthermore, according to the present embodiment, the condition determination unit 1d determines whether or not a plurality of captured images satisfy a predetermined condition, and makes a transition to the virtual space. To jump from the real world to the virtual world, simply connecting to a specific address is too mechanical to enjoy the virtual space. Therefore, in this embodiment, when receiving provision of the image of the virtual space from the virtual service, the setting is made so that the change from the reality to the virtual world can be experienced.

  Next, a second embodiment of the present invention will be described using the flowcharts of FIGS. In the first embodiment of the present invention, whether or not the predetermined condition for transition to the virtual space is satisfied is determined by the condition determination unit 1d provided in the camera 100. In the second embodiment, the condition determination unit 33a of the server 33 determines whether or not a predetermined condition is satisfied. Since the configuration of the second embodiment is the same as that of the first embodiment except that the flowchart of FIG. 5 is replaced with FIG. 6 and FIG. 7, only the differences will be mainly described.

  In the control flow of the camera 100 in the present embodiment, normal shooting is performed in step S34 and subsequent steps, reproduction display is performed in step S41 and subsequent steps, and as other modes, a virtual space request is performed in step S51 and subsequent steps. First, in step S31, it is determined whether image data in the virtual space is being received from the server 33. If the result of determination is that reception is not in progress, a through image display is performed as in step S2 in the first embodiment (S32).

  Next, it is determined whether or not the photographing is performed in the same manner as Step S4 in the first embodiment (S34). As a result of the determination, in the case of shooting, shooting is performed as in step S5 (S35). Thereafter, in order to determine whether or not the condition for transition to the virtual space as described with reference to FIG. 3 is satisfied, information on shooting conditions such as position information and time information is added (S36). When the shooting conditions are added, the shot image is recorded (S37). In this recording, additional information on the shooting conditions is also recorded in association with the shot image. When recording is complete, return to the beginning of the flow.

  If the result of determination in step S34 is not shooting, it is next determined whether or not to play back (S41). As a result of the determination, in the case of reproduction, a reproduction operation is performed as in step S12 of the first embodiment. When the reproduction operation is finished, it is next determined whether or not to perform recording communication with the server 33 (S43). That is, when it is desired to transmit the image being played back to the server 33 for publication, a recording communication operation is performed (S44). The transmitted image is stored in the recording unit 33d of the server 33 and released.

  If the result of determination in step S41 is not reproduction, it is determined whether or not it is determined whether or not a predetermined condition for transition to the virtual space is satisfied. This determination is made when communication with the server 33 becomes possible through a hot spot or the like. When it is determined whether the predetermined condition is satisfied, the photographing condition obtained in step S36 is transmitted to the server 33 (S52), and a virtual image transmission is requested (S53). The server 33 determines the shooting conditions. If satisfied, the server 33 transmits an image of a virtual space suitable for the state where the camera 100 is placed. When the virtual space request is transmitted, the process returns to the first step. Even when the camera 100 is set to the virtual space mode for forcibly transitioning to the virtual space, the step S51 is skipped in Yes and a virtual space request is made.

  Returning to step S31, it is determined whether or not an image in the virtual space is received. If there is reception, the virtual image in the virtual space is displayed (S33a). At this time, the motion detector 5d detects the camera motion based on the image signal of the image sensor 3 of the camera 100, and transmits it to the server 33 (S33b). The server 33 moves the virtual landscape according to the movement. As in the first embodiment, if there is a favorite scene, the user performs a shooting operation in step S34 and subsequent steps and records the image (S37). With the above operation, the user can enjoy shooting with the feeling that he or she has been drowned in the virtual space.

  Next, the operation of the server 33 that transmits an image of the virtual space to the camera 100 will be described using the flowchart shown in FIG. First, it is determined whether a captured image has been transmitted from the camera 100. This is a step in which the server 33 receives the image transmission performed by the camera 100 in step S44 (FIG. 6) described above. If it is determined that an image has been input, the image is recorded in the recording unit 33d (S102). The images recorded here can be browsed by many people and can be released quickly. That is, if there is an access from a PC or mobile phone, the signal is determined in step S121, and image browsing is enabled when the predetermined password matches in step S122 (S123). Of course, when many people want to see, there is no need to restrict viewing.

  If the result of determination in step S101 is not image input, it is next determined whether or not virtual space communication is in effect (S111). In other words, the camera 100 transmits a photographed image together with the photographing condition acquired in step S36 when the virtual space image request is made in step S53.

  If the result of determination in step S111 is virtual space communication, it is next determined whether or not the shooting position and time change satisfy the conditions (S112). Here, when the change in the position and time of the captured image satisfies the predetermined condition as described with reference to FIGS. 3A and 3B, the process leaves Yes and proceeds to step S115. On the other hand, if the result of the determination in step S112 is No, it is determined whether or not the photographed image as described in FIG.

  If the result of determination in step S113 is No, it is determined whether or not the camera 100 is set to a predetermined mode (S114). That is, it is determined whether or not other conditions are satisfied, such as when the camera 100 is set to the virtual space mode and a virtual space request is made in step S53, or the shooting position is at a specific place such as an amusement park. . If it is determined that the predetermined mode is set, the process proceeds to step S115.

  In step S115, it is determined whether or not the user is currently in the virtual space. That is, in this embodiment, when not in the virtual space, if a predetermined condition is satisfied, the virtual space is entered. On the other hand, if the predetermined condition is satisfied in the virtual space, the virtual space returns to the real world. It is configured. Therefore, if the result of determination is that there is no virtual space, processing branches from step S115 to step S116, and the server 33 transmits image data in the virtual space according to the conditions of the image transmitted from the camera 100.

  At this time, if the image condition transmitted from the camera 100 includes the shooting position information, an image of the virtual space corresponding to the shooting position may be sent. For example, if it is an amusement park like Disneyland, the virtual space is suitable. Next, the motion signal of the camera 100 transmitted in step S33b is received, and the display of the virtual space is switched according to the motion signal (S117). Thereby, it is possible to take a picture while moving in the virtual space.

  As a result of the determination in step S114, if the virtual space is already entered, the process branches from step S115 to S118, and when shooting under a predetermined condition is performed in the virtual space, switching to real space shooting is performed. For example, if it is a method to go to the door 37 as shown in FIG.4 (b) and open there and return to a real image, it will become a transition of a natural scenery.

  According to the second embodiment of the present invention, the imaging condition is determined by the image transmission destination server 33 instead of the camera 100, and an external database can be used, so that more complicated condition setting is possible. . In the present embodiment, the server 33 determines the predetermined condition for transitioning to the virtual space and returning from the virtual space to the real world. First, the condition determination unit 1d of the camera 100 When the primary determination is performed and the primary determination is satisfied, the server 33 may perform determination under more complicated conditions.

  As described above, according to the embodiment of the present invention, it is possible to provide a camera in which the photographing area is further enlarged from the real space, increase the rate of using and carrying the camera, and make it easier to use the camera. In addition, it is possible to provide a camera that can shoot a scene that cannot be shot with a normal camera by the same operation as the normal camera.

  Further, according to the present embodiment, the movement of the camera 100 is detected while the virtual space image is being displayed on the display panel 8, and the virtual space image is moved in accordance with the detected movement. For this reason, although it is a virtual space, it can enjoy like the real world. In the present embodiment, the motion of the camera 100 is detected by the motion detection unit 5d of the image processing unit 5c based on the image signal from the image pickup device 3, but the present invention is not limited to this. The movement of the camera 100 may be detected by a sensor or the like.

  Furthermore, according to the present embodiment, the condition determination unit 1d in the camera 100 and the condition determination unit 33a of the server 33 determine whether or not a predetermined condition for transition is satisfied based on the shooting condition and the shot image. And transition between the virtual space and the real world. Therefore, it is possible to switch from real to virtual and from virtual to real with a natural interface.

  In the description of each embodiment, the image to be recorded on the recording unit 9a or the recording medium 9 is still image data. However, the present invention is not limited to this, and a moving image may be recorded. In this case, the recording of the moving image may be started when the release switch 1a is operated, and then the recording of the moving image may be stopped when the release switch 1a is operated.

It is a block diagram of the camera concerning 1st Embodiment of this invention, and its periphery. 1 is a block diagram illustrating a system including a camera, a server, and a server that provides a virtual space according to the first embodiment of the present invention. In the first embodiment of the present invention, it is a diagram for explaining a predetermined condition for transition to a virtual space, (a) is a diagram for explaining an example of transition from a change in shooting position, (b) is a time change It is a figure explaining the example which changes more, (c) is a figure explaining the example which changes by the change of a picked-up image. In the first embodiment of the present invention, the display state of the virtual space image on the display panel of the camera is shown, and the view of the virtual space changing according to the movement of the camera is described. 3 is a flowchart showing a camera control operation according to the first embodiment of the present invention. It is a flowchart which shows the operation | movement of control of the camera in 2nd Embodiment of this invention. It is a flowchart which shows the operation | movement of control of the server in 2nd Embodiment of this invention.

1 ... MPU, 1a ... release switch, 1b ... mode switch, 1c
..Other switches, 1d ... condition determining unit, 1t ... clock unit, 2 ... photographing lens, 2
a ... AF (autofocus) control unit, 2b ... aperture, 2c ... aperture control unit, 3.
..Image sensor, 4... Analog front end (AFE) unit, 5... Image processing unit, 5
a ... shape determination unit, 5b ... resize unit, 5c ... distance determination unit, 5d ... motion detection unit, 6 ... compression unit, 8 ... display panel, 8a ... display Control unit, 8b ... multi-image processing unit, 9 ... recording medium, 9a ... recording unit, 9c ... transmission / reception unit, 9d ...
Reception setting unit, 9e: Transmission setting unit, 11: Auxiliary light emitting unit, 20 ... Subject, 3
DESCRIPTION OF SYMBOLS 1 ... Other users, 32 ... Communication line, 33 ... Server, 33a ... Condition determination part, 33b ... Transmission part, 33c ... Reception part, 33d ... Recording part, 33f: Cooperation unit, 34 ... Server, 34a CG library, 35 ... Transmission image, 36CG
Image data, 37 ... door, 100 ... camera

Claims (4)

An image sensor;
Display means;
And detectable motion detector motion detection information regarding camera movement of Kageji shooting,
A display control means for switching a virtual image of a virtual space transmitted from an external device in accordance with an image based on an output of the image sensor and the motion detection information transmitted from the camera, and displaying the virtual image on the display means;
In accordance with an instruction from the release unit, an image recording unit that records an image based on the image sensor or the virtual image,
With
The camera according to claim 1, wherein the display control means switches from a virtual image in the virtual space to an image based on an output of the imaging device in accordance with the photographing of a predetermined image in the virtual space . The display control means in accordance with taking a predetermined image in the real world, the camera according to claim 1, characterized in that for switching from the image based on the output of the image pickup device to the virtual image picture of the virtual space.   The camera according to claim 1, further comprising a determination unit that can determine whether communication with the external device is possible, and requesting the virtual image of the virtual space from the external device. Detect motion detection information about camera movement during shooting,
In accordance with the image based on the output of the image sensor and the motion detection information transmitted from the camera, the virtual image of the virtual space transmitted from the external device is switched and displayed on the display means, and the predetermined image in the virtual space is displayed. According to the image shooting, switching from the virtual image of the virtual space to an image based on the output of the image sensor,
According to the instruction of the release unit, the image based on the image sensor or the virtual image is recorded.
A camera control method.

Images