JP5245953B2 - Presentation image generation method and apparatus, and image forming apparatus - Google Patents

Description

  The present invention relates to a method and apparatus for generating a presentation image to be projected onto a screen by a projection apparatus, and an image forming apparatus.

  Generally, OHP (Over Head Projector) is used for presentations in business sites. That is, for example, a projection image for presentation created by PowerPoint (registered trademark) or the like is stored in advance in a personal computer. At the time of presentation, the projected image is projected on a screen by a projector to give presentations and explanations.

  In order to give a more effective presentation, the presenter sometimes makes a supplementary explanation by writing a line or a character on a screen on which a projected image is projected or pasting an image such as a photograph while giving a presentation.

  There is also a demand for adding an additional material added for supplementary explanation during the presentation in this way as a presentation image and storing it for later use. There is also a desire to store such an auxiliary image in association with the document image. In this regard, there have been several proposals in the past.

  For example, by capturing an image on the screen and performing image processing such as binarization and pattern extraction on the captured image, a human finger, a pointing stick, or a laser is applied to the projected image projected on the screen from the projector. It has been proposed to specify a location pointed by a pointer or the like (Patent Document 1).

  Further, an image of the annotation data including the image of the identification information is taken in a state where the image of the identification information for identifying the original document data is projected onto the projection target, and an image of the annotation data with the identification information is acquired. Then, based on the identification information image included in the acquired annotation data image with identification information, it has been proposed to synthesize the image of the corresponding original document and the annotation data image (Patent Document 2).

  Further, it has been proposed that handwritten writing information written on a screen is scanned by a scanner unit to digitize a written image and synthesized with a projection image projected by a projector unit (Patent Document 3).

JP2000-200139A JP 2006-108813 A JP 2001-16384 A

As described above, if the adjunct is paper such as a photograph that is directly attached to the surface of the screen, the image of the adjunct is captured as an auxiliary image by capturing it with a camera, and this is the original image. Can be used to create a presentation image in which an auxiliary image is added to a document image.

  However, if the original image and the auxiliary image are simply synthesized as they are, the amount of data becomes enormous, which is inconvenient for storing and transferring the original image and the auxiliary image.

  In addition, it is conceivable to reduce the amount of data by applying compression processing to the presentation image obtained by combining. In this case, the compression processing is performed as one image in which the original image and the auxiliary image are combined. As a result, the image quality may deteriorate compared to the original data of the original image.

  No solution for solving such a problem is disclosed in any of Patent Documents 1 to 3 described above.

  The present invention has been made in view of the above-described problem, and an object of the present invention is to reduce the data amount of a presentation image obtained by combining a document image and an auxiliary image while maintaining the image quality of the document image.

A method according to an embodiment of the present invention is a method of generating a presentation image to be projected on a screen by a projection device, the step of obtaining a document image to be projected on the screen, and an auxiliary to the document image Obtaining an auxiliary image taken by the photographing apparatus with the screen as a background and not projecting the original image, and performing region discrimination on the original image to convert the original image into character data A step of separating the auxiliary image into character data and photo data, a step of separating the auxiliary image into character data and photo data, a step of separating the auxiliary image into character data and photo data, and the auxiliary image. character data and photographic data, respectively is compressed separately, four obtained by compression And a step of generating a PDF file that contains the layer.

  Region discrimination is performed on the document image and the auxiliary image, and the character data and the photo data are individually separated. A composite image is generated using each separated character data and photograph data.

  According to the present invention, it is possible to reduce the data amount of a presentation image obtained by combining a document image and an auxiliary image while maintaining the image quality of the document image.

1 is a diagram illustrating an overall schematic configuration of a projector cooperation system to which an image forming apparatus according to an embodiment of the present invention is applied. 2 is a block diagram illustrating a functional configuration of the image forming apparatus. FIG. It is a block diagram which shows the example of a structure of a presentation image generation apparatus. It is a figure which shows the example of the data structure of a PDF file. It is a figure explaining the outline flow of the production | generation method of a presentation image. It is a flowchart which shows the flow of the production | generation process of a presentation image. It is a flowchart which shows the flow of the production | generation process of a presentation image. It is a flowchart which shows the flow of the process in a camera.

  Hereinafter, an example in which the projector cooperation system 1 is configured with the projector 12 and the camera 13 controlled by the image forming apparatus 11 using the image forming apparatus 11 according to an embodiment of the present invention will be described.

  In FIG. 1, a projector cooperation system 1 according to the present embodiment includes an image forming apparatus 11, a projector 12, a camera 13, a screen 14, a personal computer (PC) 15, and the like.

  Referring also to FIG. 2, the image forming apparatus 11 is a multifunction device called a so-called MFP (Muliti Function Peripheral) in the present embodiment. The image forming apparatus 11 has a copy function, a network printing function, a FAX function, a scanner function, a document server function, and the like. The image forming apparatus 11 controls the projector (projection apparatus) 12 and the camera (imaging apparatus) 13, projects the projection image GT by the projector 12, and photographs the surface of the screen 14 by the camera 13, and generates the auxiliary image GH. . Details will be described later.

  The projector 12 projects the projection image GT on the screen 14 based on the projection data (projection image data) DT sent from the image forming apparatus 11. The projector 12 is connected to the image forming apparatus 11 via a video cable 31 and receives the above-described projection data DT from the image forming apparatus 11. In addition, the image forming apparatus 11 turns on and off the projection of the projection image GT, light Projection on / off, power on / off, and the like are controlled.

  Note that the projection image GT includes a document image GK, a composite image GP, an auxiliary image GH, and the like. By projecting the projection data DT input to the projector 12, a projection image GT is obtained. The projection data DT is RGB data for a color image, for example. In the present specification, the “image” that can be visually recognized and the “image data” that is the state of the data are the same in terms of content, and may be described without distinction.

  Note that “projection image” or “projection data” may be described as “presentation image” or “presentation document”. In the present embodiment, there is one feature in a method for generating a composite image GP which is a kind of presentation image.

  The camera 13 captures (captures) an image of the surface of the screen 11. In the present embodiment, the camera 13 captures a still image and outputs a captured image (image data) G. The first image G1 and the second image G2 are obtained according to the timing of capturing the image G, that is, according to the state of the screen 11 when the image G is captured.

  For example, a digital camera is used as the camera 13, but it may be an imaging device that can capture a moving image. The camera 13 is connected to the image forming apparatus 11 via a control cable 32, and shooting timing (shutter), flash on / off, and the like are controlled by the image forming apparatus 11, and the captured image G is sent to the image forming apparatus 11. The camera 13 is installed and fixed at a position where the entire screen 14 can be appropriately photographed from the front.

  A projection image GT from the projector 12 is projected on the screen 14. As the screen 14, various types and sizes of screens such as a reflective screen, a transmissive screen, a presentation screen, and a projection screen can be used. Further, a white board for writing characters or the like, or a white wall surface can be used as the screen.

  As will be described later, an additional FB may be added to the screen 14 by writing a line or a character or pasting an image such as a photograph or a document. It should be as easy as possible. In this regard, if it has a function like a whiteboard, it is possible to directly write handwritten characters using a sign pen or the like, and writing can be easily erased. However, a sheet may be pasted on the screen and characters may be indirectly written on the sheet. In order to attach a photograph or a document, for example, it may be stopped with a push pin, attached with an adhesive tape, or fixed with a magnet. Further, when a whiteboard or a wall surface is used as the screen, it is preferable to have a surface state in which halation does not occur as much as possible when shooting with the camera 13. In order to suppress halation, the indoor lighting and the light emission amount of the projector 12 may be adjusted.

  The personal computer 15 is a so-called personal computer, and includes a CPU (Central Processing Unit), a memory, a magnetic disk, an input / output interface, and the like. The personal computer 15 stores various projection data DT for use in presentation. Such projection data DT is created inside the personal computer 15 using appropriate software such as PowerPoint (registered trademark), or inputted from the outside.

  The personal computer 15 is connected to the image forming apparatus 11 by a video cable 33 and transmits, for example, projection data DT including RGB data to the image forming apparatus 11. The personal computer 15 can also be connected to the image forming apparatus 11 via the LAN 17.

  As the video cables 31 and 33 or the control cable 32, a USB cable or a network cable may be used.

  In the projector cooperation system 1 according to the present embodiment, the personal computer 15 is not necessarily required as long as the projection data DT can be taken into the image forming apparatus 11. For example, the projection data DT may be captured by connecting a USB memory storing the projection data DT to the image forming apparatus 11. Further, the projection data DT may be taken into the image forming apparatus 11 by using various functions of the image forming apparatus 11 such as a box function (Box function) and a scan function of the image forming apparatus 11. Further, the projection data DT may be generated inside the image forming apparatus 11.

  The projection data DT stored in the storage unit of the personal computer 15 is once taken into the image forming apparatus 11 under the control of the image forming apparatus 11 and accumulated as presentation image data. The projection data DT accumulated in the image forming apparatus 11 is transmitted to the projector 12 in response to a user command, and is projected on the screen 14 as a projection image GT. Under the control of the image forming apparatus 11, an image G on the surface of the screen 14 is taken by the camera 13. The image G photographed by the camera 13 is sent to the image forming apparatus 11, subjected to image processing inside the image forming apparatus 11, stored in a memory, and output to the outside as necessary.

  2, the image forming apparatus 11 includes an operation control unit 21, a memory 22, an HDD 23, a projection data creation unit 24, an image calculation unit 25, a user IF 26, a projection data output unit 27, a camera control unit 28, and a projection data input unit 29. The network IF 30, the document reading unit 34, the printing unit 35, and the like.

  The operation control unit 21 controls the projection data creation unit 24, the image calculation unit 25, and the like to perform necessary processing, and also controls the document reading unit 34, the printing unit 35, and the like to perform the entire operation of the image forming apparatus 11. To control. The operation control unit 21 also controls the projector 12 and the camera 13 as described above in the projector mode.

  The memory 22 temporarily stores generated or input projection data DT, an image (image data) G taken by the camera 13, other images or data, and the like.

  The HDD (hard disk device) 23 stores projection data DT, image G, other images, data, programs, and the like.

  The projection data creation unit 24 creates projection data DT. In particular, in the projector mode, the projection data DT, that is, the auxiliary image GH and the composite image GP, which are a kind of presentation image, are created. Also, area determination, color / monochrome determination (ACS (Auto Color Select) determination), and the like are performed. That is, the auxiliary image GH is created based on the first image G1 and the second image G2 captured by the camera 13, and the composite image GP is created by synthesizing the auxiliary image GH and the document image GK.

  The image calculation unit 25 calculates the difference between the first image G1 and the second image G2 captured by the camera 13, and emphasizes the density of the additional image included in the second image G2 or the auxiliary image GH. For example, processing necessary for creating the projection data DT is performed. Further, various image processing is performed on the image read by the document reading unit 34 and the input image.

  A user IF (user interface) 26 is a part that performs an interface with a user. The user IF 26 is, for example, a touch panel on which various operation buttons are displayed. The user inputs various commands and data to the image forming apparatus 11 via the user IF 26 and receives messages from the image forming apparatus 11.

  For example, the user sets the projector mode via the user IF 26, and instructs the camera 13 to shoot the first image G1 and the second image G2 in the projector mode. Further, in the projector mode, the projection of the projection image GT by the projector 12 is prohibited in order to prevent the projection image GT from appearing when the camera 13 is instructed to shoot. In addition, for illumination at the time of shooting by the camera 13, light projection with adjusted light amount is performed from the projector 12 or flash is emitted as necessary.

  Note that the user can remotely operate the image forming apparatus 11 using a browser of a personal computer via the LAN 17 or another network instead of using the user IF 26. For example, using the personal computers 15 and 16 or another external personal computer, a command is given to the image forming apparatus 11 using a browser, and the camera 13 is controlled to capture the first image G1, the second image G2, and the like. Is also possible.

  The projection data output unit 27 performs control for outputting the projection data DT input from the personal computer 15 and the projection data DT created in the image forming apparatus 11 to the projector 12.

  The camera control unit 28 controls the camera 13 in the projector mode.

  The projection data input unit 29 performs control for inputting projection data DT from the personal computer 15.

  The network IF 30 receives and transmits various data via the LAN 17 or the like. When the personal computer 15 is connected to the LAN 17, the projection data DT can be input via the network IF 30 without using the projection data input unit 29.

  The document reading unit 34 scans and reads images of documents of various sizes. The printing unit 35 prints an image read by the document reading unit 34 or an image sent from the personal computer 15 or 16 on a sheet by an electrophotographic process.

  Next, a process in the projector mode, particularly a process for generating the composite image GP will be described.

  As described above, the image forming apparatus 11 can perform processing for creating the auxiliary image GH and the composite image GP when the projector mode is set.

  That is, when the user is performing a presentation by projecting the projection image GT onto the screen 14 using the projector 12, the user writes a line or character on the screen on which the projection image GT is projected, or photographs or materials. A supplementary explanation may be given by pasting. As described above, the addition FB added to the projection image GT is digitized (image data) using the screen 14 as a background, and an auxiliary image GH is generated based on the digitized image FB. Are combined to generate a composite image GP.

  The auxiliary image GH can be saved as an independent image, or can be synthesized so as to be added to the original projection image GT (original image GK) and saved as a synthesized image. It is. The auxiliary image GH can be used as an auxiliary to the original document image GK by projecting onto the screen 14 by the projector 12. Therefore, once the auxiliary image GH is created, the auxiliary image GH can be projected by the projector 12 in the next presentation. Therefore, the auxiliary image GH can be added even if the actual addition FB is not prepared. A presentation can be performed using the image GF.

  FIG. 3 shows a functional configuration of the presentation image generation apparatus PS realized in the image forming apparatus 11.

  In FIG. 3, the generation device PS includes a first image acquisition unit 41, a second image acquisition unit 42, an auxiliary image generation unit 43, an auxiliary image region determination unit 44, a document image region determination unit 45, a color / monochrome determination unit 46, a color A monochrome determination unit 47, a synthesis unit 48, and a projection data storage unit 49;

  The first image acquisition unit 41 acquires the first image G1 captured by the camera 13. The first image G1 is an image of the surface of the screen 14 taken by the camera 13 in a state where the projection image GT is not projected. That is, it is an image obtained by photographing only the screen 14, and the surface state of the screen 14 is an image as it is. If there is a stain on the surface of the screen 14, the stain appears as an image.

  The first image G1 is taken by the user giving a command to the image forming apparatus 11. The user gives an instruction to shoot the first image G1 after setting the operation mode of the image forming apparatus 11 to the projector mode. At the time of shooting, projection of the projection image GT of the projector 12 is prohibited. In order to illuminate the screen 14, light projection is performed by the projector 12 or the flash of the camera 13 is emitted as necessary.

  The second image acquisition unit 42 acquires the second image G2 captured by the camera 13. The second image G2 is an image obtained by capturing the addition FB supplementarily added to the projection image GT for supplementary explanation with the screen 14 as a background and without projecting the projection image GT. . That is, the second image G2 is an image obtained by photographing only the addition FB with the screen 14 as a background.

  The “addition” is information or information added to the projection image GT for supplementary explanation, such as lines and characters written on the screen 14, photographs or materials pasted on the screen 14. is there. An image obtained by photographing the “addition” with the camera 13 with the screen 14 as a background is the second image G2. Therefore, the second image G2 includes an “addition image” that is an image of the “addition”.

  The shooting of the second image G2 is performed by the user giving a command to the image forming apparatus 11. In the middle of the presentation, the user gives an instruction to shoot the second image G2 after adding the appendage FB to the projection image GT to the screen 14. Then, the image forming apparatus 11 prohibits the projection of the projection image GT by the projector 12, performs the same control for illumination as that of the first image G <b> 1, and performs imaging by the camera 13.

  The auxiliary image generation unit 43 generates an auxiliary image GH based on the first image G1 and the second image G2. The auxiliary image GH includes the additional image GF as described above.

  In order to generate the composite image GP, the auxiliary image generation unit 43 acquires, for example, an image (difference image) GS that is a difference between the first image G1 and the second image G2. The difference image GS is obtained, for example, by subtracting the first image G1 from the second image G2. Therefore, when the surface of the screen 14 is dirty, an image due to the stain appears in both the first image G1 and the second image G2, and therefore the image due to the stain is canceled (offset) in the difference image GS. Lost or greatly reduced.

  Further, in the first image G1 and the second image G2, the density of the image on the surface of the screen 14 usually has a significant value instead of 0. That is, a low-density gray image that is not pure white appears as indicating the density of the background image (background density). However, the background density is also canceled in the difference image GS. Accordingly, in the difference image GS, the density value of the portion other than the additional image GF is almost zero. On the other hand, in the difference image GS, the density value of the additional image GF decreases by a density corresponding to the background density.

  In the difference image GS, images other than the additional image GF are background images.

  Further, a process for enhancing the density (density enhancement process) of the additional image GF may be performed. The density enhancement process may be performed on the additional image GF included in the second image G2, or may be performed on the additional image GF included in the auxiliary image GH.

  When density enhancement processing is performed, first, an area (additional image area) where density enhancement is to be performed is detected. The additional image area is an area occupied by the additional image GF. In order to detect the additional image region, the region of the additional image GF and the region of the background image GB are separated and extracted. In order to demarcate the region of the background image GB, for example, the first image G1 and the second image G2 are compared, the region where the density does not change is set as the background region, and the region where the density changes is set as the additional image region. .

  As the density enhancement process, for example, the density of the additional image GF is increased by a predetermined ratio. Alternatively, a predetermined density is added to the density of the additional image GF. At that time, the multiplication rate (multiplication coefficient) or the addition value (addition coefficient) may be adjusted according to the density of the additional image GF before density enhancement processing. By performing the density enhancement process, the additional image GF becomes clearer.

  That is, for example, when the user writes light on the surface of the screen 14 or the line is thin, the additional image GF may become thin and unclear, but the density is increased by performing the density emphasizing process. , The sharpness increases.

  The auxiliary image region determination unit 44 performs region determination on the auxiliary image GH and separates the auxiliary image GH into character data HM and photo data HS. That is, it is determined whether the one-page region of the auxiliary image GH is a character region or a photographic region, data included in the character region is extracted as character data HM, and the data included in the photographic region is extracted as photographic data HS. Extract as

  The document image region determination unit 45 performs region determination on the document image GK and separates the document image GK into character data KM and photo data KS. That is, it is determined whether one page area of the original image GK is a character area or a photographic area, data included in the character area is extracted as character data KM, and data included in the photographic area is extracted as photographic data KS. Extract as

  The color / monochrome determination unit 46 performs color / monochrome determination (ACS determination) on the auxiliary image GH. That is, it is determined whether the auxiliary image GH is a color image or a monochrome image, and determination data HH indicating the result is output.

  The color / monochrome determination unit 47 performs color / monochrome determination (ACS determination) on the document image GK. That is, it is determined whether the document image GK is a color image or a monochrome image, and determination data HK indicating the result is output.

  The synthesizing unit 48 synthesizes the character data KM and the photo data KS for the document image GK, and the character data HM and the photo data HS for the auxiliary image GH to generate one synthesized image GP (synthesized file FG). At that time, suitable compression processing is performed on the character data or the photo data as necessary.

  For example, the synthesizing unit 48 generates a PDF file or a compact PDF (C-PDF) file including four layers including the character data KM, photo data KS, character data HM, and photo data HS. In this case, for example, binarization processing, G4 compression, or the like is performed as compression processing of character data. In addition, the characters of the same color are integrated into the character portion to determine the character color, and reversible compression such as MMR (Modified Modified-Read) is performed. In addition, as photographic data compression processing, irreversible compression such as JPEG (Joint Photographic Experts Group) is performed.

  Note that the compact PDF compression is proposed by the applicant of the present application, and is processed in different resolutions and different compression methods for each region in the image and integrated into one file. Specifically, URL (https://konicaminolta.jp/about/research/core_technology/picture/compact_pdf.html) can be referred to.

  Further, in the case where it is determined that the original image GK is monochrome, the synthesizing unit 48 obtains a gray scale compressed image for the photo data KS, and when it is determined that the original image GK is color, the photo. A color compressed image is obtained for the data KS. When the auxiliary image GH is determined to be monochrome, a gray scale compressed image is obtained for the photo data HS, and when the auxiliary image GH is determined to be color, the photo data HS is determined. A color compressed image is obtained.

  As described above, when combining the original image GK and the auxiliary image GH, the combining unit 48 according to the present embodiment performs area determination for each of the original image GK and separates the character data and the photo data, and is suitable for each data. Therefore, the amount of data can be reduced while maintaining the image quality of each data. For example, since the photographic data KS of the document image GK is also compressed alone, the image quality does not deteriorate compared to the original data of the document image GK.

  In the area determination, for example, area separation is performed by combined determination of characters and photographs. Various publicly known methods can be used as a method for region discrimination. For example, in the case of text, the character area is distinguished by utilizing the property that the density difference between white pixels and black pixels is large. It is possible to use a technique of detecting and discriminating a photograph area.

  FIG. 4 shows an example of the structure of a compact PDF file. For the compact PDF file itself, JP 2007-193750 can be referred to.

  As shown in FIG. 4, the compact PDF file has a hierarchical structure including four layers: a file header part H, a body part B, a cross reference table R, and a trailer T. In the file header portion H, PDF specification version information and the like are recorded. In the body part B, the contents of the document are recorded. In the cross reference table R, the position of the object in the body part B, the page in the file, and the positions of other objects are recorded. In the trailer T, the number of objects of the PDF file and the object number of the catalog dictionary are recorded.

  The body part B includes document information such as date, data blocks of pages (child pages) constituting the document, child page dictionary, parent page dictionary, and catalog page dictionary. The catalog page dictionary records the number of the parent page dictionary, the parent page dictionary records the number of pages and the number of the child page dictionary, and the child page dictionary records the data block format and the like.

  In the data block, the photo data HS of the auxiliary image GH, the character data HM, the photo data KS of the document image GK, the four layers of the character data KM, and layer information are recorded. Information such as the position of each layer and the color of characters is recorded in the layer information.

  The generated composite image GP is stored in the projection data storage unit 49, sent to the projector 12 in accordance with a user operation instruction, and projected onto the screen 14 as a projection image GT.

  The projection data storage unit 49 stores projection data DT that can be sent to the projector 12 for presentation and for creating the composite image GP. As the projection data DT, data such as a document image GK, an auxiliary image GH, and a composite image GP are stored. The document image GK includes an image obtained by reading the document with the document reading unit 34, an image sent from the personal computer 15, an image generated inside the image forming apparatus 11, and the like.

  Next, a process for generating the projection auxiliary image GH will be described with reference to FIG.

  As shown in FIG. 5, in the presentation, with the original image GK (upper left in FIG. 5) projected on the screen 14, the additional material FB is added on the screen 14 (uppermost in FIG. 5). The projection of the document image GK by the projector 12 is interrupted and photographed by the camera 13, and necessary processing is performed to obtain the auxiliary image GH (upper right in FIG. 5). The auxiliary image GH includes an additional image GF.

  Region determination is performed for each of the document image GK and the auxiliary image GH, and character data KM, photo data KS, character data HM, and photo data HS are extracted (upper row in FIG. 5). Necessary processing is performed on each of the four data, and the resultant data is combined into a composite image GP including the four layers LY1 to LY4 (the lowermost stage in FIG. 5). At this time, the compact PDF file is formed so that the four layers LY1 to 4 are in order of the character data KM of the document image GK, the photo data KS, the character data HM of the auxiliary image GH, and the photo data HS, for example, from the back. create.

  When the original image GK or the auxiliary image GH is in color, full color JPEG compression is performed on the photo data, and in the case of monochrome, gray scale JPEG compression is performed on the photo data.

  As described above, in the image forming apparatus 11 according to the present embodiment, the composition unit 48 does not perform region determination for the document image GK and the auxiliary image GH after composition, but separates the document image GK and the auxiliary image GH separately. Since the area determination is performed and appropriate processing is performed on the separated character data and photographic data, a composite image GP with a small data amount can be generated while maintaining the image quality of the original image GK.

  Accordingly, it is possible to easily and rapidly perform the storage or transmission of the generated composite image GP.

  According to the projector linkage system 1 of the present embodiment, the user operates the image forming apparatus 11 to project the document image GK onto the screen 14, generate and store the auxiliary image GH and the composite image GP, distribute data, And a series of operations such as printing can be easily performed. Therefore, it is possible to easily and quickly create a material for presentation.

  Next, an example of the composite image GP generation process in the image forming apparatus 11 will be described with reference to a flowchart.

  6 and 7, in the image forming apparatus 11, when the projector mode is started (Yes in # 11) and a command to create a presentation image is received (Yes in # 12), projection is performed at that time. The projection image GT is stored in the memory as a document image GK (# 13).

  The projection by the projector 12 is turned off (# 14), and a shooting command is sent to the camera 13 (# 15). An image G photographed by the camera 13 is taken in, and an auxiliary image GH is generated based on the image G (# 16). Projection by the projector 12 is resumed (# 17). Thereby, the user resumes the presentation.

  The image forming apparatus 11 performs ACS determination (color determination) for the document image GK and the auxiliary image GH (# 18), and performs region determination and region separation for the document image GK and the auxiliary image GH (# 19).

  Depending on the result of the ACS determination (# 20, 23), the photographic data HS is compressed separately for the document image GK and the auxiliary image GH (# 21, 22, 24, 25). Based on the obtained data, a contract PDF file is generated (# 26).

  In FIG. 7, the camera 13 determines the presence / absence of a shooting command from the image forming apparatus 11 (# 31). When there is a shooting command (Yes in # 32), the shutter is controlled to perform shooting (# 33), and the image G obtained by shooting is transferred to the image forming apparatus 11 (# 34).

  By using the composite image GP created in this way, it is possible to perform a presentation similar to that using the adjunct FB without using the adduct FB as the actual product. Therefore, it becomes easy for the user to prepare for the presentation and to perform the presentation itself.

  In the embodiment described above, the generation device PS can be realized by hardware, software, or a combination thereof in the image forming apparatus 11. Such software, that is, a program (computer program) is recorded in an appropriate recording medium, installed in the memory 22 or the HDD 23 of the image forming apparatus 11, and provided in the operation control unit 21 and the image calculation unit 25. It can be executed by a CPU or the like.

  In addition, the configuration, processing content, operation, and the like of the generation device PS can be various configurations other than those described above. Further, the configuration, structure, circuit, shape, dimensions, number, material, processing content, processing order, etc. of the whole or each part of the image forming apparatus 11 or the projector cooperation system 1 can be appropriately changed in accordance with the spirit of the present invention. it can.

DESCRIPTION OF SYMBOLS 1 Projector cooperation system 11 Image forming apparatus 12 Projector 13 Camera 14 Screen 21 Operation control part 25 Image calculating part 41 First image acquisition part 42 Second image acquisition part 43 Auxiliary image generation part 44 Auxiliary image area discrimination | determination part 45 Original image area discrimination | determination Unit 46 color monochrome determination unit 47 color monochrome determination unit 48 composition unit 49 projection data storage unit PS generation device GT projection image (presentation image)
DT projection data (presentation image)
GH auxiliary image GP Composite image (presentation image)
GK Document image KM Character data KS Photo data HM Character data HS Photo data

Claims (10)

A method of generating a presentation image for projection onto a screen by a projection device,
Obtaining a document image to be projected on the screen;
Obtaining an auxiliary image captured by a photographing apparatus with the screen as a background and without projecting the original image, with an adjunct added to the original image for assisting;
Performing region discrimination on the document image and separating the document image into character data and photo data;
Performing region discrimination on the auxiliary image and separating the auxiliary image into character data and photo data;
Individually compressing character data and photo data for the original image and character data and photo data for the auxiliary image, respectively, and generating a PDF file including four layers obtained by the compression ;
A method for generating a presentation image, comprising: The PDF file is generated so that the four layers are in order of character data of the original image, photo data of the original image, character data of the auxiliary image, and photo data of the auxiliary image from the back.
The method for generating a presentation image according to claim 1. Performing color / monochrome discrimination on the document image;
Performing color / monochrome discrimination on the auxiliary image;
When the original image or the auxiliary image is determined to be monochrome, a grayscale compressed image is obtained for the photographic data, and when it is determined to be color, the photographic data is Obtaining a color compressed image, and
In the combining step, combining using the obtained compressed image,
The method for generating a presentation image according to claim 1. In the step of obtaining the auxiliary image,
Causing the photographing apparatus to photograph the screen in a state in which the document image is not projected to obtain a first image;
A step of causing the photographing device to photograph a supplementary image added to the document image for assistance with the screen as a background and not projecting the document image to obtain a second image;
Generating the auxiliary image based on the first image and the second image,
The method for generating a presentation image according to claim 1. Each of the steps is executed by an image forming apparatus that controls the projection apparatus and the imaging apparatus.
The method for generating a presentation image according to claim 1. An apparatus for generating a presentation image for projection onto a screen by a projection apparatus,
Means for obtaining a document image to be projected on the screen;
Means for obtaining an auxiliary image captured by a photographing apparatus in a state in which the additional image added to the original image for assistance is used with the screen as a background and the original image is not projected;
Means for performing region discrimination on the document image and separating the document image into character data and photo data;
Means for performing region discrimination on the auxiliary image and separating the auxiliary image into character data and photo data;
Means for individually compressing character data and photo data for the original image and character data and photo data for the auxiliary image, respectively, and generating a PDF file including four layers obtained by the compression ;
An apparatus for generating a presentation image, comprising: The generating means is arranged so that the four layers are in order of character data of the original image, photo data of the original image, character data of the auxiliary image, and photo data of the auxiliary image from the back. Create a PDF file,
The presentation image generation apparatus according to claim 6. Means for performing color / monochrome discrimination on the document image;
Means for performing color / monochrome discrimination on the auxiliary image;
When the original image or the auxiliary image is determined to be monochrome, a grayscale compressed image is obtained for the photographic data, and when it is determined to be color, the photographic data is Means for obtaining a color compressed image,
The synthesizing means synthesizes using the obtained compressed image.
The presentation image generation apparatus according to claim 6 or 7. The means for obtaining the auxiliary image includes
Means for obtaining a first image by causing the photographing device to photograph the screen in a state in which no document image is projected;
Means for obtaining a second image by causing the photographing apparatus to photograph an additional material added to the document image for assistance with the screen as a background and without projecting the document image;
Means for generating the auxiliary image based on the first image and the second image;
The presentation image generation apparatus according to claim 6 . An image forming apparatus comprising the presentation image generating apparatus according to claim 6 .

Images