CN117354438A - Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium - Google Patents

Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium Download PDF

Info

Publication number
CN117354438A
CN117354438A CN202311432750.1A CN202311432750A CN117354438A CN 117354438 A CN117354438 A CN 117354438A CN 202311432750 A CN202311432750 A CN 202311432750A CN 117354438 A CN117354438 A CN 117354438A
Authority
CN
China
Prior art keywords
shooting
virtual
illumination sampling
light source
light intensity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311432750.1A
Other languages
Chinese (zh)
Inventor
卞梓霖
张家斌
李静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenli Vision Shenzhen Cultural Technology Co ltd
Original Assignee
Shenli Vision Shenzhen Cultural Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenli Vision Shenzhen Cultural Technology Co ltd filed Critical Shenli Vision Shenzhen Cultural Technology Co ltd
Priority to CN202311432750.1A priority Critical patent/CN117354438A/en
Publication of CN117354438A publication Critical patent/CN117354438A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the invention provides a light intensity processing method, a light intensity processing device, electronic equipment and a computer storage medium. The light intensity processing method comprises the following steps: acquiring actual illuminance distribution of a plurality of illumination sampling positions in a real shooting prospect; in the virtual shooting background of the real shooting foreground, determining the brightness of the plurality of illumination sampling positions under a preset virtual light source; respectively adjusting the light intensity of the preset virtual light source for the plurality of illumination sampling positions, so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions is consistent with the actual illuminance distribution of the plurality of illumination sampling positions; and determining fitting results of the adjusted light intensities of the preset virtual light sources as light intensities of the virtual shooting background aligned with the real shooting foreground. The embodiment of the invention improves the accuracy of light intensity alignment and the authenticity of shooting.

Description

Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a light intensity processing method, a light intensity processing device, electronic equipment and a computer storage medium.
Background
The virtual shooting technology is a fusion of traditional movie making skills and modern technologies, and is beneficial to an creator to realize the real-time combination of the digital world and the physical world, and the shooting effect is improved. In an LED-based virtual photography process, a real world scene is replaced by first creating an exquisite scene that closely resembles reality in an application such as a virtual engine, and then the technician plays it back onto the LED screen. In this technique, a photographer such as a photographing team does not need to go to a viewfinder, but may complete photographing demands for different photographing prospects by switching virtual photographing backgrounds at any time. In order to ensure that the virtual shooting background and the real shooting foreground in the final shooting picture can be well fused together and the authenticity of the shooting picture is improved, the visual effect presented by the virtual shooting background and the real shooting foreground in the virtual engine needs to be ensured to be kept highly consistent.
In the scheme of the alignment of the traditional virtual-real light intensity effect, the virtual shooting background and the real shooting foreground are limited by different display mechanisms, and when shooting is performed, the light intensity alignment effect between the virtual shooting background and the real shooting foreground is poor, so that the shooting authenticity is poor.
Disclosure of Invention
In view of the above, embodiments of the present invention provide a light intensity processing method, apparatus, electronic device and computer storage medium, so as to at least partially solve the above problems.
According to a first aspect of an embodiment of the present invention, there is provided a light intensity processing method. The light intensity processing method comprises the following steps: acquiring actual illuminance distribution of a plurality of illumination sampling positions in a real shooting prospect; in the virtual shooting background of the real shooting foreground, determining the brightness of the plurality of illumination sampling positions under a preset virtual light source; respectively adjusting the light intensity of the preset virtual light source for the plurality of illumination sampling positions, so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions under the preset virtual light source is consistent with the actual illuminance distribution of the plurality of illumination sampling positions; and determining fitting results of the adjusted light intensities of the preset virtual light sources as light intensities of the virtual shooting background aligned with the real shooting foreground.
In another implementation manner of the present invention, the determining, in the virtual shooting background of the real shooting foreground, the brightness of the plurality of illumination sampling positions under a preset virtual light source includes: determining the positions of the plurality of illumination sampling positions in the virtual shooting background according to the spatial correspondence between the real shooting foreground and the virtual shooting background; and reading the brightness of the plurality of positions under the preset virtual light source in the virtual shooting background.
In another implementation manner of the present invention, the adjusting the light intensity of the preset virtual light source for the plurality of illumination sampling positions respectively, so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions respectively is consistent with the actual illuminance distribution of the plurality of illumination sampling positions includes: determining equivalent illuminance with a preset mapping relation with the brightness of each illumination sampling position, wherein the preset mapping relation indicates the corresponding relation between the equivalent illuminance of the object and the brightness; and when the equivalent illuminance of each illumination sampling position is consistent with the actual illuminance, recording the adjusted light intensity of the preset virtual light source.
In another implementation of the present invention, the method further includes: when the equivalent illuminance of each illumination sampling position is inconsistent with the actual illuminance, the light intensity of the preset virtual light source is adjusted until the equivalent illuminance of the illumination sampling position is consistent with the actual illuminance.
In another implementation of the present invention, the method further includes: and setting the plurality of illumination sampling positions so that the plurality of illumination sampling positions are positioned around the photographed object of the real photographing prospect.
In another implementation of the present invention, the method further includes: determining an illumination plane in which the plurality of illumination sampling positions are located in the virtual shooting background; setting the position of the preset virtual light source in the virtual shooting background, so that the projection position of the preset virtual light source in the irradiation plane is between the plurality of illumination sampling positions.
In another implementation of the present invention, the method further includes: and adjusting the position of the preset virtual light source in the virtual shooting background so that the difference between the light intensity of each preset virtual light source after adjustment and the fitting result is smaller than a preset value.
In another implementation of the present invention, the method further includes: shooting a gray scale sample in the real shooting prospect based on shooting parameters to obtain a front Jing Huidu of the gray scale sample after shooting; shooting a virtual gray scale sample based on the shooting parameters to obtain the background gray scale of the virtual gray scale sample after shooting, wherein the gray scale of the virtual gray scale sample is consistent with the gray scale of the gray scale sample; and verifying the light intensity alignment result between the real shooting foreground and the virtual shooting background by comparing the gray scale of the front Jing Huidu and the background.
In another implementation of the present invention, the method further includes: shooting the gray sample in the real shooting prospect by adjusting initial shooting parameters; and when the foreground gray level of the gray level sample after shooting is neutral gray level, determining the initial shooting parameter as the shooting parameter.
In another implementation of the present invention, the method further includes: and under the condition that the preset virtual light source is ensured to have aligned light intensity, adjusting the light source cone angle of the preset virtual light source so that the equivalent illuminance of the plurality of illumination sampling positions is consistent with the actual illuminance distribution.
According to a second aspect of an embodiment of the present invention, there is provided a light intensity processing apparatus. The light intensity processing device includes: the acquisition module acquires actual illuminance distribution of a plurality of illumination sampling positions in a real shooting prospect; the determining module is used for determining the brightness of the plurality of illumination sampling positions under a preset virtual light source in the virtual shooting background of the real shooting foreground; the adjusting module is used for respectively adjusting the light intensity of the preset virtual light source for the plurality of illumination sampling positions so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions under the preset virtual light source is consistent with the actual illuminance distribution of the plurality of illumination sampling positions; and the fitting module is used for determining the fitting result of the light intensity after each adjustment of the preset virtual light source as the light intensity of the virtual shooting background aligned with the real shooting foreground.
According to a third aspect of an embodiment of the present invention, there is provided an electronic apparatus including: the device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus; the memory is configured to store at least one executable instruction, where the executable instruction causes the processor to perform operations corresponding to the method according to the first aspect.
According to a fourth aspect of embodiments of the present invention, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to the first aspect.
According to the embodiment of the invention, by means of the brightness of the plurality of illumination sampling positions under the preset virtual light source, the equivalent illuminance distribution of the plurality of illumination sampling positions is obtained, and the light intensity of the preset virtual light source can be adjusted by comparing the equivalent illuminance distribution of the plurality of illumination sampling positions with the actual illuminance distribution, so that the light intensity of the preset virtual light source is aligned with the light intensity of the actual shooting prospect. In addition, the fitting result of the light intensity after each adjustment of the preset virtual light source is determined to be the light intensity aligned with the virtual shooting background and the real shooting background, so that the error caused by the single illumination sampling position is avoided, the accuracy of light intensity alignment is improved, and the shooting authenticity is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present invention, and other drawings may be obtained according to these drawings for a person having ordinary skill in the art.
Fig. 1 is a schematic diagram of a photographing system according to one example.
Fig. 2 is a flow chart of steps of a light intensity processing method according to some embodiments of the invention.
Fig. 3A is a flowchart of steps of a further example of a light intensity processing method according to the embodiment of fig. 2.
Fig. 3B and 3C are schematic diagrams of a light intensity alignment process of a real photographing foreground and a virtual photographing background according to the embodiment of fig. 2.
Fig. 4 is a block diagram showing a structure of a light intensity processing apparatus according to other embodiments of the present invention.
Fig. 5 is a schematic structural view of an electronic device according to other embodiments of the present invention.
Detailed Description
In order to better understand the technical solutions in the embodiments of the present invention, the following description will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which are derived by a person skilled in the art based on the embodiments of the present invention, shall fall within the scope of protection of the embodiments of the present invention.
The implementation of the embodiments of the present invention will be further described below with reference to the accompanying drawings.
Fig. 1 shows an example photographing system. Illustratively, the photographing system may include a display device 101, a server 102, a terminal device 103, and a photographing device 104.
The server 102 may be communicatively connected to the terminal device 103, where the server 102 stores background resources, such as image resources and/or video resources, of a virtual shooting background.
Thus, the terminal device 103 may send a download request to the server 102, where the download request is for requesting to download the background resource.
The terminal device 103 may perform a virtual photographing background image quality optimization process in the background resource, for example, adjust a display effect of the virtual photographing background, for example, color display, illuminance display, or the like.
The display device 101 may be a display screen or a projection device, where the display device 101 is communicatively connected to the terminal device 103, and receives the virtual shooting background transmitted by the terminal device 103. In the case where the display device 101 is a display screen, the display screen may be disposed behind the realistic shooting prospect; in the case where the display device 101 is a projector, the projector projects a virtual shooting background onto a projection screen, which may be disposed behind a real shooting foreground.
The photographing device 104 is configured to photograph a virtual photographing background and a real photographing foreground when the display device 101 displays the virtual photographing background.
Further, an application program such as a virtual engine may be installed in the terminal device 103. And processing the virtual shooting background. A virtual engine is an image processing application that is capable of two-dimensional or three-dimensional rendering of an image. For example, the terminal device 103 may acquire (e.g., from the photographing device 104) relevant information of the real photographing foreground (e.g., position information of the real photographing foreground, an illumination sampling position, and an actual illuminance). The terminal device 103 may also acquire position information of the display device. The terminal device 103 may spatially align the virtual shooting background with the real shooting foreground by adjusting the relative position between the virtual shooting background and the display device.
It should be understood that the terminal device 103 may be a smart phone, tablet, notebook, or the like electronic device. The terminal device 103 can access to a network, and is in communication connection and data interaction with the server 102 and/or the display device 101 and the photographing device 104 through the network, wherein the network comprises a local area network (Local Area Network, LAN), a wide area network (Wide Area Network, WAN) and a mobile communication network; such as the World Wide Web (WWW), long term evolution (english: long Term Evolution, LTE) networks, 2G networks (english: 2th Generation Mobile Network), 3G networks (english: 3th Generation Mobile Network), 5G networks (english: 5th Generation Mobile Network), and the like. Of course, the description is intended to be illustrative only and is not to be taken in a limiting sense.
Fig. 2 illustrates a light intensity processing method according to some embodiments of the invention. The light intensity processing method of fig. 2 includes:
s210: the method comprises the steps of obtaining actual illuminance distribution of a plurality of illumination sampling positions in a real shooting prospect.
It should be understood that the actual illuminance of each illumination sampling position may be detected by the illuminance detection device, or the actual shooting foreground may be pre-shot, and the illuminance represented by the brightness of the illumination sampling position in the shot image is taken as the actual illuminance. The actual illuminance distribution may be represented by the actual illuminance of each of the plurality of illumination sampling positions, or may be represented by the trend of illuminance of the plurality of illumination sampling positions with position.
S220: and determining the brightness of a plurality of illumination sampling positions under a preset virtual light source in the virtual shooting background of the real shooting foreground.
It will be appreciated that a preset virtual light source may be added directly in the image processing application (e.g., virtual engine) of the virtual photographic background and the brightness of the multiple illumination sampling locations read or measured. It is also possible to determine the illumination sampling position aligned with the real shooting foreground in the image processing application, add a virtual object with a certain material parameter at the illumination sampling position (for better measurement effect, the virtual object may be a planar virtual object), and then read or measure the brightness on the virtual object.
S230: and respectively adjusting the light intensity of the preset virtual light source for the plurality of illumination sampling positions, so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions under the preset virtual light source is consistent with the actual illuminance distribution of the plurality of illumination sampling positions.
It should be appreciated that the equivalent illuminance distribution of the plurality of illumination sampling positions in the virtual photographic background may be determined according to the brightness of the plurality of illumination sampling positions in the virtual photographic background, and the equivalent illuminance distribution of the plurality of illumination sampling positions in the virtual photographic background may be made to coincide with the actual illuminance distribution of the plurality of illumination sampling positions of the real photographic foreground. More specifically, the equivalent illuminance corresponding to the luminance of the plurality of illumination sampling positions may be determined so that the value of the equivalent illuminance of the plurality of illumination sampling positions coincides with the value of the actual illuminance.
S240: and determining fitting results of the adjusted light intensities of the preset virtual light sources as light intensities of the virtual shooting background aligned with the real shooting foreground.
It should be understood that the fitting of the adjusted light intensities may be performed based on a fitting algorithm, so as to obtain the fitting light intensity of the preset virtual light source as a fitting result, where the fitting algorithm may be a linear regression, a difference algorithm, a mean fitting, and the like.
In the scheme of the embodiment of the invention, the equivalent illuminance distribution of the plurality of illumination sampling positions is obtained by means of the brightness of the plurality of illumination sampling positions under the preset virtual light source, so that the light intensity of the preset virtual light source can be adjusted by comparing the equivalent illuminance distribution of the plurality of illumination sampling positions with the actual illuminance distribution, and the light intensity of the preset virtual light source is aligned with the light intensity of the actual shooting prospect. In addition, the fitting result of the light intensity after each adjustment of the preset virtual light source is determined to be the light intensity aligned with the virtual shooting background and the real shooting background, so that the error caused by the single illumination sampling position is avoided, the accuracy of light intensity alignment is improved, and the shooting authenticity is improved.
In some examples, fig. 3A illustrates some example light intensity processing methods of the embodiment of fig. 2, including the steps of:
s310: and determining a plurality of illumination sampling positions according to the position of the shot object in the real shooting prospect. For example, the plurality of light sampling locations may be a plurality of light sampling points or a plurality of light sampling areas. In a specific example, the plurality of illumination sampling positions may be disposed within or near an illumination plane of the target light source in the real shooting foreground. The projection positions of at least a part of the shot object in the irradiation plane are positioned in a fitting range of the projection positions of the plurality of illumination sampling positions in the irradiation plane, wherein the fitting range can be a circumcircle or a circumpolygon of the projection positions of the plurality of illumination sampling positions in the irradiation plane. As shown in fig. 3B, in the real photographing foreground 10 (for example, it may be displayed in the display device 101 in fig. 1), the plurality of illumination sampling positions A, B, C, D, E are (0, 0), (0,0.5,0), (0, 1, 0), (0, -0.5, 0), (0, -1, 0) based on the coordinates of the XYZ coordinate system, respectively.
S320: and sequentially measuring the actual illuminance of each of the plurality of illumination sampling positions by using an illuminance measuring device. For example, the illuminance at the illumination sampling position (0, 0) is 100lux, the illuminance at the illumination sampling position (0, -0.5, 0) is 80lux, the illuminance at the illumination sampling position (0, -1, 0) is 50lux, the illuminance at the illumination sampling position (0,0.5,0) is 80lux, and the illuminance at the illumination sampling position (0, -1, 0) is 50lux.
S330: in a virtual engine that virtually captures a background, a virtual object is added to correspond to an illumination sampling position. For example, for the virtual photographing background 30 as shown in fig. 3B, in the virtual engine, the virtual object may be set to have a standard gray-scale material, for example, the basic color value is set to 0.18, and the roughness is set to 1. It should be appreciated that the base color may be varied by adjusting hue, saturation, and brightness. The base color value generally refers to a numerical value that numerically represents a color in a digital color space, where the digital color space may be an RGB color space or a CMYK color space. Roughness refers to the degree of smoothness of an object surface and can also be used to describe the thickness and fineness of an object surface, and in computer graphics, roughness values generally refer to a parameter used to describe the smoothness of an object surface, typically ranging from 0 to 1, where 0 represents a very smooth surface and 1 represents a very rough surface. As another example, as shown in fig. 3C, the virtual object may be placed at an illumination sampling location (0, -0.5, 0) (illumination sampling location D), and without loss of generality, the virtual object may be placed at any illumination sampling location (e.g., illumination sampling location A, B, C, D, or E). Without loss of generality, when the virtual shooting background and the real shooting foreground are spatially aligned, as an example of determining the brightness of the plurality of illumination sampling positions under the preset virtual light source, a plurality of coordinate values of the plurality of illumination sampling positions in the virtual shooting background may be determined according to a spatial correspondence between the real shooting foreground and the virtual shooting background, and then the brightness of the plurality of positions respectively indicated by the plurality of coordinate values under the preset virtual light source may be read in the virtual shooting background.
S340: in the virtual engine, a preset virtual light source is added to vertically irradiate on a virtual object. For example, a position where the preset virtual light source irradiates the irradiation plane is located at the virtual object.
S350: in the virtual engine, according to a preset mapping relation, the brightness corresponding to the equivalent illuminance of the shot object is calculated. The preset mapping relationship may indicate a correspondence relationship between the equivalent illuminance and the brightness of the object, for example, the following formula is an example of the preset mapping relationship:
pi l=r E, where R is the surface reflectance of the object; pi is the circumference ratio; e is the surface illuminance of the object; l is the luminance value of the object surface. For example, when the illuminance at the illumination sampling position (0, 0) is 100lux, the reflectance r=0.19 of the surface of the virtual object (for example, having a standard gray-scale material) is calculated to obtain the luminance value l=6.05 of the surface of the virtual object.
S360: the brightness detection tool in the virtual engine is adopted to measure the surface brightness value of the virtual object, and the intensity of the preset virtual light source is adjusted, so that the equivalent illuminance of the illumination sampling position is consistent with the actual illuminance. For example, the brightness value of the virtual object at the illumination sampling position (0, 0) is set to be 6.05, and the adjusted light intensity I0 of the preset virtual light source is recorded. It should be appreciated that the intensity detection tool is capable of calculating an intensity value of the surface of the virtual object based on pixel parameters of the virtual object. The surface brightness values of the other illumination sampling positions B, C, D and E are measured in this way, and the adjusted light intensities I1, I2, I3 and I4 of the preset virtual light sources are recorded accordingly.
S370: fitting the adjusted light intensities of the preset virtual light sources, and determining the fitting result as the light intensity of the virtual shooting background aligned with the real shooting foreground. For example, the adjusted light intensities I0, I1, I2, I3, and I4 are subjected to average processing, resulting in fitting result= (i0+i1+i2+i3+i4)/5.
S380: under the condition that the preset virtual light source is ensured to have aligned light intensity, the light source cone angle of the preset virtual light source is adjusted, so that the equivalent illuminance of a plurality of illumination sampling positions is consistent with the actual illuminance distribution. It should be appreciated that the illuminance of the virtual object at least part of the illumination sampling locations may be measured in the virtual engine, e.g., the illuminance at the illumination sampling locations (0, -0.5, 0) may be measured, the illuminance at the illumination sampling locations (0, -1, 0) may be measured, and the linear variation curve between its respective illuminance and the illumination sampling locations may be calculated. It should be appreciated that the adjusted light intensity of the preset virtual light source may have a suitable difference from the aligned light intensity, whereby the light source cone angle of the virtual light may be adjusted against the illuminance of the illumination sampling position (0, -0.5, 0) and the linear variation curve of the illuminance of the illumination sampling position (0, -1, 0) in the realistic photographing prospect (an example of the actual illuminance distribution). The light source cone angle of the virtual light source refers to a parameter that controls the projection range and diffusion effect of the light source. In a virtual engine, the light rays are typically propagated into the scene in a conical or conical fashion, and thus the light source cone angle determines the angular size of the light beam emitted by the light source. Smaller angles will produce a more focused beam of light, which will concentrate the area where the light is projected to, producing a stronger illuminance. And a larger angle can generate a scattered light beam, so that the area where the lamplight is projected is wider, and weaker illuminance is generated.
Further, for the embodiment of fig. 3A, as an example of a verification process of the alignment result of the real shooting foreground and the virtual shooting background, the gray-scale samples in the real shooting foreground may be shot based on the shooting parameters to obtain the front Jing Huidu of the gray-scale samples after shooting, then the virtual shooting background is set based on the shooting parameters, the virtual gray-scale samples are shot to obtain the background gray-scale of the virtual gray-scale samples after shooting (it is understood that the gray-scale of the virtual gray-scale samples is consistent with the gray-scale of the gray-scale samples), and then the light intensity alignment result between the real shooting foreground and the virtual shooting background is verified by comparing the foreground gray-scale with the background gray-scale. Because the gray scale sample can remove the influence of non-illuminance factors to reliably represent illuminance, the foreground gray scale and the background gray scale can be reliably and efficiently compared under the condition that the gray scale of the virtual gray scale sample is consistent with the gray scale of the gray scale sample, and the verification efficiency is improved.
Further, in the verification process, the gray sample in the actual shooting foreground can be shot by adjusting the initial shooting parameters, and then when the gray sample is neutral in the shot foreground gray, the initial shooting parameters are determined to be shooting parameters. That is, when the foreground gray level of the gray level sample after shooting is neutral gray level, the illuminance factor is more accurately represented, and the reliability of the verification process is further improved.
It should be understood that, among the above-described respective steps, steps S310 and S320 correspond to step S210 of fig. 2. Steps S330-S350 correspond to step S220 of fig. 2. Step S360 corresponds to step S230 of fig. 2. Steps S370-S380 correspond to step S240 of fig. 2.
For the embodiment of fig. 3A, without loss of generality, as an example of determining the brightness of the plurality of illumination sampling positions under the preset virtual light source, a plurality of coordinate values of the plurality of illumination sampling positions in the virtual photographing background may be determined according to a spatial correspondence between the real photographing foreground and the virtual photographing background, and then the brightness of the plurality of positions indicated by the plurality of coordinate values in the virtual photographing background, respectively, under the preset virtual light source may be read. Through the processing procedure, the spatial correspondence between the real shooting foreground and the virtual shooting background is beneficial to the effect of light intensity alignment. More specifically, the above-described spatial correspondence may refer to a correspondence between a coordinate system of a real shooting foreground and a coordinate system of a virtual shooting background. The coordinate system of the real shooting foreground is a three-dimensional coordinate system set based on the real shooting foreground, and the coordinate system of the virtual shooting background is a virtual three-dimensional coordinate system adopted when editing is performed in an image processing application program such as a virtual engine, so that more realistic three-dimensional visual effect is realized. Therefore, the coordinate system of the real photographing foreground and the coordinate system of the virtual photographing background may be aligned (for example, three dimensions of the two coordinate systems are aligned respectively), and then, based on the aligned real photographing foreground and virtual photographing background, a correspondence between a specific position of the illumination sampling position in the real photographing foreground and a specific position of the illumination sampling position in the virtual photographing background is determined.
More specifically, as one specific example of reading the brightness of a plurality of positions respectively indicated by a plurality of coordinate values in the virtual photographing background under a preset virtual light source, for each coordinate value, a virtual object (for example, a planar virtual object) may be set in the virtual engine at the coordinate value, and then, the surface brightness value of the virtual object is detected by means of a brightness detection tool in the virtual engine.
For the embodiment of fig. 3A, without loss of generality, in order to adjust the light intensities of the preset virtual light sources for the plurality of illumination sampling positions, respectively, so that the equivalent light intensities corresponding to the luminances of the plurality of illumination sampling positions are consistent with the actual light intensities of the plurality of illumination sampling positions, the equivalent light intensities having a preset mapping relationship with the luminance of each illumination sampling position may be determined first (for example, the preset mapping relationship indicates a correspondence relationship between the equivalent light intensity and the luminance of the object), and then, when the equivalent light intensity of each illumination sampling position is consistent with the actual light intensity, the adjusted light intensity of the preset virtual light source is recorded. The corresponding relation between the equivalent illuminance and the brightness of the object can be reliably indicated by the preset mapping relation, and the adjusted light intensity of the preset virtual light source can be reliably and efficiently obtained by comparing whether the equivalent illuminance and the actual illuminance of each illumination sampling position are consistent.
That is, when the equivalent illuminance at each illumination sampling position is inconsistent with the actual illuminance, the light intensity of the preset virtual light source may be adjusted until the equivalent illuminance at the illumination sampling position is consistent with the actual illuminance.
Further, for the embodiment of fig. 3A, without loss of generality, the light intensity processing method may further include: a plurality of illumination sampling positions are set so that the plurality of illumination sampling positions are located around a photographed object of a realistic photographing prospect. Therefore, the illumination of the illumination sampling position is more beneficial to representing the illumination of the shot object.
Further, for the embodiment of fig. 3A, without loss of generality, the light intensity processing method may further include: and determining an illumination plane in which a plurality of illumination sampling positions in the virtual shooting background are located, and then setting the position of a preset virtual light source in the virtual shooting background so that the projection position of the preset virtual light source in the illumination plane is between the plurality of illumination sampling positions. It is understood that the projection position of the preset virtual light source in the irradiation plane is among a plurality of illumination sampling positions, so that the illumination sampling positions are more close to the vertical irradiation, and the accuracy of representation of the preset mapping relation is further improved.
Further, for the embodiment of fig. 3A, without loss of generality, the light intensity processing method may further include: and adjusting the position of the preset virtual light source in the virtual shooting background so that the difference between the light intensity of each adjusted preset virtual light source and the fitting result is smaller than a preset value. Therefore, the light intensities after adjustment of the preset virtual light sources are closer to each other (for example, the statistical variance or the statistical standard deviation between the light intensities after adjustment is smaller), so that the fitting result is closer to the illuminance distribution brought by a single light source of the real shooting prospect, and the fitting effect of the fitting process is further improved.
Fig. 4 shows a light intensity processing device according to further embodiments of the invention. The light intensity processing apparatus of fig. 4 may be used to perform the light intensity processing method of fig. 2, comprising:
the acquisition module 410 acquires actual illuminance distribution of a plurality of illumination sampling positions in a real shooting foreground.
The determining module 420 determines the brightness of the plurality of illumination sampling positions under a preset virtual light source in the virtual shooting background of the real shooting foreground.
The adjusting module 430 adjusts the light intensities of the preset virtual light sources for the plurality of illumination sampling positions, so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions under the preset virtual light source is consistent with the actual illuminance distribution of the plurality of illumination sampling positions.
And a fitting module 440, configured to determine a fitting result of each adjusted light intensity of the preset virtual light source as a light intensity of the virtual shooting background aligned with the real shooting foreground.
According to the embodiment of the invention, by means of the brightness of the plurality of illumination sampling positions under the preset virtual light source, the equivalent illuminance distribution of the plurality of illumination sampling positions is obtained, and the light intensity of the preset virtual light source can be adjusted by comparing the equivalent illuminance distribution of the plurality of illumination sampling positions with the actual illuminance distribution, so that the light intensity of the preset virtual light source is aligned with the light intensity of the actual shooting prospect. In addition, the fitting result of the light intensity after each adjustment of the preset virtual light source is determined to be the light intensity aligned with the virtual shooting background and the real shooting background, so that the error caused by the single illumination sampling position is avoided, the accuracy of light intensity alignment is improved, and the shooting authenticity is improved.
In other examples, the determination module is specifically configured to: determining the positions of the plurality of illumination sampling positions in the virtual shooting background according to the spatial correspondence between the real shooting foreground and the virtual shooting background; and reading the brightness of a plurality of positions under the preset virtual light source in the virtual shooting background.
In other examples, the adjustment module is specifically configured to: determining equivalent illuminance with a preset mapping relation with the brightness of each illumination sampling position, wherein the preset mapping relation indicates the corresponding relation between the equivalent illuminance of the object and the brightness; and when the equivalent illuminance of each illumination sampling position is consistent with the actual illuminance, recording the adjusted light intensity of the preset virtual light source.
In other examples, the adjustment module is further to: when the equivalent illuminance of each illumination sampling position is inconsistent with the actual illuminance, the light intensity of the preset virtual light source is adjusted until the equivalent illuminance of the illumination sampling position is consistent with the actual illuminance.
In other examples, the acquisition module is further to: and setting the plurality of illumination sampling positions so that the plurality of illumination sampling positions are positioned around the photographed object of the real photographing prospect.
In other examples, the adjustment module is further to: determining an illumination plane in which the plurality of illumination sampling positions are located in the virtual shooting background; setting the position of the preset virtual light source in the virtual shooting background, so that the projection position of the preset virtual light source in the irradiation plane is between the plurality of illumination sampling positions.
In other examples, the fitting module is further to: and adjusting the position of the preset virtual light source in the virtual shooting background so that the difference between the light intensity of each preset virtual light source after adjustment and the fitting result is smaller than a preset value.
In other examples, the light intensity processing apparatus further comprises a verification module for: shooting a gray scale sample in the real shooting prospect based on shooting parameters to obtain a front Jing Huidu of the gray scale sample after shooting; shooting a virtual gray scale sample based on the shooting parameters to obtain the background gray scale of the virtual gray scale sample after shooting, wherein the gray scale of the virtual gray scale sample is consistent with the gray scale of the gray scale sample; and verifying the light intensity alignment result between the real shooting foreground and the virtual shooting background by comparing the gray scale of the front Jing Huidu and the background.
In other examples, the verification module is further to: shooting the gray sample in the real shooting prospect by adjusting initial shooting parameters; and when the foreground gray level of the gray level sample after shooting is neutral gray level, determining the initial shooting parameter as the shooting parameter.
In other examples, the adjustment module is further to: and under the condition that the preset virtual light source is ensured to have aligned light intensity, adjusting the light source cone angle of the preset virtual light source so that the equivalent illuminance of the plurality of illumination sampling positions is consistent with the actual illuminance distribution.
Referring to fig. 5, a schematic structural diagram of an electronic device according to another embodiment of the present invention is shown, and the specific embodiment of the present invention is not limited to the specific implementation of the electronic device.
As shown in fig. 5, the electronic device may include: a processor (processor) 502 for executing programs 510, a communication interface (Communications Interface) 504, a memory (memory) 506, and a communication bus 508.
The processor, communication interface, and memory communicate with each other via a communication bus.
And the communication interface is used for communicating with other electronic devices or servers.
And a processor, configured to execute a program, and specifically may execute relevant steps in the foregoing method embodiment.
In particular, the program may include program code including computer-operating instructions.
The processor may be a CPU or specific integrated circuit ASIC (Application Specific Integrated Circuit) or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors comprised by the smart device may be the same type of processor, such as one or more CPUs; but may also be different types of processors such as one or more CPUs and one or more ASICs.
And the memory is used for storing programs. The memory may comprise high-speed RAM memory or may further comprise non-volatile memory, such as at least one disk memory.
The program may include a plurality of computer instructions, and the program may specifically enable the processor to perform operations corresponding to the light intensity processing method described in any one of the foregoing method embodiments through the plurality of computer instructions.
The specific implementation of each step in the program may refer to the corresponding steps and corresponding descriptions in the units in the above method embodiments, and have corresponding beneficial effects, which are not described herein. It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the apparatus and modules described above may refer to corresponding procedure descriptions in the foregoing method embodiments, which are not repeated herein.
The present invention also provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method described in any of the preceding method embodiments. The computer storage media includes, but is not limited to: a compact disk read Only (Compact Disc Read-Only Memory, CD-ROM), random access Memory (Random Access Memory, RAM), floppy disk, hard disk, magneto-optical disk, or the like.
Embodiments of the present invention also provide a computer program product comprising computer instructions that instruct a computing device to perform operations corresponding to any one of the light intensity processes described in the method embodiments above.
In addition, it should be noted that, the information related to the user (including, but not limited to, user equipment information, user personal information, etc.) and the data related to the embodiment of the present invention (including, but not limited to, sample data for training the model, data for analyzing, stored data, presented data, etc.) are information and data authorized by the user or sufficiently authorized by each party, and the collection, use and processing of the related data need to comply with the related regulations and standards, and are provided with corresponding operation entries for the user to select authorization or rejection.
It should be noted that, according to implementation requirements, each component/step described in the embodiments of the present invention may be split into more components/steps, or two or more components/steps or part of operations of the components/steps may be combined into new components/steps, so as to achieve the objects of the embodiments of the present invention.
The methods according to embodiments of the present invention described above may be implemented in hardware, firmware, or as software or computer code storable in a recording medium such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk, or as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium and to be stored in a local recording medium downloaded through a network, so that the methods described herein may be processed by such software on a recording medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware such as an application specific integrated circuit (Application Specific Integrated Circuit, ASIC) or field programmable or gate array (Field Programmable Gate Array, FPGA). It is understood that a computer, processor, microprocessor controller, or programmable hardware includes a Memory component (e.g., random access Memory (Random Access Memory, RAM), read-Only Memory (ROM), flash Memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor, or hardware, performs the methods described herein. Furthermore, when a general purpose computer accesses code for implementing the methods illustrated herein, execution of the code converts the general purpose computer into a special purpose computer for performing the methods illustrated herein.
Those of ordinary skill in the art will appreciate that the elements and method steps of the examples described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present invention.
The above embodiments are only for illustrating the embodiments of the present invention, but not for limiting the embodiments of the present invention, and various changes and modifications may be made by one skilled in the relevant art without departing from the spirit and scope of the embodiments of the present invention, so that all equivalent technical solutions also fall within the scope of the embodiments of the present invention, and the scope of the embodiments of the present invention should be defined by the claims.

Claims (13)

1. A light intensity processing method comprising:
acquiring actual illuminance distribution of a plurality of illumination sampling positions in a real shooting prospect;
in the virtual shooting background of the real shooting foreground, determining the brightness of the plurality of illumination sampling positions under a preset virtual light source;
Respectively adjusting the light intensity of the preset virtual light source for the plurality of illumination sampling positions, so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions under the preset virtual light source is consistent with the actual illuminance distribution of the plurality of illumination sampling positions;
and determining fitting results of the adjusted light intensities of the preset virtual light sources as light intensities of the virtual shooting background aligned with the real shooting foreground.
2. The method of claim 1, wherein the determining the brightness of the plurality of illumination sampling locations under the preset virtual light source in the virtual capture background of the real capture foreground comprises:
determining the positions of the plurality of illumination sampling positions in the virtual shooting background according to the spatial correspondence between the real shooting foreground and the virtual shooting background;
and reading the brightness of a plurality of positions under the preset virtual light source in the virtual shooting background.
3. The method of claim 1, wherein the adjusting the light intensities of the preset virtual light sources for the plurality of illumination sampling positions respectively so that the equivalent illuminance distribution corresponding to the luminances of the plurality of illumination sampling positions respectively coincides with the actual illuminance distribution of the plurality of illumination sampling positions comprises:
Determining equivalent illuminance with a preset mapping relation with the brightness of each illumination sampling position, wherein the preset mapping relation indicates the corresponding relation between the equivalent illuminance of the object and the brightness;
and when the equivalent illuminance of each illumination sampling position is consistent with the actual illuminance, recording the adjusted light intensity of the preset virtual light source.
4. A method according to claim 3, wherein the method further comprises:
when the equivalent illuminance of each illumination sampling position is inconsistent with the actual illuminance, the light intensity of the preset virtual light source is adjusted until the equivalent illuminance of the illumination sampling position is consistent with the actual illuminance.
5. The method of claim 1, wherein the method further comprises:
and setting the plurality of illumination sampling positions so that the plurality of illumination sampling positions are positioned around the photographed object of the real photographing prospect.
6. The method of claim 1, wherein the method further comprises:
determining an illumination plane in which the plurality of illumination sampling positions are located in the virtual shooting background;
setting the position of the preset virtual light source in the virtual shooting background, so that the projection position of the preset virtual light source in the irradiation plane is between the plurality of illumination sampling positions.
7. The method of claim 1, wherein the method further comprises:
and adjusting the position of the preset virtual light source in the virtual shooting background so that the difference between the light intensity of each preset virtual light source after adjustment and the fitting result is smaller than a preset value.
8. The method of claim 1, wherein the method further comprises:
shooting a gray scale sample in the real shooting prospect based on shooting parameters to obtain a front Jing Huidu of the gray scale sample after shooting;
shooting a virtual gray scale sample based on the shooting parameters to obtain the background gray scale of the virtual gray scale sample after shooting, wherein the gray scale of the virtual gray scale sample is consistent with the gray scale of the gray scale sample;
and verifying the light intensity alignment result between the real shooting foreground and the virtual shooting background by comparing the gray scale of the front Jing Huidu and the background.
9. The method of claim 8, wherein the method further comprises:
shooting the gray sample in the real shooting prospect by adjusting initial shooting parameters;
and when the foreground gray level of the gray level sample after shooting is neutral gray level, determining the initial shooting parameter as the shooting parameter.
10. The method of claim 1, wherein the method further comprises:
and under the condition that the preset virtual light source is ensured to have aligned light intensity, adjusting the light source cone angle of the preset virtual light source so that the equivalent illuminance of the plurality of illumination sampling positions is consistent with the actual illuminance distribution.
11. A light intensity processing apparatus comprising:
the acquisition module acquires actual illuminance distribution of a plurality of illumination sampling positions in a real shooting prospect;
the determining module is used for determining the brightness of the plurality of illumination sampling positions under a preset virtual light source in the virtual shooting background of the real shooting foreground;
the adjusting module is used for respectively adjusting the light intensity of the preset virtual light source for the plurality of illumination sampling positions so that the equivalent illuminance distribution corresponding to the brightness of the plurality of illumination sampling positions under the preset virtual light source is consistent with the actual illuminance distribution of the plurality of illumination sampling positions;
and the fitting module is used for determining the fitting result of the light intensity after each adjustment of the preset virtual light source as the light intensity of the virtual shooting background aligned with the real shooting foreground.
12. An electronic device, comprising: the device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus;
The memory is configured to store at least one executable instruction that causes the processor to perform operations corresponding to the method according to any one of claims 1-10.
13. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to any of claims 1-10.
CN202311432750.1A 2023-10-31 2023-10-31 Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium Pending CN117354438A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311432750.1A CN117354438A (en) 2023-10-31 2023-10-31 Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311432750.1A CN117354438A (en) 2023-10-31 2023-10-31 Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium

Publications (1)

Publication Number Publication Date
CN117354438A true CN117354438A (en) 2024-01-05

Family

ID=89357415

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311432750.1A Pending CN117354438A (en) 2023-10-31 2023-10-31 Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium

Country Status (1)

Country Link
CN (1) CN117354438A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107734264A (en) * 2017-09-11 2018-02-23 广东欧珀移动通信有限公司 Image processing method and device
CN108509887A (en) * 2018-03-26 2018-09-07 深圳超多维科技有限公司 A kind of acquisition ambient lighting information approach, device and electronic equipment
CN108986199A (en) * 2018-06-14 2018-12-11 北京小米移动软件有限公司 Dummy model processing method, device, electronic equipment and storage medium
US20200143588A1 (en) * 2018-11-02 2020-05-07 Canon Kabushiki Kaisha Information processing apparatus, information processing method, and storage medium for image display and virtual light source representation
CN111698390A (en) * 2020-06-23 2020-09-22 网易(杭州)网络有限公司 Virtual camera control method and device, and virtual studio implementation method and system
CN114359021A (en) * 2021-12-31 2022-04-15 网易(杭州)网络有限公司 Processing method and device for rendered picture, electronic equipment and medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107734264A (en) * 2017-09-11 2018-02-23 广东欧珀移动通信有限公司 Image processing method and device
CN108509887A (en) * 2018-03-26 2018-09-07 深圳超多维科技有限公司 A kind of acquisition ambient lighting information approach, device and electronic equipment
CN108986199A (en) * 2018-06-14 2018-12-11 北京小米移动软件有限公司 Dummy model processing method, device, electronic equipment and storage medium
US20200143588A1 (en) * 2018-11-02 2020-05-07 Canon Kabushiki Kaisha Information processing apparatus, information processing method, and storage medium for image display and virtual light source representation
CN111698390A (en) * 2020-06-23 2020-09-22 网易(杭州)网络有限公司 Virtual camera control method and device, and virtual studio implementation method and system
CN114359021A (en) * 2021-12-31 2022-04-15 网易(杭州)网络有限公司 Processing method and device for rendered picture, electronic equipment and medium

Similar Documents

Publication Publication Date Title
US11210839B2 (en) Photometric image processing
US20170059305A1 (en) Active illumination for enhanced depth map generation
CN109587556B (en) Video processing method, video playing method, device, equipment and storage medium
US10663291B2 (en) Method and system for reproducing visual content
US10930059B2 (en) Method and apparatus for processing virtual object lighting inserted into a 3D real scene
US11022861B2 (en) Lighting assembly for producing realistic photo images
CN107370910B (en) Minimum surround based on optimal exposure exposes set acquisition methods
CN117459700B (en) Color luminosity three-dimensional imaging method, system, electronic equipment and medium
JP2017045166A (en) Workpiece processing method, method for creating reference image, reference image creation device, workpiece processing device, program, and recording medium
CN111105365B (en) Color correction method, medium, terminal and device for texture image
CN110458964B (en) Real-time calculation method for dynamic illumination of real environment
US11417019B2 (en) Detection of a calibration object for modifying image parameters
Einabadi et al. Discrete Light Source Estimation from Light Probes for Photorealistic Rendering.
CN113837917A (en) Cross-media invisible watermark checking method and system based on AR technology
CN117354439B (en) Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium
CN112749746A (en) Method, system and device for iteratively updating defect sample
CN117354438A (en) Light intensity processing method, light intensity processing device, electronic equipment and computer storage medium
CN116681689A (en) Occlusion image generation method and device, electronic equipment and storage medium
CN115914616A (en) Light source point detection method, device, equipment and computer readable storage medium
Pintus et al. Practical free-form RTI acquisition with local spot lights
CN108776963B (en) Reverse image authentication method and system
CN116452459B (en) Shadow mask generation method, shadow removal method and device
CN118338132B (en) Shooting method and system for flexible material, storage medium and electronic equipment
CN114760422B (en) Backlight detection method and system, electronic equipment and storage medium
Štampfl et al. Shadow Segmentation with Image Thresholding for Describing the Harshness of Light Sources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination