CN107197171A - A kind of digital photographing processing method for adding intelligence software light source - Google Patents

A kind of digital photographing processing method for adding intelligence software light source Download PDF

Info

Publication number
CN107197171A
CN107197171A CN201710482260.0A CN201710482260A CN107197171A CN 107197171 A CN107197171 A CN 107197171A CN 201710482260 A CN201710482260 A CN 201710482260A CN 107197171 A CN107197171 A CN 107197171A
Authority
CN
China
Prior art keywords
light source
digital photographing
brightness
light
software
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710482260.0A
Other languages
Chinese (zh)
Inventor
周素梅
邓蜀国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southwest University
Original Assignee
Southwest University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southwest University filed Critical Southwest University
Priority to CN201710482260.0A priority Critical patent/CN107197171A/en
Publication of CN107197171A publication Critical patent/CN107197171A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/75Circuitry for compensating brightness variation in the scene by influencing optical camera components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/76Circuitry for compensating brightness variation in the scene by influencing the image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a kind of digital photographing processing method for adding intelligence software light source, obtain video flowing two field picture, user inserts software light source in viewing area specified location, system obtains image-region color value automatically, extract (r, g, b) component, scope is rendered according to light source parameters calculating and brightness is superimposed.The present invention can add one or more software light sources to video arbitrary region (quantity is not limited in theory), and the parameters such as light direction F, lamplight brightness B, light range R, light color C can be set, designated area brightness intelligently, accurately can be rendered according to lighting programmers, reach raising digital photographing image quality purpose;When outside physical light-source can not meet digital photographing condition, addition polytype light source can be realized by software, the parameters such as light direction, range and brightness are adjusted, realize that carrying out intelligence to video image designated area renders, so as to improve photo image quality.

Description

A kind of digital photographing processing method for adding intelligence software light source
Technical field
The invention belongs to digital photographing processing technology field, more particularly to a kind of digital photographing for adding intelligence software light source Processing method.
Background technology
At present, it is ripe by computer progress portrait digital photographing technology, and application is widely.Specialty takes pictures one As in film studio carry out, film studio be provided with specialty light source, generally require each 1 of king light, auxiliary lamp, floor-lamp, ceiling light, background 1 to 2, lamp.This lighting mode makes image light soft, and exposure is uniform, can remove pouch, eliminate nasal fossa shade, make one picture More aestheticism.In specific photographing operation, particularly some colleges and universities, middle and primary schools, office, enterprises and institutions are gathered in high-volume During photo, often because of the film studio without specialty, and time is pressing, typically selection office, meeting room are used as bat on the spot According to place, the fluorescent lamp or near the window, passageway scattered light at the top of room are relied on as light source, because light source is unbalanced, is taken pictures When, it is excessive, not enough or unbalance portrait partial exposure usually occur, and final photo effect is have impact on to a certain extent.
In summary, there is light source when high-volume gathers photo at present unbalanced, portrait partial exposure occur excessive, not enough Or it is unbalance, influence final photo effect.
The content of the invention
It is an object of the invention to provide a kind of digital photographing processing method for adding intelligence software light source, it is intended to solves mesh There is light source during preceding high-volume collection photo unbalanced, it is excessive, not enough or unbalance portrait partial exposure occur, influences final photo The problem of effect.
What the present invention was realized in:Capture in real time in the window and show camera video image, select light sources in light source bank, drag Specified light source is moved to video specified location, system will be rendered to give tacit consent to light source parameters in the position to video, user Ke Tong Cross mouse or menu is modified to light source parameters, system is carried out according to the amended light source parameters of user are real-time to video image Render.
Further, the addition intelligence software light source is mainly included the following steps that:
Step one, light sources in light source bank is set up:That is dynamic light source array, each array element represents a light source, each light source tool There are the attributes such as position P, direction F, brightness B, range R, color C;
Step 2, obtains video flowing two field picture in real time;
Step 3, light source management;
1st, light source is added:A light source is selected in light sources in light source bank, visual windows specified location is dragged to, that is, completed The addition of software light source (now, in visual windows display light source characteristic image thumbnail);
2nd, mobile light source:The position hot-zone set up in light source image region, dragging mouse in the region can be intuitively complete The movement of paired light source position;
The 3rd, light source parameters are set:
Method one:Pass through right button menu:The parameter exact numericals such as set location P, direction F, brightness B, range R, color C;
Method two:Pass through mouse action:Parameter hot-zone is set up in light source image region:Including direction F hot-zones, brightness B heat Area, range R hot-zones, parameter setting can intuitively be completed by dragging associative operation bar in hot-zone by mouse;
4th, light source is deleted:Needs are balanced according to video image brightness, unnecessary light source can be deleted, it is to delete dynamic to delete water source Element is specified in light source array;
Step 4, travels through list of light sources, and carrying out brightness to two field picture according to light source parameters renders:Obtain image-region color Original value, extracts (r, g, b) component;Wash with watercolours is calculated according to parameters such as light source position P, brightness B, range R, direction F, light color C The color value that should be superimposed after dye simultaneously extracts its color component (r, g, b), by the synchronous superimposed light of (r, g, b) component of original color value (r, g, b) of source rendered color value, you can show final rendering effect pattern in real time in viewing area;
Step 5, take pictures preservation when, in real time obtain video flowing two field picture, carry out brightness render and preserved.
Further, the encryption method of the video flowing two field picture comprises the following steps:
Step 1: defining random function funA, according to the length of video file, generation is some to random integers (x, y), deposits Enter in set S { }, and set S is saved in database in corresponding video file attributes field, control generation video-encryption The Y value of file size<10;
Step 2: reading video file stream by byte, the information from database according to video file reads the collection of deposit S { } is closed, all random numbers pair are obtained;
Step 3: according to data to (x, y), the X position in file stream writes the random string of Y length, by file In stream write-in encrypted video file stream;
Step 4: repeat step three, until file read-write is completed.
The digital photographing processing method for the addition intelligence software light source that the present invention is provided, can be to video arbitrary region addition one Individual or multiple software light sources (quantity is not limited in theory), and light direction F, lamplight brightness B, light can be set to penetrate respectively Journey R, light color C etc., intelligence can be needed according to picture, accurately designated area brightness is rendered, reach improve digital photographing into As quality purpose;When outside physical light-source can not meet digital photographing condition, addition polytype can be realized by software Light source, adjusts the parameters such as light direction, range and brightness, realizes that carrying out intelligence to video image designated area renders, so as to carry High photo image quality.
Brief description of the drawings
Fig. 1 is the digital photographing process flow figure of addition intelligence software light source provided in an embodiment of the present invention.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to embodiments, to the present invention It is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not used to Limit the present invention.
The application principle of the present invention is explained in detail below in conjunction with the accompanying drawings.
As shown in figure 1, it is provided in an embodiment of the present invention addition intelligence software light source digital photographing processing method include with Lower step:
S101:Set up light sources in light source bank;
S102:Video flowing two field picture is obtained in real time;
S103:Software light source is managed;Software light source is added, software illuminant characterization image thumbnails are loaded in viewing area; Mobile light source;Light source parameters are set:Position P, direction F, brightness B, range R, color C parameters;Delete light source;
S104:List of light sources is traveled through, carrying out brightness to two field picture according to light source parameters renders;
S105:Take pictures preservation when, in real time obtain video flowing two field picture, carry out brightness render and preserved.
In step s 103:Light source parameters are set:(1) completed by the related hot-zone action bars of mouse drag;(2) pass through Right button menu is configured.
The encryption method of the video flowing two field picture comprises the following steps:
Step 1: defining random function funA, according to the length of video file, generation is some to random integers (x, y), It is stored in set S { }, and set S is saved in database in corresponding video file attributes field, control generation video adds The Y value of close file size<10;
Step 2: reading video file stream by byte, the information from database according to video file reads the collection of deposit S { } is closed, all random numbers pair are obtained;
Step 3: according to data to (x, y), the X position in file stream writes the random string of Y length, by file In stream write-in encrypted video file stream;
Step 4: repeat step three, until file read-write is completed.
The application principle of the present invention is further described with reference to specific embodiment.
The digital photographing processing method of addition intelligence software light source provided in an embodiment of the present invention comprises the following steps:
1st, light sources in light source bank is set up
public static ArrayList Lamps;// dynamic light source structural array:The light source loaded
Wherein:Light source serial number numbering flowing water such as 1,2,3 ...;The entitled mark to light source of light source, to multiple light sources It is easy to identification;Light source image is characterized picture, such as bulb, the sun ...;Point coordinates centered on light source center position;Light source is former Beginning size is the actual size of light source picture;Light source shows that scaling is Zoom display in the window, is easy to the behaviour to light source Make;Brightness, range, start angle, termination point and color are respectively the different characteristic parameter of light source.
Light sources in light source bank is predefined a collection of Ordinary Light Sources Have list, such as sun, fluorescent lamp ... ..
2nd, video flowing two field picture is obtained in real time.
Bitmap VideoFrameBitmap=(Bitmap) videoSourcePlayer.GetCurrentVideoFrame();
3rd, light source is managed.
(1) light source is added:AddLamp(Bitmap LampBitmap,LampStyle S,Point P,float F1, Float F2, float B, int R, Color C), i.e., increase an element in the dynamic light source array of activation, while in window Shown in mouthful.
(2) mobile light source:MoveLamp(int LampNumber,Point P);Change the coordinate for specifying light source.
(3) light source parameters are set:EditLamp (int LampNumber), that is, set the position P for specifying light source, brightness The parameters such as B, range R, deflection F1, F2, light color C.
Wherein position P scope is in video viewing area;Brightness B scopes are 0 to 255;Range B scopes are viewing areas Maximum magnitude max (VideoFrameW, VideoFrameH);Deflection F1 (initial angle), direction F2 (end angle):Scope is F1 >=0&&F1<=360, F2>=0&&F2<=360.
(4) light source is deleted:DeleteLamp(int LampNumber).One is deleted in the dynamic light source array of activation Individual element, while no longer showing the light source in the window.
4th, list of light sources is traveled through, carrying out brightness to two field picture according to light source parameters renders:Obtain image-region color original Value, extracts (r, g, b) component;Calculated according to parameters such as light source position P, brightness B, range R, direction F, light color C after rendering The color value that should be superimposed simultaneously extracts its color component (r, g, b), and (r, g, b) component of original color value is synchronously superimposed into light source wash with watercolours Contaminate (r, g, b) of color value, you can show final rendering effect pattern in real time in viewing area.
(1):Image-region original color value Color_Old (x, y) is obtained, (r, g, b) component is extracted.
(2):Light color is calculated according to parameters such as lighting programmers position P, brightness B, range R, direction F, color C ColorBrightness (x, y), and extract its (r, g, b) component.
(3) it is superimposed light luminance:Light color value is superimposed on the basis of original color value, i.e., it is same on r, g, b component Step superposition, final effect is shown in viewing area in real time
R+=(int) BrightnessR;
G+=(int) BrightnessG;
B+=(int) BrightnessB;
When the 5th, preserving, video flowing two field picture is obtained in real time, and the progress brightness that repeats the above steps is rendered and to specified photo Region is cut, preserved.
Bitmap SavePhoto=CropBitmap (VideoFrameBitmap, SavePhotoRectangle);
SavePhoto.Save(SavePhotoFileName,SavePhotoFileFormat.JPG)。
Above technical finesse explanation:
1st, light source hot-zone (△, ▽), rolling selection light source hot-zone and dragging is selected to add in built-in vertical click on of light source base area Plus light source hot-zone.Hot-zone is a series of coordinate arrays, position and event for induction mouse.
Point[]p_lampMode_DownArea;// top △ selection light sources hot-zone:For selecting a upper light source
Point[]p_lampMode_UpArea;// bottom ▽ selection light sources hot-zone:For selecting next light source
Point[]p_lampMode_RollArea;// roll selection light source hot-zone
Point[]p_lampMode_Area;// dragging addition light source hot-zone
2nd, light source parameters are set up in illuminant characterization image-region hot-zone and mobile hot-zone is set, into illuminant characterization image Breviary region, system amplifies display light source characteristic image automatically, and responds mouse click, rolling, drag operation, triggering light source position Mobile, parameter setting event is put, and according to displacement real-time rendering viewing area of the mouse to light source parameters control stick.
The realization principle for the intelligence software that the present invention is provided:The brightness of light source is linearly declined by light source center along light direction Subtract, i.e., on the basis of light source center color, extract (r, g, b) component, the numerical value of its r, g, b component is sexually revised by line synchro, The decay of light-source brightness can be achieved.Traditional pixel method is abandoned in real-time rendering luminance video (to provide by development environment The function of special acquisition color obtain the color of specified location pixel), but use internal memory method, i.e., by obtaining in image Sweep length, the pixel wide of variable are deposited, the color to specified location pixel carries out memory address, by directly to the behaviour of internal memory The mesh of modification colour brightness is reached, Partial key code is as follows:
Int Stride=Math.Abs (bmpData.Stride);// sweep length;
Int PixelWidth=Stride/bmpData.Width;Digit shared by // mono- pixel 4:(R,G,B, Y), 3:(R,G,B).
Byte [] rgb Values=new byte [bytes];// bitmap data byte arrays;
// original color value
Int r=rgbValues [y*Stride+x*PixelWidth+2];//R is red component;
Int g=rgbValues [y*Stride+x*PixelWidth+1];//G is green component;
Int b=rgbValues [y*Stride+x*PixelWidth+0];//B is blue component.
// light source r, g, b superposition
// internal storage data writes direct
Rgb Values [y*Stride+x*PixelWidth+0]=(byte) (b);
Rgb Values [y*Stride+x*PixelWidth+1]=(byte) (g);
Rgb Values [y*Stride+x*PixelWidth+2]=(byte) (r);
Marshal.Copy(rgb Values,0,ptr,bytes);
Rendered by internal memory method, processing, storage speed are exceedingly fast, and almost the imperceptible time prolongs in actual applications Late.
In render process is carried out to video, it is related to larger image memory variable, although development language provides automatic Memory management, but to improve internal memory utilization ratio and preventing internal memory from overflowing, system specially adds memory variable managing process, Discarded variable is purged in time, the speed and stability of Video Rendering is further increased.In long-time (for three days on end Uninterruptedly), in the case of image quality (1080P), high-speed (secondary/50ms) to video source, light source, head portrait area carry out random movement, The super-strength pressure test such as Arbitrary Rotation in the range of 360 degree, system can normally be run.Software without Professional Photography canopy, Carried out especially for units such as school, office, enterprises and institutions when batch is taken pictures with very strong practicality.With respect to software light source, Physical light-source has more stereovision and authenticity on imaging effect, and such as condition is permitted, is also to try to build special physical light-source.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention Any modifications, equivalent substitutions and improvements made within refreshing and principle etc., should be included in the scope of the protection.

Claims (5)

1. a kind of digital photographing processing method for adding intelligence software light source, it is characterised in that the addition intelligence software light source Digital photographing processing method obtain video flowing two field picture, user inserts software light source in viewing area specified location, system from It is dynamic to obtain image-region color value, (r, g, b) component is extracted, scope is rendered according to light source parameters calculating and brightness is superimposed.
2. the digital photographing processing method of intelligence software light source is added as claimed in claim 1, it is characterised in that the addition The digital photographing processing method of intelligence software light source comprises the following steps:
Step one, light sources in light source bank is set up;
Step 2, obtains video flowing two field picture in real time;
Step 3, the management of software light source;Software light source is added, software illuminant characterization image thumbnails are loaded in viewing area;Move Dynamic light source;Light source parameters are set:Position P, direction F, brightness B, range R, color C parameters;Delete light source;
Step 4, travels through list of light sources, and carrying out brightness to two field picture according to light source parameters renders;
Step 5, take pictures preservation when, in real time obtain video flowing two field picture, carry out brightness render and preserved.
3. the digital photographing processing method of intelligence software light source is added as claimed in claim 2, it is characterised in that described in step The management of software light source includes in rapid four:The movement of light source position;Change light source parameters;Delete and specify light source.
4. the digital photographing processing method of intelligence software light source is added as claimed in claim 2, it is characterised in that the step In five according to light source parameters to two field picture carry out brightness render including:
Image-region color value is obtained, (r, g, b) component is extracted;
Scope is rendered according to lighting programmers position P, brightness B, range R, direction F, the calculating of light color C parameters and light color is folded Degree of highlighting, and final rendering effect pattern is shown in real time in viewing area.
5. the digital photographing processing method of intelligence software light source is added as claimed in claim 2, it is characterised in that the video The encryption method of stream two field picture comprises the following steps:
Step 1: defining random function funA, according to the length of video file, produce some to random integers (x, y), deposit collection Close in S { }, and set S is saved in database in corresponding video file attributes field, control generation video-encryption file The Y value of size<10;
Step 2: reading video file stream by byte, the information from database according to video file reads the set S of deposit { }, obtains all random numbers pair;
Step 3: according to data to (x, y), the X position in file stream writes the random string of Y length, file stream is write Enter in encrypted video file stream;
Step 4: repeat step three, until file read-write is completed.
CN201710482260.0A 2017-06-22 2017-06-22 A kind of digital photographing processing method for adding intelligence software light source Pending CN107197171A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710482260.0A CN107197171A (en) 2017-06-22 2017-06-22 A kind of digital photographing processing method for adding intelligence software light source

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710482260.0A CN107197171A (en) 2017-06-22 2017-06-22 A kind of digital photographing processing method for adding intelligence software light source

Publications (1)

Publication Number Publication Date
CN107197171A true CN107197171A (en) 2017-09-22

Family

ID=59879547

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710482260.0A Pending CN107197171A (en) 2017-06-22 2017-06-22 A kind of digital photographing processing method for adding intelligence software light source

Country Status (1)

Country Link
CN (1) CN107197171A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108810406A (en) * 2018-05-23 2018-11-13 Oppo广东移动通信有限公司 Portrait light efficiency processing method, device, terminal and computer readable storage medium
CN109688341A (en) * 2018-12-27 2019-04-26 维沃移动通信有限公司 A kind of method for polishing and terminal device
CN111147733A (en) * 2018-11-02 2020-05-12 佳能株式会社 Information processing apparatus, information processing method, and storage medium
CN111901529A (en) * 2020-08-17 2020-11-06 珠海格力电器股份有限公司 Target object shooting method and device
WO2022007787A1 (en) * 2020-07-07 2022-01-13 广州虎牙科技有限公司 Image processing method and apparatus, device and medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542612A (en) * 2010-12-27 2012-07-04 新奥特(北京)视频技术有限公司 Method for setting light source parameters and calculating light color based on OpenGL core mode
CN103606182A (en) * 2013-11-19 2014-02-26 华为技术有限公司 Method and device for image rendering
CN104392479A (en) * 2014-10-24 2015-03-04 无锡梵天信息技术股份有限公司 Method of carrying out illumination coloring on pixel by using light index number
CN106254895A (en) * 2016-07-21 2016-12-21 重庆科技学院 A kind of for audio frequency and video Mp4 file encryption decryption system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542612A (en) * 2010-12-27 2012-07-04 新奥特(北京)视频技术有限公司 Method for setting light source parameters and calculating light color based on OpenGL core mode
CN103606182A (en) * 2013-11-19 2014-02-26 华为技术有限公司 Method and device for image rendering
CN104392479A (en) * 2014-10-24 2015-03-04 无锡梵天信息技术股份有限公司 Method of carrying out illumination coloring on pixel by using light index number
CN106254895A (en) * 2016-07-21 2016-12-21 重庆科技学院 A kind of for audio frequency and video Mp4 file encryption decryption system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108810406A (en) * 2018-05-23 2018-11-13 Oppo广东移动通信有限公司 Portrait light efficiency processing method, device, terminal and computer readable storage medium
CN111147733A (en) * 2018-11-02 2020-05-12 佳能株式会社 Information processing apparatus, information processing method, and storage medium
US11151779B2 (en) 2018-11-02 2021-10-19 Canon Kabushiki Kaisha Information processing apparatus, information processing method, and storage medium for image display and virtual light source representation
CN111147733B (en) * 2018-11-02 2021-12-03 佳能株式会社 Information processing apparatus, information processing method, and storage medium
CN109688341A (en) * 2018-12-27 2019-04-26 维沃移动通信有限公司 A kind of method for polishing and terminal device
WO2022007787A1 (en) * 2020-07-07 2022-01-13 广州虎牙科技有限公司 Image processing method and apparatus, device and medium
CN111901529A (en) * 2020-08-17 2020-11-06 珠海格力电器股份有限公司 Target object shooting method and device

Similar Documents

Publication Publication Date Title
CN107197171A (en) A kind of digital photographing processing method for adding intelligence software light source
US9262854B2 (en) Systems, methods, and media for creating multiple layers from an image
CN104221358B (en) Unified slider control for modifying multiple image properties
US8644644B2 (en) Methods and apparatus for blending images
US8849043B2 (en) System for matching artistic attributes of secondary image and template to a primary image
US8212834B2 (en) Artistic digital template for image display
US8849853B2 (en) Method for matching artistic attributes of a template and secondary images to a primary image
US8854395B2 (en) Method for producing artistic image template designs
US8237819B2 (en) Image capture method with artistic template design
US8289340B2 (en) Method of making an artistic digital template for image display
TW202234341A (en) Image processing method and device, electronic equipment and storage medium
US20110029635A1 (en) Image capture device with artistic template design
WO2017097143A1 (en) Method and device for setting interface switch animation
US20120249571A1 (en) Image display method, server, and image display system
CN105940673B (en) Image processing apparatus and image processing method
CN104221359A (en) Color adjustors for color segments
LeGendre et al. Practical multispectral lighting reproduction
CN114241159A (en) Three-dimensional reconstruction and PBR mapping manufacturing method based on close-range photogrammetry method
CN103413339B (en) 1000000000 pixel high dynamic range images are rebuild and the method for display
TW201933046A (en) Image processing method and device based on augmented reality, and electronic equipment
CN109089045A (en) A kind of image capture method and equipment and its terminal based on multiple photographic devices
WO2022022260A1 (en) Image style transfer method and apparatus therefor
CN104537633B (en) A kind of method that utilization image fusion technology eliminates the anti-shadow of image
KR20210029905A (en) Method and computer program for remove photo background and taking composite photograph
CN103795925A (en) Interactive main-and-auxiliary-picture real-time rendering photographing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170922

RJ01 Rejection of invention patent application after publication