EP1944761A1 - Disturbance reduction in digital signal processing - Google Patents

Disturbance reduction in digital signal processing Download PDF

Info

Publication number
EP1944761A1
EP1944761A1 EP07000716A EP07000716A EP1944761A1 EP 1944761 A1 EP1944761 A1 EP 1944761A1 EP 07000716 A EP07000716 A EP 07000716A EP 07000716 A EP07000716 A EP 07000716A EP 1944761 A1 EP1944761 A1 EP 1944761A1
Authority
EP
European Patent Office
Prior art keywords
signal
lpc
perturbation
speech
coefficients
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP07000716A
Other languages
German (de)
French (fr)
Inventor
Christophe Beaugeant
Herve Taddei
Emmanuel Rossignol Thepie Fapi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Solutions and Networks GmbH and Co KG
Original Assignee
Siemens Networks GmbH and Co KG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Networks GmbH and Co KG filed Critical Siemens Networks GmbH and Co KG
Priority to EP07000716A priority Critical patent/EP1944761A1/en
Priority to PCT/EP2007/063598 priority patent/WO2008086920A1/en
Publication of EP1944761A1 publication Critical patent/EP1944761A1/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/06Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients

Definitions

  • the invention relates to disturbance reduction in digital signal processing.
  • Digital telecommunication systems include speech coding. Speech codecs are definitely perturbed by the presence of noise and echo. Indeed, they are optimized to handle single speech signals.
  • LPC Linear Prediction Coefficients
  • Noise reduction and echo cancellation are historically built as pre-processing before coding the speech.
  • Many solutions reducing the perturbations on PCM signals are available.
  • a state of the art overview can be found in " Combined Noise and Echo Reduction in Hands-Free systems: A Survey” by R. Le Bouquin Jeannippo, P. Scalart, G. Faucon, C. Beaugeant; IEEE Trans. On Speech and Audio Processing; vol.9; Nov 2001; pp 808-820 .
  • Such solutions are efficient when the PCM data is available, so typically if the problem are solved within the terminal itself, before the encoding of the signal.
  • LPC Linear Prediction Coefficients
  • the digital signal y(n) comprises a useful signal s(n) and a perturbation signal p(n).
  • the perturbation signal p(n) derives e.g. from noise or echo and includes everything of y(n) that is not part of the useful signal s(n).
  • the bitstream y e (n) is derived from y(n) by LPC-encoding.
  • LPC Linear Prediction Coefficients
  • Other parameters of the bitstream y e (n) may also be received, like the fixed gain or the adaptive gain of the bitstream y e (n).
  • the complete bitstream y e (n) is received.
  • the autocorrelation matrix ⁇ s of the useful signal s(n), of the autocorrelation matrix ⁇ p , of the perturbation signal p(n) and the LPC A p of the perturbation signal p(n) are estimated.
  • a modified LPC A s is calculated. It is calculated from A y and the estimated ⁇ s , ⁇ p , A p .
  • a modified data stream y e '(n) including the modified LPC A s is output. This data stream can be received by a decoder which decodes the original signal y(n).
  • Codecs for transmission of speech are optimized for speech signals.
  • the addition of noise or of echo to the useful speech signal leads to sub-optimal behaviour of the codecs, which means additive artefacts on the decoded signal and lower quality.
  • the use of LPC coefficients that are influenced by the noise signal makes the quality of the received speech worse. Accordingly, noise and echo are not only adding undesired information to the useful signal, they also lead to sub-optimal behaviour of speech codecs, decreasing all the quality of telecommunication.
  • the steps of estimating ⁇ s , ⁇ p , A p can be based on the residual signal of y e (n) and A y .
  • the residual signal is the signal that is obtained after the LPC filtering.
  • y e (n) comprises of the residual signal and the LPC coefficients.
  • the estimations of ⁇ s , ⁇ p , A p can be done by classical methods, e.g. by frequency analysis of the encoded signal y e (n).
  • the method also comprises a step of a noise reduction on the residual signal of the encoded signal y e (n).
  • a noise reduction technique on residual signals is described in the above-mentioned "Compressed Domain Noise Reduction and Echo Suppression for Network Speech".
  • the invention described here provides a solution to achieve a reduction of perturbation, like noise and echo, by modifying the LPC coefficients computed during LPC analysis.
  • the Linear Prediction Cofficients (LPC) A y of the signal y e (n) are not received, but calculated from the digital sample signal y(n).
  • the encoding and modifying the LPC coefficients is done only once. Therefore, the residual signal does not need to be encoded and output twice. This improves the speed for encoding and modifying the LPC.
  • the invention may be used with any system based on model of Eq (1) where additive perturbation disturbed the coefficients ⁇ a y ( k ) ⁇ .
  • the method is applicable in a broad range of applications in signal processing.
  • One possible application where the LPC modification would be useful is earthquake detection.
  • the method is especially qualified for signal transmission in telecommunication. Because the different signal characteristics of voice and noise signals, the autocorrelation matrix of the perturbation signal can be estimated relatively precisely. This ensures that the cleaning of the LPC parameters is made successful.
  • the invention also relates to a digital signal transmission apparatus that performs the inventive method.
  • Such an apparatus comprises means for receiving the LPC coefficients A y , for the estimation of ⁇ s , ⁇ p , A p , for the calculation and output of A p .
  • DSP digital signal processor
  • a corrupted signal y(n) is the sum of a useful signal s(n) with a perturbation p ( n ).
  • a s A y + ⁇ s - 1 . ⁇ p ⁇ A y - A p
  • the present invention proposes a method based on formula Eq. (20)-(21) or on any formula derived from this equation to obtain the LPC coefficients of the useful signal ( A s ), when the LPC coefficients of the perturbed signal ( A y ) are available.
  • Eq. (20)/(21) require to know the LPC coefficients of the perturbation A p , the correlation matrix of the perturbation ⁇ p and the inverse of the correlation matrix of the useful signal ⁇ s -1 .
  • these entities are not directly available as we place our problem in a scheme where only the perturbed coefficients A y are available. Accordingly A p , ⁇ p and ⁇ s -1 need to be estimated. It results that the invention can be seen as the generic process described below:
  • the LPC A y are available.
  • This process can be applied on speech codec bitstream by applying the following steps:
  • Figure 1 shows an embodiment of a telecommunication system 1 in a signal transmission with modified LPC coefficients.
  • the sender 2 generates the useful signal s(t) by talking. Perturbations generate a perturbation signal p(t) with is added to the useful signal resulting in the signal y(t).
  • the signal y(t) is digitalized in the Analog-Digital-Converter (AD-Converter) 3 which generates a digital signal y(n).
  • the digital signal y(n) is encoded in the encoder to the signal y e (n).
  • the encoding is done with the help of an LPC analysis.
  • the encoded signal y e (n) is transmitted via the transmission block 5 to the decoder 6.
  • the decoder 6 receives the signal y e ' (n) from the transmission block and decodes y e ' (n) to a digital signal y d (n).
  • y e ' (n) is either equal or unequal to y e (n).
  • the transmission block 5 is e.g. a telephone switch, a router or a simple wire.
  • y d (n) is finally DA-converted by the DA-converter to y a (t) which is received as an analog signal by the receiver 8.
  • the modification of the LPC parameters is done in the transmission block 5, whereas in the embodiment of Figure 4 , the encoder 4 directly modifies the LPC parameters.
  • FIG. 2 is a flow chart for the modification of LPC coefficients within the transmission block 5.
  • y e (n) is a bitstream including LPC coefficients. If the encoder uses the AMR codec, the LPC coefficients are transmitted as Line Spectral Pair (LSP). The frames of y e (n) also comprise the parameters pitch delay, fixed codebook index, fixed gain and adaptive gain. The bitstream is computed by the analysis of successive frames, each, each comprising a defined number of samples (thoughy 160). If the signal y e (t) is sampled at a frequency of 8 MHz, in the so-called narrow band, the number of LPC coefficients is chosen to 8 or 10 in current standardized codecs (AMR, EFR, FR). In other words, the codec uses 8th respectively a 10th order linear prediction filter. In Eq. (1) k runs from 1 to 9 respectively from 1 to 11.
  • the sampling frequency is 16 kHz and the number of coefficients is preferably chosen to 16 in current standardized codecs (AMR-WB).
  • the Figure 2 shows the flow chart where the LPC coefficients are extracted from the bitstream y e (n).
  • the bitstream is divided in the LPC coefficients and the rest of the bitstream, including the information needed to decode the residual waveform. Then the estimations of A p , ⁇ p and ⁇ s -1 are applied, taking into account the LPC coefficient as well as eventually additive information from the bitstream.
  • a p is generated by the help of a Voice Activity Detection (VAD).
  • VAD Voice Activity Detection
  • the output of the VAD generates zero if no voice signal is detected in the bitsteam, else the VAD outputs a one.
  • the bitstream of the encoded signal has to be decoded to make the estimation of ⁇ p , ⁇ s .
  • the estimation of this matrices and vectors can also be done on the basis of the codec parameters of the signal y e (n) by interpreting the fixed gain and the adaptive gain.
  • the clean LPC coefficients A s are generated by one of the equations 21 or 22. It should be noticed that the calculated clean LCP A s are an estimation of a LPC of the useful signal s(n). Accordingly, the calculated LPC A s are as good as the estimations for A s , ⁇ p , ⁇ s are.
  • the filter on the LPC A y coefficients is applied to get the clean LPC A s and finally the LPC are replaced in the bitstream by changing each frame by the use of the clean LPC parameters A s .
  • the frames are modified sequentially and sent to the decoder as signals y e '(n).
  • This method of improving the speech signal quality can be done anywhere in the path between the encoder and decoder.
  • the method can be applied in the terminal of the sender, in the terminal of the receiver or in one of the routers telephone switches or gateways between different networks.
  • Figure 3 shows a comparison of transfer functions with non-modified LPC versus modified LPC coefficients.
  • the synthesis LPC filter function can be described by the filter transfer function H(f) in the frequency domain.
  • the graph of Fig. 3 shows a functions H(f) dependent on the frequency f for a non-noisy LPC function and, with the dashed line, for a noisy LPC filter.
  • the transfer function of the noisy LPC filter in our case a non-modified LPC, has more energy but is smoother.
  • Using a LPC that was generated on the basis of a noisy signal worsens the quality of the speech.
  • the modification of the LPC to a clean LPC make it easier for the receiver to understand the received speech and enhance the clarity of the speech.
  • the flow chart of Figure 2 may be extended by an additional step which reduces noise on the rest bitstream. This noise reduction is performed after the estimation of A p , ⁇ p and ⁇ s -1 and before the generation the new frames of the bitstream of the signal.
  • One examplary noise reduction technique for the rest bitstream is the method for reducing noise on the codec parameters pitch gain and codebook gain described in the above-mentioned "Compressed Domain Noise Reduction and Echo Suppression for Network Speech".
  • Figure 4 shows a second embodiment of the modification of LPC coeffients.
  • the function is included in the encoder 4.
  • the LPC coefficient are computed by an analysis of successive weighted frames.
  • the Levinson-Durbin algorithm permits to get the LPC coefficient from the sample y(n) of the analysis frame.
  • Our method maybe placed as a postfilter of the computation blocks of the LPC analysis. In this scenario, it enhances the LPC coefficient by reducing the influence of the noise.
  • the needed estimations ( A p , ⁇ p and ⁇ s -1 ) may be done by using the LPC coefficients but also some additive information of sample y(n) as depicted in Fig 4 .
  • the filter of Eq (20)/(21) is applied on the perturbed coefficients to get the enhanced ones.
  • the method of improving the speech quality is performed within the encoder.
  • the encoder receives the samples from the A/D-converter. The samples are organized as frames. After windowing a frame, the LPC analysis outputs the LCP coefficients A y .
  • the parameters A p , ⁇ p and ⁇ s -1 are estimated like one of the embodiments described above.
  • LPC coefficients A s are calculated by one of the equations (21) and (22). The encoding of the frame is done with A s .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

A method is provided for transmitting a digital signal y(n), y(n) comprising a useful signal s(n) and a perturbation signal p(n). The method comprises the steps of: - receiving the Linear Prediction Coefficients (LPC) A y of the signal y e (n), y e (n) being an LPC-encoded signal of y(n). - estimating the autocorrelation matrix “ s of the useful signal s(n), of the autocorrelation matrix “ p of the perturbation signal p(n) and the LPC A p of the perturbation signal p(n); - calculating a modified LPC A s by using A y and the estimated “ s , “ p , A p ; - outputting a modified data stream y e '(n) including the modified LPC A s .

Description

  • The invention relates to disturbance reduction in digital signal processing.
  • In telecommunication devices, sound pick-up has to deal with two problems: The presence of noise in the environment where the devices are and the echo phenomenon due to the coupling between the loudspeaker and the microphone. These phenomenon decrease the quality of the communication: On one hand, the speech signal of the user is corrupted by the environmental noise which leads to tiredness for the far-end speaker and in case of too loud noise to misunderstanding between the correspondents. The echo phenomenon is also really perturbing for the far-end speaker as he can hear his own voice due to the coupling. If the transmission delay of the communication network is important (more than 30 ms), he has the really bad feeling of hearing his own voice delayed. Current mobile networks and their delay of more than 150 ms make this echo phenomenon annoying (previously, fixed telephony network provided low delay for local calls and the echo phenomenon was disturbing only for international communications).
  • These two drawbacks are inherent to phone communication. In case of handset or headset, their effects on the far-end speaker are a little bit smoothed by the fact that the speech of the user is generally more energetic than the two perturbations (noise and echo). Nevertheless, in certain conditions (in stations, on the street), the surrounding noise can really disturb the far-end speaker. The echo can also appear in small recent devices, or in headsets. In both cases the coupling exists and the echo can be energetic enough to be disturbing.
    The hands-free systems present the worse case considering noise and echo problems. Indeed, in this case the microphone is far from the talker so that the speech signal is less energetic and the perturbation gains importance. Moreover, the loudspeaker signal is also louder than in non-hands-free use cases so that the coupling between the two transducers (microphone/loudspeaker) increases.
  • Digital telecommunication systems include speech coding. Speech codecs are definitely perturbed by the presence of noise and echo. Indeed, they are optimized to handle single speech signals.
  • There exists a lot of codecs, and many of them are using Linear Prediction Coefficients (LPC) analysis. For example, CELP codecs as AMR, EFR, MELP, TCX or vocoders use such an analysis. The generic principle of the LPC analysis is to provide a linear estimation of the input speech signal y(n) through an AR filter as follow: y ^ n = - k = 1 P a y k . y n - k
    Figure imgb0001
  • Where └ay (k)┘ stand for the Linear Prediction Coefficients and P stands for the prediction order. After filtering the input signal by the LPC filter, a residual signal is obtained. This signal needs to be transmitted for reconstruction of the original signal to the decoder.
  • Noise reduction and echo cancellation are historically built as pre-processing before coding the speech. Many solutions reducing the perturbations on PCM signals are available. A state of the art overview can be found in "Combined Noise and Echo Reduction in Hands-Free systems: A Survey" by R. Le Bouquin Jeannès, P. Scalart, G. Faucon, C. Beaugeant; IEEE Trans. On Speech and Audio Processing; vol.9; Nov 2001; pp 808-820. Such solutions are efficient when the PCM data is available, so typically if the problem are solved within the terminal itself, before the encoding of the signal.
  • Within the communication chain, it may happen that only the coded signal is available. This is the case in any part of the network where only the codec bitstream is available. It may also be the case in terminal where an integrated chipset encodes the microphone signal and only delivers a bitstream to the processor where noise reduction or echo cancellation can be implemented.
  • In such scenarios, classical solutions can only be applied by decoding the signal, processing it and re-encoding. This leads to a suboptimal solution compared to any solution that would be based on the processing of the PCM signal. Indeed, decoding and re-encoding lead to high computation load, moreover, the so-called tandem effect due to decoding-re-encoding decreases the quality of the speech signal. Accordingly, the enhancement obtained by noise reduction and echo cancellation may be compensated by the artefacts introduced by the tandem effect.
  • More recently, the idea appeared to modify the codec parameter "fixed gain" in A-CELP coding to decrease of the signal energy when perturbation is detected. This is shown in
    • "Compressed Domain Noise Reduction and Echo Suppression for Network Speech" by Chandran, Ravi and Marchok, Daniel J.; Enhancement, Proc.of the 43rd IEEE Midwest Symposium on Circuits and Systems, pp 10-13, 2000,
    • "Noise reduction on speech codec parameters" by Hervé Taddei, Christophe Beaugeant, Michael de Meuleneire; ICASSP 2004
    • and "Gain Loss Control based on Speech Codec Parameters" by C. Beaugeant, N. Duetsch, H. Taddei; Eusipco 2004.
  • Such techniques allow an efficient decrease of the perturbation energy but can not reduce all the artefacts present on the speech.
  • It is an object of the invention to provide a method for reducing noise on encoded digital signals being encoded with Linear Prediction Coefficients (LPC).
  • This object is solved by the subject-matter of the independent claims. Further enhancements are provided by the subject-matter of the dependent claims.
  • A method is provided for transmission of a digital signal y(n). The digital signal y(n) comprises a useful signal s(n) and a perturbation signal p(n). The perturbation signal p(n) derives e.g. from noise or echo and includes everything of y(n) that is not part of the useful signal s(n).
  • The bitstream ye(n) is derived from y(n) by LPC-encoding. As a first step, the Linear Prediction Coefficients (LPC) A y of a bitstream ye(n) are received. Other parameters of the bitstream ye(n) may also be received, like the fixed gain or the adaptive gain of the bitstream ye(n). As an option, the complete bitstream ye(n) is received. The autocorrelation matrix Γ s of the useful signal s(n), of the autocorrelation matrix Γ p , of the perturbation signal p(n) and the LPC A p of the perturbation signal p(n) are estimated.
  • A modified LPC A s is calculated. It is calculated from A y and the estimated Γ s , Γ p , A p . In an output step, a modified data stream ye'(n) including the modified LPC A s is output. This data stream can be received by a decoder which decodes the original signal y(n).
  • Codecs for transmission of speech are optimized for speech signals. The addition of noise or of echo to the useful speech signal leads to sub-optimal behaviour of the codecs, which means additive artefacts on the decoded signal and lower quality. The use of LPC coefficients that are influenced by the noise signal makes the quality of the received speech worse. Accordingly, noise and echo are not only adding undesired information to the useful signal, they also lead to sub-optimal behaviour of speech codecs, decreasing all the quality of telecommunication.
  • Our solution is based on this innovative principle to modify directly the parameter computed by the speech encoders. Compared to prior art solutions, it proposes to modify the LPC coefficients. The received speech sounds more precise if the LPC coefficients are less influenced by noise.
  • A s is preferably calculated by A s = Γ s -1 [(Γ s + Γ p ) · A y - Γ p · A p ]. This equation only comprises multiplication and addition functions and is accordingly adapted for digital signal processors. A s also can be calculated by the equivalent equation A s = A y + Γ s -1 p [A y - A p ].
  • If also the residual signal of the encoded signal ye(n) is received, the steps of estimating Γ s , Γ p , A p can be based on the residual signal of ye(n) and A y . The residual signal is the signal that is obtained after the LPC filtering. ye(n) comprises of the residual signal and the LPC coefficients. The estimations of Γ s , Γ p , A p can be done by classical methods, e.g. by frequency analysis of the encoded signal ye(n).
  • In an embodiment, the method also comprises a step of a noise reduction on the residual signal of the encoded signal ye(n). This gives the additional advantage that the noise is reduced in the output data stream ye'(n). A noise reduction technique on residual signals is described in the above-mentioned "Compressed Domain Noise Reduction and Echo Suppression for Network Speech". The invention described here provides a solution to achieve a reduction of perturbation, like noise and echo, by modifying the LPC coefficients computed during LPC analysis.
  • In another embodiment, the Linear Prediction Cofficients (LPC) A y of the signal ye(n) are not received, but calculated from the digital sample signal y(n). The encoding and modifying the LPC coefficients is done only once. Therefore, the residual signal does not need to be encoded and output twice. This improves the speed for encoding and modifying the LPC.
  • Even if the embodiments of the invention will be described in respect to speech signals, the invention may be used with any system based on model of Eq (1) where additive perturbation disturbed the coefficients └ay (k)┘. The method is applicable in a broad range of applications in signal processing. One possible application where the LPC modification would be useful is earthquake detection.
  • But, the method is especially qualified for signal transmission in telecommunication. Because the different signal characteristics of voice and noise signals, the autocorrelation matrix of the perturbation signal can be estimated relatively precisely. This ensures that the cleaning of the LPC parameters is made successful.
  • The invention also relates to a digital signal transmission apparatus that performs the inventive method. Such an apparatus comprises means for receiving the LPC coefficients A y , for the estimation of Γ s , Γ p , A p , for the calculation and output of A p .
  • Especially, the calculation of A s is preferable done by a digital signal processor (DSP) because a DSP is effective in performing multiplications and additions.
  • The invention deals with a method to reconstruct the LPC coefficient A s = [as (k)] T of the useful signal s(n) knowing the LPC coefficients A y=[ay (k)] T computed on a perturbed signal y(n). It is based on the following mathematical development of the LPC analysis.
  • We consider that a corrupted signal y(n) is the sum of a useful signal s(n) with a perturbation p(n). This perturbation can be additive noise, echo or more generally any signal that is not desired: y n = s n + p n
    Figure imgb0002
  • We assume that the perturbation and the useful signal are not correlated.
  • We also assume that an LPC analysis of order P is applied on analysis frames of N samples (this is the case for speech codecs based on LPC), so that the signal y(n) is estimated by (n) as: y ^ n = - k = 1 P a y k . y n - k
    Figure imgb0003
  • In the same way, the useful signal s(n) is modeled as: s ^ n = - k = 1 P a s k . s n - k
    Figure imgb0004

    and, an estimation (n) of p(n) can be written with: p ^ n = - k = 1 P a p k . p n - k
    Figure imgb0005
  • Let's consider the following squared error E ST = n = 0 N - 1 y n + k = 1 P a y k y n - k 2
    Figure imgb0006
  • Using the fact that the signal y(n) can be written as the sum of the useful signal and of the perturbation, we can write: E ST = n = 0 N - 1 s n + p n + k = 1 P a y k s n - k + p n - k 2
    Figure imgb0007

    The error EST is minimum with respect to the LPC coefficients A y when its derivative with respect to each coefficient is zero: j , E ST a j j = 0
    Figure imgb0008
  • It leads to E ST = n = 0 N - 1 s n + p n + k = 1 P a y k s n - k + p n - k . s n - j + p n - j = 0
    Figure imgb0009
  • This can be written equivalently n = 0 N - 1 s n s n - j + p n p n - j + s n p n - j + p n s n - j + n = 0 N - 1 k = 1 P a y k s n - k s n - j + p n - k p n - j + s n - k p n - j + p n - k s n - j = 0
    Figure imgb0010
  • With the hypothesis that the perturbation signal and the useful signal are not correlated, we assume that we can write n = 0 N - 1 s n p n - j + p n s n - j + n = 0 N - 1 k = 1 P a y k s n - k p n - j + p n - k s n - j 0
    Figure imgb0011
  • As a result equation Eq (10) is reduced to: n = 0 N - 1 s n s n - j + p n p n - j = - n = 0 N - 1 k = 1 P a y k s n - k s n - j + p n - k p n - j
    Figure imgb0012
  • Assuming that the estimation (n) from Eq (4) is close to the signal s(n) (s(n)ŝ(n)) we can write: n = 0 N - 1 s n s n - j = - n = 0 N - 1 k = 1 P a s k s n - k s n - j = - k = 1 P a s n = 0 P s n - k s n - j
    Figure imgb0013
  • In the same way, we can write: n = 0 N - 1 p n p n - j = - n = 0 N - 1 k = 1 P a p k p n - k p n - j = - k = 1 P a p n = 0 P p n - k p n - j
    Figure imgb0014
  • As a result Eq (11) leads to: - k = 1 P a s k n = 0 N - 1 s n - k s n - j - k = 1 P a p k n = 0 N - 1 p n - k p n - j = n = 0 N - 1 k = 1 P a y k s n - k s n - j + p n - k p n - j
    Figure imgb0015
  • Let's introduce the covariance functions of the useful signal s(n) and of the perturbation p(n) r u i - j = n = 0 N - 1 u n - i u n - j , u = s , p , y
    Figure imgb0016

    as well as the autocorrelation matrix of s(n) , p(n) and y(n) Γ u = r u i - j 1 i , j P , u = s , p , y
    Figure imgb0017
  • For e.g. P=4, Γ u can be written as Γ u = r u 1 r u 2 r u 3 r u 4 r u 2 r u 1 r u 2 r u 3 r u 3 r u 2 r u 1 r u 2 r u 4 r u 3 r u 2 r u 1
    Figure imgb0018
  • Let's also introduce the LPC coefficients vector of the different signals considered ( s(n) p(n) and y(n)) : A u = a u k T k = 1 , , P , u = s , p , y
    Figure imgb0019
  • Where T stands for the transposition operator.
    With the new notation introduced Eq (14) becomes: - Γ s A s - Γ p A p = - Γ s + Γ p A y
    Figure imgb0020
  • As a result the LPC coefficients of the useful signal can be obtained through: A s = Γ s - 1 . Γ s + Γ p A y - Γ p A p
    Figure imgb0021
  • Or equivalently: A s = A y + Γ s - 1 . Γ p A y - A p
    Figure imgb0022
  • The two last expressions show that the computation of the useful signal LPC is obtained when the following entities are known: the LPC of the perturbed signal (A y ), the LPC of the perturbation (A p ), the covariance matrix of the perturbation (Γ p ), and the inverse of the covariance matrix of the useful signal (Γ s ). One can see the formula as a filter of the perturbed LPC A y to obtain the useful LPC A s , this filter depending on A p , Γp and Γ s .
  • Accordingly, the present invention proposes a method based on formula Eq. (20)-(21) or on any formula derived from this equation to obtain the LPC coefficients of the useful signal (A s ), when the LPC coefficients of the perturbed signal (A y ) are available. Eq. (20)/(21) require to know the LPC coefficients of the perturbation A p , the correlation matrix of the perturbation Γ p and the inverse of the correlation matrix of the useful signal Γ s -1. Generally, these entities are not directly available as we place our problem in a scheme where only the perturbed coefficients A y are available. Accordingly A p , Γ p and Γ s -1 need to be estimated. It results that the invention can be seen as the generic process described below:
  • For each frame m, the LPC A y are available.
    • Estimation of the LPC of the perturbation A p based on the LPC A y . As an alternative, if more entities than A y are available the estimation can be based on the additive information. For instance, when placing the method within a speech codec, other speech codec parameters can be used to obtain the estimation.
    • Estimation of the correlation matrix of the perturbation Γ p based on the LPC A y . As an alternative, if more entities than A y are available the estimation can be based on the additive information. For instance, when placing the method within a speech codec, other speech codec parameters can be used to obtain the estimation.
    • Estimation of the correlation matrix of the useful signal Γ s based on the LPC A y . As an alternative, if more entities than A y are available the estimation can be based on the additive information. For instance, when placing the method within a speech codec, other speech codec parameters can be used to obtain the estimation.
    Applying the filter defined in Eq (20)/(21) to get A s .
  • This process can be applied on speech codec bitstream by applying the following steps:
    • For each frame m, extracting the LPC coefficients A y from the speech codec bitstream.
    • Applying the processed as described previously to get the useful signal LPC A s .
    • Exchanging the coefficients A y with the useful one A s
  • The solution has following advantages:
    • The method makes it possible to obtain clean LPC coefficients when knowing perturbed ones. Any system based on linear prediction, computing coefficients A y can use this solution to obtain the clean coefficients A s
    • A typical application of the method is processing noise reduction, echo reduction or reduction of any other perturbation on the LPC on speech.
    • When PCM samples are not available, but only codec parameters, the methods permits to re-construct the useful LPC parameters without the need to decode the bitstream to get the PCM data and apply classical noise reduction or echo cancellation. This is an alternative solution to existing prior art solutions.
    • In the LPC analysis step (speech encoding), such method can be applied in parallel to the LPC analysis. It can be seen as a kind of postfilter after the LPC analysis.
    • The mathematical expression obtained in Equation (21) is relatively easy to implement. It requires of course estimations of certain entities like cross-correlation functions or LPC or the noisy signal, but such estimations are quite classical. The method is accordingly quite classical from a signal processing point of view, and possible to implement in real time applications.
  • The invention is demonstrated with help of the drawings.
    • Figure 1 shows a signal transmission from a sender to a receiver in a telecommunication system.
    • Figure 2 is a flow chart for the modification of LPC coefficients according to a first embodiment.
    • Figure 3 shows a comparison of transfer function with non-modified LPC versus modified LPC coefficients.
    • Figure 4 shows a second embodiment for the modification of LPC coefficients.
  • Figure 1 shows an embodiment of a telecommunication system 1 in a signal transmission with modified LPC coefficients. The sender 2 generates the useful signal s(t) by talking. Perturbations generate a perturbation signal p(t) with is added to the useful signal resulting in the signal y(t). The signal y(t) is digitalized in the Analog-Digital-Converter (AD-Converter) 3 which generates a digital signal y(n). The digital signal y(n) is encoded in the encoder to the signal ye(n).
  • The encoding is done with the help of an LPC analysis. The encoded signal ye(n) is transmitted via the transmission block 5 to the decoder 6. The decoder 6 receives the signal ye' (n) from the transmission block and decodes ye' (n) to a digital signal yd(n). Depending on how the transmission block 5 is implemented, ye' (n) is either equal or unequal to ye(n). The transmission block 5 is e.g. a telephone switch, a router or a simple wire.
  • yd(n) is finally DA-converted by the DA-converter to ya(t) which is received as an analog signal by the receiver 8.
  • In the embodiment of Figure 2, the modification of the LPC parameters is done in the transmission block 5, whereas in the embodiment of Figure 4, the encoder 4 directly modifies the LPC parameters.
  • Figure 2 is a flow chart for the modification of LPC coefficients within the transmission block 5. ye(n) is a bitstream including LPC coefficients. If the encoder uses the AMR codec, the LPC coefficients are transmitted as Line Spectral Pair (LSP). The frames of ye(n) also comprise the parameters pitch delay, fixed codebook index, fixed gain and adaptive gain. The bitstream is computed by the analysis of successive frames, each, each comprising a defined number of samples (generelly 160). If the signal ye(t) is sampled at a frequency of 8 MHz, in the so-called narrow band, the number of LPC coefficients is chosen to 8 or 10 in current standardized codecs (AMR, EFR, FR). In other words, the codec uses 8th respectively a 10th order linear prediction filter. In Eq. (1) k runs from 1 to 9 respectively from 1 to 11.
  • In the case of the so-called wide band, the sampling frequency is 16 kHz and the number of coefficients is preferably chosen to 16 in current standardized codecs (AMR-WB).
  • The Figure 2 shows the flow chart where the LPC coefficients are extracted from the bitstream ye(n). The bitstream is divided in the LPC coefficients and the rest of the bitstream, including the information needed to decode the residual waveform. Then the estimations of A p , Γ p and Γ s -1 are applied, taking into account the LPC coefficient as well as eventually additive information from the bitstream.
  • In an embodiment, A p is generated by the help of a Voice Activity Detection (VAD). Voice Activity Detection is known in the art. Here, the output of the VAD generates zero if no voice signal is detected in the bitsteam, else the VAD outputs a one. A p (m) is calculated by the following algorithm, whereby m is the index of the frame or subframe.
    if VAD = 0, A p m = α A y m + 1 - α A p m - 1
    Figure imgb0023

    if VAD = 1, A p m = A p m - 1
    Figure imgb0024

    α is a fixed parameter being heuristically chosen, whereby 0<α<1.
  • To estimate Γ p , the perturbation is assumed to be white noise. Accordingly, the autocorrelation matrix Γ p has the following form: Γ p = E p m 0 0 0 0 E p m 0 0 0 0 E p m 0 0 0 0 E p m
    Figure imgb0025
  • Depending on the output of VAD, Ep(m) is calculated by the equations
    if VAD = 0, E p m = β E y m + 1 - β E p m - 1
    Figure imgb0026

    if VAD = 1, E p m = E p m - 1 ,
    Figure imgb0027

    wherein by Ey (m) is the energy of the signal y(n), m indicates a frame or subframe and β is a fixed parameter being heuristically chosen, 0<β<1.
  • In this embodiment, Γ s is estimated by the equation: Γ s = Γ y - Γ p .
    Figure imgb0028

    Γ y may be calculated with the help of Eq. 15 if the data stream is decoded.
  • In this embodiment, the bitstream of the encoded signal has to be decoded to make the estimation of Γ p , Γ s.
    Alternatively, the estimation of this matrices and vectors can also be done on the basis of the codec parameters of the signal ye(n) by interpreting the fixed gain and the adaptive gain.
  • After the estimation of A s , Γ p , Γ s , the clean LPC coefficients A s are generated by one of the equations 21 or 22. It should be noticed that the calculated clean LCP A s are an estimation of a LPC of the useful signal s(n). Accordingly, the calculated LPC A s are as good as the estimations for A s , Γ p , Γ s are.
  • The filter on the LPC A y coefficients is applied to get the clean LPC A s and finally the LPC are replaced in the bitstream by changing each frame by the use of the clean LPC parameters A s . The frames are modified sequentially and sent to the decoder as signals ye'(n).
  • This method of improving the speech signal quality can be done anywhere in the path between the encoder and decoder. For example, in telecommunication systems, the method can be applied in the terminal of the sender, in the terminal of the receiver or in one of the routers telephone switches or gateways between different networks.
  • The use of the modified LPC coefficients improves the quality of the received signal which is demonstrated with the help of Figure 3.
  • Figure 3 shows a comparison of transfer functions with non-modified LPC versus modified LPC coefficients. The synthesis LPC filter function can be described by the filter transfer function H(f) in the frequency domain. The graph of Fig. 3 shows a functions H(f) dependent on the frequency f for a non-noisy LPC function and, with the dashed line, for a noisy LPC filter. The transfer function of the noisy LPC filter, in our case a non-modified LPC, has more energy but is smoother. Using a LPC that was generated on the basis of a noisy signal worsens the quality of the speech. Hence, the modification of the LPC to a clean LPC make it easier for the receiver to understand the received speech and enhance the clarity of the speech.
  • If only the LPC's are modified, the received speech still includes noise. Therefore, as an option, the flow chart of Figure 2 may be extended by an additional step which reduces noise on the rest bitstream. This noise reduction is performed after the estimation of A p , Γ p and Γ s -1 and before the generation the new frames of the bitstream of the signal.
  • One examplary noise reduction technique for the rest bitstream is the method for reducing noise on the codec parameters pitch gain and codebook gain described in the above-mentioned "Compressed Domain Noise Reduction and Echo Suppression for Network Speech".
  • Figure 4 shows a second embodiment of the modification of LPC coeffients. In this case, the function is included in the encoder 4.
  • In speech encoding, like typically AMR, AMR-WB, G723, G729, the LPC coefficient are computed by an analysis of successive weighted frames. Typically, the Levinson-Durbin algorithm permits to get the LPC coefficient from the sample y(n) of the analysis frame. Our method maybe placed as a postfilter of the computation blocks of the LPC analysis. In this scenario, it enhances the LPC coefficient by reducing the influence of the noise. The needed estimations (A p , Γ p and Γ s -1) may be done by using the LPC coefficients but also some additive information of sample y(n) as depicted in Fig 4. Finally, the filter of Eq (20)/(21) is applied on the perturbed coefficients to get the enhanced ones.
  • In the embodiment of Figure 4, the method of improving the speech quality is performed within the encoder. The encoder receives the samples from the A/D-converter. The samples are organized as frames. After windowing a frame, the LPC analysis outputs the LCP coefficients A y . The parameters A p , Γ p and Γ s -1 are estimated like one of the embodiments described above. LPC coefficients A s are calculated by one of the equations (21) and (22). The encoding of the frame is done with A s .
  • Reference number list
  • 1
    telecommunication system
    2
    sender
    3
    A/D-converter
    4
    encoder
    5
    transmission block
    6
    decoder
    7
    D/A-converter
    8
    receiver

Claims (9)

  1. Method for transmitting a digital signal y(n), y(n) comprising a useful signal s(n) and a perturbation signal p(n), the method comprising the steps of:
    - receiving the Linear Prediction Coefficients (LPC) A y of a bitstream ye(n), ye(n) being an LPC-encoded signal of y(n);
    - estimating the autocorrelation matrix Γ s of the useful signal s(n), of the autocorrelation matrix Γ p of the perturbation signal p(n) and the LPC A p of the perturbation signal p(n);
    - calculating a modified LPC A s by using A y and the estimated Γ s , Γ p , A p ;
    - outputting a modified data stream ye'(n) including the modified LPC A s .
  2. Method according to claim 1,
    wherein A s is calculated by A s = Γ s -1 .[(Γ s p A y-Γ p· A p ].
  3. Method according to claim 1, further comprising the step:
    - receiving the residual signal of the encoded signal ye(n)
    and wherein in the step of
    - estimating Γ s , Γ p , A y
    the estimated values for at least one of the parameters Γ s , Γ p , A y are calculated from the residual signal of ye(n).
  4. Method according to one of the preceding claims, further comprising the steps:
    - performing a noise reduction on the residual signal of the encoded signal ye(n).
  5. Method according to one or the claims 1 to 4,
    in which instead of
    - receiving the Linear Prediction Coefficients (LPC) A y of the signal ye(n),
    the method comprises the steps of
    - receiving the digital signal y(n) and
    - calculating Linear Prediction Coefficients (LPC) A y by encoding the signal y(n).
  6. Method according to one of the preceding claims
    characterized in that
    the method is performed in a telecommunication system.
  7. Digital signal transmission apparatus
    which performs a method according to one of the claims one to 6.
  8. Digital signal transmission apparatus according to claim 7, comprising a Digital Signal Processor (DSP).
  9. Digital signal transmission apparatus according to claim 7 being a telecommunication terminal.
EP07000716A 2007-01-15 2007-01-15 Disturbance reduction in digital signal processing Withdrawn EP1944761A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP07000716A EP1944761A1 (en) 2007-01-15 2007-01-15 Disturbance reduction in digital signal processing
PCT/EP2007/063598 WO2008086920A1 (en) 2007-01-15 2007-12-10 Disturbance reduction in digital signal processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP07000716A EP1944761A1 (en) 2007-01-15 2007-01-15 Disturbance reduction in digital signal processing

Publications (1)

Publication Number Publication Date
EP1944761A1 true EP1944761A1 (en) 2008-07-16

Family

ID=38007980

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07000716A Withdrawn EP1944761A1 (en) 2007-01-15 2007-01-15 Disturbance reduction in digital signal processing

Country Status (2)

Country Link
EP (1) EP1944761A1 (en)
WO (1) WO2008086920A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017050972A1 (en) * 2015-09-25 2017-03-30 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Encoder and method for encoding an audio signal with reduced background noise using linear predictive coding

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SG10202005270YA (en) 2010-07-02 2020-07-29 Dolby Int Ab Selective bass post filter

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002054744A1 (en) * 2000-12-29 2002-07-11 Nokia Corporation Audio signal quality enhancement in a digital network
WO2002080149A1 (en) * 2001-03-30 2002-10-10 Telefonaktiebolaget Lm Ericsson Noise suppression

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002054744A1 (en) * 2000-12-29 2002-07-11 Nokia Corporation Audio signal quality enhancement in a digital network
WO2002080149A1 (en) * 2001-03-30 2002-10-10 Telefonaktiebolaget Lm Ericsson Noise suppression

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CHANDRAN R ET AL: "Compressed domain noise reduction and echo suppression for network speech enhancement", CIRCUITS AND SYSTEMS, 2000. PROCEEDINGS OF THE 43RD IEEE MIDWEST SYMPOSIUM ON AUGUST 8-11, 2000, PISCATAWAY, NJ, USA,IEEE, vol. 1, 8 August 2000 (2000-08-08), pages 10 - 13, XP010558066, ISBN: 0-7803-6475-9 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017050972A1 (en) * 2015-09-25 2017-03-30 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Encoder and method for encoding an audio signal with reduced background noise using linear predictive coding
KR20180054823A (en) * 2015-09-25 2018-05-24 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. Encoder and method for encoding an audio signal having reduced background noise using linear predictive coding
CN108352166A (en) * 2015-09-25 2018-07-31 弗劳恩霍夫应用研究促进协会 The encoder and method that audio signal is encoded in a manner of so that ambient noise is reduced using linear predictive coding
US10692510B2 (en) 2015-09-25 2020-06-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Encoder and method for encoding an audio signal with reduced background noise using linear predictive coding
CN108352166B (en) * 2015-09-25 2022-10-28 弗劳恩霍夫应用研究促进协会 Encoder and method for encoding an audio signal using linear predictive coding

Also Published As

Publication number Publication date
WO2008086920A1 (en) 2008-07-24

Similar Documents

Publication Publication Date Title
US7539615B2 (en) Audio signal quality enhancement in a digital network
JP4512574B2 (en) Method, recording medium, and apparatus for voice enhancement by gain limitation based on voice activity
EP0993670B1 (en) Method and apparatus for speech enhancement in a speech communication system
US10692510B2 (en) Encoder and method for encoding an audio signal with reduced background noise using linear predictive coding
US6694018B1 (en) Echo canceling apparatus and method, and voice reproducing apparatus
MX2013009344A (en) Apparatus and method for processing a decoded audio signal in a spectral domain.
US20110054889A1 (en) Enhancing Receiver Intelligibility in Voice Communication Devices
EP0899718B1 (en) Nonlinear filter for noise suppression in linear prediction speech processing devices
JP2010503325A (en) Packet-based echo cancellation and suppression
US20030065507A1 (en) Network unit and a method for modifying a digital signal in the coded domain
US6718036B1 (en) Linear predictive coding based acoustic echo cancellation
EP2608200B1 (en) Estimation of speech energy based on code excited linear prediction (CELP) parameters extracted from a partially-decoded CELP-encoded bit stream
EP1944761A1 (en) Disturbance reduction in digital signal processing
JP2018511086A (en) Audio encoder and method for encoding an audio signal
EP1521241A1 (en) Transmission of speech coding parameters with echo cancellation
EP1521240A1 (en) Speech coding method applying echo cancellation by modifying the codebook gain
Manikandan Speech enhancement based on wavelet denoising
GB2343822A (en) Using LSP to alter frequency characteristics of speech
Beaugeant et al. Gain loss control based on speech codec parameters
Virette et al. Analysis of background noise reduction techniques for robust speech coding
Fapi et al. Noise reduction within network through modification of LPC parameters
EP1521243A1 (en) Speech coding method applying noise reduction by modifying the codebook gain
EP1521242A1 (en) Speech coding method applying noise reduction by modifying the codebook gain
Kulakcherla Non linear adaptive filters for echo cancellation of speech coded signals
Gnaba et al. Combined acoustic echo canceller for the GSM network

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

AKX Designation fees paid
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20090117

REG Reference to a national code

Ref country code: DE

Ref legal event code: 8566