KR20210063931A - The electronic device performing wireless communication and the method for wireless communication - Google Patents

Abstract

An objective of the present invention is to provide a user with transmission sound quality with reduced or removed echoes or noise. According to one embodiment of the present invention, the electronic device comprises a communication circuit transmitting and receiving sound signals to and from an external device by a first communication method, a memory, and a processor. The processor checks whether a first noise reduction and echo cancellation (NREC) technology is applied by the external device, transmits a first sound signal to the external device, receives a second sound signal corresponding to the first sound signal from the external device, checks a remaining echo amount or a remaining noise amount for the second sound signal if the first NREC technology is applied by the external device, compares the remaining echo amount or the remaining noise amount with a preset reference value, and can apply a second NREC technology based on the comparison. Various other embodiments identified through the specification are possible.

Description

The electronic device performing wireless communication and the method for wireless communication

Various embodiments disclosed in this document relate to an electronic device that transmits and receives a call signal to and from an external device through wireless communication using Bluetooth communication.

An electronic device such as a smartphone or a tablet PC may perform various functions through wireless communication. Recently, with the development of wireless communication technology, a low-cost, low-power wireless device or technology using a wireless link is being developed. Bluetooth (Bluetooth) is a representative short-distance communication method that enables voice and data communication between terminals at low cost and low power.

The Bluetooth earphone (or earphone, headset) may be paired with a mobile electronic device such as a smart phone or a tablet PC through Bluetooth communication. The user may make a hands-free call using the earphone, and may hear a sound output when a music file or a video file stored in the mobile electronic device is executed.

In the Bluetooth earphone, ambient noise may be introduced into the call signal through the microphone during a call. In addition, various noise components such as noise transmitted through the counterpart electronic device or noise generated by the Bluetooth earphone or the electronic device itself may be included in the call signal.

In Bluetooth earphones, the distance between the microphone and the receiver is usually very close, so the sound output from the receiver is often delivered to the microphone. A phenomenon in which the sound output from the receiver is transmitted to the microphone is called an echo phenomenon, and the electronic device may reduce or eliminate the occurrence of the echo through various technologies.

When a conventional electronic device (eg, a smartphone, a tablet PC) is paired with a Bluetooth device (eg, an earphone) to transmit and receive an acoustic signal for a call, noise reduction and echo cancellation (NREC) technology is applied to reduce noise or echo. can be reduced or eliminated.

When the Bluetooth device itself applies the NREC technology, the electronic device may not apply the NREC technology. In this case, if residual echo is generated even after the application of the NREC technology in the Bluetooth device, the sound quality may deteriorate, which may cause inconvenience to the user.

The electronic device includes a communication circuit, a memory, and a processor for transmitting and receiving a sound signal to and from an external device by a first communication method, wherein the processor checks whether a first noise reduction and echo cancellation (NREC) technology is applied in the external device and transmits a first acoustic signal to the external device, receives a second acoustic signal corresponding to the first acoustic signal from the external device, and applies the first NREC technology in the external device. The residual echo amount or the residual noise amount for the sound signal may be checked, the residual echo amount or the residual noise amount may be compared with a preset reference value, and the second NREC technique may be applied based on the comparison.

The electronic device according to various embodiments disclosed in this document may determine whether the NREC technology is applied in the Bluetooth device and determine whether to apply the NREC technology by checking the echo residual amount or the noise residual amount. In this way, it is possible to provide the user with the sound quality of a conversation in which echo or noise is reduced or removed.

The electronic device according to various embodiments disclosed in this document may provide a test sound source, measure a residual echo amount, and apply NREC technology.

1 illustrates a first electronic device and a second electronic device according to various embodiments of the present disclosure.
2 is a block diagram of a first electronic device according to various embodiments of the present disclosure;
3 is a flowchart illustrating a wireless communication method according to various embodiments.
4 is a signal flow diagram illustrating a process of checking a residual echo value according to various embodiments of the present disclosure;
5 is a graph illustrating a process of canceling an echo from a second sound signal according to various embodiments of the present disclosure;
6 is an electronic device in a network environment, according to various embodiments.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar elements.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings. However, this is not intended to limit the techniques described in this document to specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of this document. . In connection with the description of the drawings, similar reference numerals may be used for similar elements.

1 illustrates a first electronic device and a second electronic device according to various embodiments of the present disclosure; In FIG. 1 , the case where the first electronic device 101 is a smart phone and the second electronic device 102 is an earphone is exemplarily illustrated, but the present invention is not limited thereto.

Referring to FIG. 1 , the first electronic device 101 may include a main body 111 and a display 112 . Various components necessary for the operation of the first electronic device 101 such as a processor, a memory, a communication module, a printed circuit board, or a battery may be included in the main body 111 . The display 112 may display various content such as text or images.

According to various embodiments, the first electronic device (or terminal device) 101 may be paired with the second electronic device 102 using Bluetooth communication. The Bluetooth communication method uses an ISM (Industrial Scientific Medical) band of the 2.4 GHz band. The ISM band can be used freely without a separate license, and the Bluetooth communication method can prevent interference with other devices by placing a guard band of a 2MHz band below the ISM band and a 3.5MHz band above the ISM band.

According to an embodiment, the first electronic device 101 may broadcast an inquiry signal and receive a device address from the second electronic device 102 in response to the inquiry signal. The first electronic device 101 may request the second electronic device 102 to transmit the device name. When receiving the request for transmission of the device name, the second electronic device 102 may transmit the device name to the first electronic device 101 . The first electronic device 101 may receive a device name from the second electronic device 102 and be connected to the second electronic device 102 automatically or through a user input.

The second electronic device 102 may transmit/receive a sound signal to and from the first electronic device 101 through Bluetooth communication. The second electronic device 102 may include a receiver (or a sound output unit, a speaker) 121 that outputs a sound and a microphone 122 that receives a sound. The second electronic device 102 may receive the sound signal from the first electronic device 101 and output it through the receiver 121 . The second electronic device 102 may transmit the acoustic signal collected through the microphone 122 to the first electronic device 101 . In FIG. 1 , the case in which the second electronic device 102 is in the form of an ear set is illustrated as an example, but is not limited thereto. For example, the second electronic device 102 may be a headset or an earphone.

According to various embodiments, the second electronic device 102 may be small, and accordingly, the distance between the receiver 121 and the microphone 122 may be relatively close. In this case, an echo phenomenon in which the sound output to the receiver 121 is transmitted to the microphone 122 may occur.

According to an embodiment, the second electronic device 102, separately from the first electronic device 101 , a noise reduction and echo cancellation (NREC) (or echo cancellation and noise reduction (ECNR)) technology (or an NREC solution) , NREC algorithm) can be applied to reduce or eliminate noise or echo (hereinafter, the first NREC technique). In the case of the second electronic device 102 (eg, a Bluetooth device) supporting the first NREC technology, optimization cannot be performed only for a specific type of the first electronic device 101 (eg, a portable terminal). Performance may not be optimized. In the second electronic device 102 (eg, a Bluetooth device) having poor NREC performance, an issue of deterioration of sound quality due to echo or the like may occur. In this case, a separate NREC may be further performed through the first electronic device 101 .

According to another embodiment, the second electronic device 102 may not perform separate NREC. For example, the second electronic device 102 may not include a circuit for performing NREC.

According to various embodiments, the processor inside the first electronic device 101 determines whether the second electronic device 102 applies the first NREC technology or the residual echo amount of the acoustic signal received by the second electronic device 102 . can be analyzed to apply a separate NREC technology (hereinafter, a second NREC technology) in various ways (refer to FIGS. 2 to 5 ).

2 is a block diagram of a first electronic device according to various embodiments of the present disclosure;

Referring to FIG. 2 , the first electronic device 101 may include a wireless communication unit 210 , a Bluetooth module unit 220 , a memory 230 , a display 240 , an input unit 250 , and a processor 260 . have. 2 illustrates a partial configuration included in the first electronic device 101, but is not limited thereto.

The wireless communication unit 210 may perform a data transmission/reception function for wireless communication of the first electronic device 101 . The wireless communication unit 210 may include an RF transmitter for up-converting and amplifying a frequency of a transmitted signal, and an RF receiver for low-noise amplifying a received signal and down-converting the frequency. For example, the wireless communication unit 210 may perform long-distance communication such as 5G or LTE.

The wireless communication unit 210 may receive data through a wireless channel and provide it to the processor 260 , and transmit the data provided from the processor 260 to an external device (eg, the second electronic device 102 ) through a wireless channel. have.

The Bluetooth module unit (or Bluetooth communication circuit) 220 may wirelessly transmit/receive sound and data signals to/from a device capable of Bluetooth communication (eg, the second electronic device 102 of FIG. 1 ). The Bluetooth module 220 may transmit a signal received from a device capable of Bluetooth communication to the processor 260 . The Bluetooth module unit 220 may transmit an acoustic signal provided from the processor 260 to a device capable of Bluetooth communication.

According to various embodiments, the Bluetooth module unit 220 provides device identification information (eg, a device address (Bluetooth Device Address-BD_ADDR), a user friendly name), and device type information (device class) of peripheral devices). may be received and transmitted to the processor 260 .

When paired with the second electronic device 102 , the Bluetooth module unit 220 may perform wireless communication with a communication circuit of the second electronic device 102 . The Bluetooth module unit 220 may transmit, to the second electronic device 102 , a sound signal of the other party device (far-end) received by the first electronic device 101 from the wireless communication unit 210 . According to an embodiment, the Bluetooth module unit 220 may transmit an acoustic signal (eg, a test sound source for echo measurement) provided by the processor 260 to the second electronic device 102 .

The Bluetooth module unit 220 may receive an acoustic signal input through the microphone 122 of the second electronic device 102 and transmit it to the processor 260 .

According to various embodiments, the Bluetooth module unit 220 may receive sound processing information (eg, AT command) regarding whether the second electronic device 102 performs the first NREC technology. The Bluetooth module 220 may transmit sound processing information to the processor 260 .

The memory 230 serves to store programs and data necessary for the operation of the first electronic device 101 , and may be divided into a program area and a data area. The memory 230 may store device information regarding a second electronic device (eg, a Bluetooth earphone) that has been paired.

For example, when the first electronic device 101 performs pairing with a specific Bluetooth earphone, the memory 230 may store a device address, a device name, and a link key of the Bluetooth earphone. A link key may be a key used for authentication and encryption to securely pair Bluetooth devices. For example, the link key is generated by a Bluetooth device address, a private user key, and a RAND value, which is an irregular number newly generated whenever a new connection between Bluetooth devices is established.

The display 240 may be formed of a liquid crystal display (LCD), and may visually provide various information to a user. For example, the display 240 may output a booting screen, a standby screen, a display screen, a call screen, or other application execution screen.

When the processor 260 controls the Bluetooth module 220 to broadcast an inquiry signal to search for Bluetooth devices located nearby, the display 240 displays a list of Bluetooth devices found under the control of the processor 260. can The display 240 may display device information of each Bluetooth device.

The input unit 250 may receive a user's input signal for controlling the first electronic device 101 and transmit it to the processor 260 . The input unit 250 may receive an input for selecting one of Bluetooth devices located nearby.

The processor 260 may perform various operations necessary for the operation of the first electronic device 101 . The processor 260 may control a signal flow between various components inside the first electronic device 101 .

According to various embodiments, the processor 260 analyzes whether the second electronic device 102 performs the first NREC technique or the residual echo amount or residual noise amount of the acoustic signal received by the second electronic device 102 . Thus, the second NREC technology can be applied in various ways. The processor 260 may perform a second NREC technique to remove noise and echo collected from the microphone 122 of the second electronic device 102 (eg, a Bluetooth device) for a call. If the second NREC technique is performed without reflecting the residual echo amount or the residual noise amount, NREC may be applied twice in duplicate, which may cause a problem in that communication quality deteriorates. The processor 260 may perform the second NREC technique by reflecting the residual echo amount or the residual noise amount to prevent deterioration of the sound quality of the transmission. The processor 260 may receive information on whether the first NREC technique is performed in the second electronic device 102 and determine whether to perform the second NREC technique.

According to various embodiments, when performing the second NREC technology, the processor 260 may determine the application level (or application level) of the second NREC technology according to the residual echo amount or the residual noise amount. When the residual echo amount or the residual noise amount is large, the application level of the second NREC technology may be increased, and if the residual echo amount or the residual noise amount is small, the application level of the second NREC technology may be decreased.

As for the performance of the first NREC technique performed by the second electronic device 102 , noise or echo cancellation performance may not be effective according to device characteristics. When the amount of residual echo in the acoustic signal received from the second electronic device 102 is equal to or greater than (or exceeds) the reference value, the processor 260 controls the residual echo or residual noise included in the acoustic signal received from the second electronic device 102 . By performing the second NREC technique for additionally removing , the voice quality can be improved.

According to various embodiments, the Bluetooth module unit 220 may include a voice section recognition unit (eg, a voice activity detection (VAD) circuit). The processor 260 may use a voice section recognition unit (eg, a VAD circuit) to classify a voice section and a noise section, and determine the amount of residual noise in the noise section.

3 is a flowchart illustrating a wireless communication method according to various embodiments.

Referring to FIG. 3 , in operation 310 , the processor 260 of the first electronic device 101 may be in a pairing state capable of Bluetooth communication with the second electronic device 102 . The processor 260 may be wirelessly connected to the communication circuit of the second electronic device 102 through the Bluetooth module unit 220 to transmit/receive data.

In operation 320 , the processor 260 may check whether the first NREC technology is applied in the second electronic device 102 . According to an embodiment, the processor 260 may receive a signal (or sound processing information) (eg, AT command) of a specified format from the second electronic device 102 to determine whether the first NREC technology is applied. .

According to various embodiments, when the first NREC technology is applied in the second electronic device 102 , the processor 260 may not perform a separate second NREC technology.

According to various embodiments, in operation 330 , when the first NREC technology is not applied in the second electronic device 102 , the second NREC technology may be applied in the first electronic device 101 .

In operation 340 , the processor 260 may transmit a first acoustic signal for echo measurement of the second electronic device 102 to the second electronic device 102 .

According to an embodiment, the first sound signal may be a test sound source for measuring the amount of echo of the second electronic device 102 . For example, when the first electronic device 101 receives a call for a call connection from the outside and the user inputs an input to connect the call, the processor 260 outputs the test sound source “Call connected.” 2 may be transmitted to the electronic device 102 .

According to another embodiment, the first acoustic signal may be a sign language signal (eg, a counterpart's voice) received from a far-end device after a call is connected. After the call is connected, the processor 260 may analyze the residual echo amount or the residual noise amount in real time to determine whether to apply the second NREC technology or a level at which the second NREC technology is applied.

According to another embodiment, the first acoustic signal may be a signal according to a previously connected first call. When the second call is connected, the processor 260 may apply information on the residual echo amount or residual noise amount analyzed in the previous first call to the currently connected second call. Even when the received calls are different, the echo generation characteristics of the second electronic device 102 may be the same or similar.

In operation 350 , the processor 260 may receive a second sound signal corresponding to the first sound signal from the second electronic device 102 . A sound based on the first sound signal is output through the receiver 121 of the second electronic device 102 , and the output sound becomes an echo sound and is introduced into the microphone 122 of the second electronic device 102 to make the second An acoustic signal may be generated. The second electronic device 102 may transmit a second acoustic signal to the first electronic device 101 .

When the first NREC technology is applied, the second acoustic signal may be in a state in which noise or echo is partially removed to a specified level. Conversely, when the first NREC technology is not applied, the second acoustic signal may be in a state in which noise or echo is not removed.

In operation 360 , the processor 260 may check a residual echo amount or a residual noise amount of the second acoustic signal. For example, the processor 260 may check a root mean square (RMS) value of an echo or noise after the second NREC technique is applied.

According to various embodiments, the processor 260 uses a voice section recognition unit (eg, a VAD circuit) included in the Bluetooth module unit 220 to classify a voice section and a noise section, and the amount of residual noise in the noise section can be decided

In operation 370 , the processor 260 may compare the residual echo amount or the residual noise amount with a preset reference value, and apply the second NREC technique based on the comparison. For example, when the residual echo amount is equal to or greater than (or exceeds) a preset reference value, the processor 260 may apply the second NREC technology.

According to various embodiments, the processor 260 may cancel an echo by comparing a signal received from a counterpart electronic device (far-end) with a root mean square (RMS) value for a non-echo portion.

4 is a signal flow diagram illustrating a process of checking a residual echo value according to various embodiments of the present disclosure;

Referring to FIG. 4 , in operation 410 , the processor 260 of the first electronic device 101 may transmit a first acoustic signal to the second electronic device 102 . For example, the first sound signal may be a test sound source for measuring the amount of echo or the amount of noise of the second electronic device 102 .

In operation 420 , a sound based on the first sound signal is output through the receiver 121 of the second electronic device 102 , and the output sound becomes an echo sound and is transmitted to the microphone 122 of the second electronic device 102 . The second acoustic signal may be generated. When the second electronic device 102 includes a circuit for performing the first NREC technology, the first NREC technology may be applied.

In operation 430 , the Bluetooth module unit 220 of the first electronic device 101 may receive a second sound signal from the second electronic device 102 . When the first NREC technology is applied, the second acoustic signal may be in a state in which noise or echo is partially removed to a specified level (a level set in the second electronic device 102 ). As for the performance of the first NREC technique performed by the second electronic device 102 , noise or echo cancellation performance may not be effective according to device characteristics.

In operation 440 , the processor 260 of the first electronic device 101 may analyze a residual echo amount or a residual noise amount of the received second acoustic signal. When the residual echo amount or the residual noise amount is equal to or greater than (or exceeds) a preset reference value, the processor 260 may perform an additional echo or noise cancellation operation by applying the second NREC technology. The processor 260 may additionally remove a portion of the first sound signal from the second sound signal.

According to various embodiments, the processor 260 may apply the second NREC technology by using a third sound signal collected through a microphone (not shown) provided in the first electronic device 101 . The processor 260 may compensate the near-end speech included in the third acoustic signal for the near-end speech portion of the second acoustic signal. Also, the processor 260 may additionally remove a stationary noise part included in the third sound signal from the second sound signal.

According to various embodiments, the processor 260 may display a user interface through which the user can selectively determine the level at which the second NREC technology is applied. For example, the processor 260 may display a user interface including a move bar that determines a level of applying the second NREC technique or a selectable option for any removal result.

According to various embodiments, the processor 260 may adaptively apply a cancellation intensity, an Rx volume, and the like, in order to efficiently perform echo cancellation. For example, when the echo residual amount is -70 dB or less based on the average root mean square (RMS), the second NREC technique is not applied, and when it exceeds the average root mean square (RMS), the second NREC technique may be applied.

According to various embodiments, the processor 260 determines the parameter optimal value information for applying the second NREC technology in the first call through the currently received call, and when connected to the second call by receiving an additional call, the memory Call quality may be optimized by loading parameters previously stored in 230 .

According to various embodiments, the processor 260 may apply the second NREC technology by using an external server. When the performance of the first NREC technology is lower than the reference value in the call connection through the currently paired second electronic device 102 , the processor 260 transmits noise information along with the BT id information of the second electronic device 102 to the external server. can convey An external server may store the received information. The processor 260 may download the stored information when the corresponding user or another user performs BT pairing and call setup. The processor 260 may optimize call quality by applying the improvement parameter from the beginning of the pairing step or the call setting step.

According to various embodiments, the processor 260 may apply the second NREC technology using machine learning using an external server. When a call is connected through the paired second electronic device 102 , the processor 260 stores the BT id information and the noise information of the second electronic device 102 in the memory 230 of the first electronic device 101 or the cloud server. (Cloud server) can be saved. The cloud server can derive NREC optimization parameters by analyzing continuously updated noise information based on DNN (Deep Neural Network). The derived optimization parameter may store information for each BT id in the memory 230 of the first electronic device 101 or a cloud server. When the user proceeds with BT pairing and call setting, quality optimization may be performed by applying optimized NREC parameter information for each BT id. Since optimization parameters are analyzed based on DNN, more information can be accumulated as the user uses more, so that more accurate NREC parameters can be derived.

According to various embodiments, when the microphone of the first electronic device 101 itself reaches an abnormal situation outside the scope of Bluetooth communication, and the NREC performance of the first electronic device 101 is deteriorated, the echo residual amount is reduced. The analysis method can further improve NREC performance.

5 is a graph illustrating a process of removing an echo from a second acoustic signal according to various embodiments of the present disclosure; 5 is illustrative and not limited thereto.

Referring to FIG. 5 , in the first graph 501 , the second sound signal may include a sign-in section 510 and a speech section 520 . In the sign language section 510 , a sound based on the first sound signal is output through the receiver 121 of the second electronic device 102 , and the output sound becomes an echo sound, and the microphone ( 122) to generate a second acoustic signal.

In the second graph 502 , the first NREC technology may be applied by the second electronic device 102 to the second acoustic signal introduced into the microphone 122 of the second electronic device 102 . In the sign language section 510 , the overall amount of echo may be reduced compared to that of the first graph 501 , but the second sound signal may include some residual echoes. As for the performance of the first NREC technology performed by the second electronic device 102 , noise or echo cancellation performance may be inferior to that of the second NREC technology of the first electronic device 101 depending on device characteristics. A residual echo may be included in the second acoustic signal.

In the third graph 503 , the processor 260 of the first electronic device 101 may analyze a residual echo amount of the received second acoustic signal. When the residual echo amount is equal to or greater than (or exceeds) a preset reference value, the processor 260 may perform an additional echo cancellation operation by applying the second NREC technology. In the sign language section 510 , the amount of echo may be greatly reduced compared to that of the first graph 501 or the second graph 502 , and call quality may be improved.

6 is a block diagram of an electronic device 601 in a network environment 600 according to various embodiments of the present disclosure. Electronic devices according to various embodiments disclosed in this document may be devices of various types. Electronic devices include, for example, portable communication devices (eg, smartphones), computer devices (eg, personal digital assistants), tablet PCs (tablet PCs), laptop PCs (desktop PCs, workstations, or servers); It may include at least one of a portable multimedia device (eg, an e-book reader or an MP3 player), a portable medical device (eg, a heart rate, blood sugar, blood pressure, or body temperature monitor), a camera, or a wearable device. (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs)); : skin pad or tattoo), or a bioimplantable circuit.In some embodiments, the electronic device is, for example, a television, a digital video disk (DVD) player, an audio device, an audio accessory device. (e.g. speaker, headphones, or headset), refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air purifier, set-top box, home automation control panel, security control panel, game console, electronic dictionary, electronic key, camcorder , or at least one of an electronic picture frame.

In another embodiment, the electronic device may include a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR) (eg, a black box for a vehicle/vessel/airplane), and an automotive infotainment device. (e.g. head-up displays for vehicles), industrial or domestic robots, drones, automated teller machines (ATMs), point of sales (POS) devices, metering instruments (e.g. water, electricity, or gas metering instruments); Alternatively, it may include at least one of an IoT device (eg, a light bulb, a sprinkler device, a fire alarm, a thermostat, or a street lamp). The electronic device according to the embodiment of this document is not limited to the above-described devices, and, for example, as in the case of a smartphone equipped with a function of measuring personal biometric information (eg, heart rate or blood sugar), a plurality of electronic devices The functions of the devices may be provided in a complex manner. In this document, the term user may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

In the network environment 600 , the electronic device 601 communicates with the electronic device 602 through a first network 698 (eg, a short-range wireless communication network), or a second network 699 (eg, a long-range wireless communication network). network) and communicate with the electronic device 604 or the server 608 . According to an embodiment, the electronic device 601 may communicate with the electronic device 604 through the server 608 . According to an embodiment, the electronic device 601 includes a processor 620 , a memory 630 , an input device 650 , a sound output device 655 , a display device 660 , an audio module 670 , and a sensor module ( 676 , interface 677 , haptic module 679 , camera module 680 , power management module 688 , battery 689 , communication module 690 , subscriber identification module 696 , or antenna module 697 . ) may be included. In some embodiments, at least one of these components (eg, the display device 660 or the camera module 680 ) may be omitted or one or more other components may be added to the electronic device 601 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 676 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 660 (eg, a display).

The processor 620, for example, executes software (eg, a program 640) to execute at least one other component (eg, a hardware or software component) of the electronic device 601 connected to the processor 620 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or computation, the processor 620 converts commands or data received from other components (eg, the sensor module 676 or the communication module 690) to the volatile memory 632 . may load into the volatile memory 632 , process commands or data stored in the volatile memory 632 , and store the resulting data in the non-volatile memory 634 . According to an embodiment, the processor 620 includes a main processor 621 (eg, a central processing unit or an application processor), and an auxiliary processor 623 (eg, a graphics processing unit, an image signal processor) that can be operated independently or in conjunction with the main processor 621 (eg, a graphics processing unit or an image signal processor). , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 623 may be configured to use less power than the main processor 621 or to be specialized for a designated function. The coprocessor 623 may be implemented separately from or as part of the main processor 621 .

The co-processor 623 may be, for example, on behalf of the main processor 621 while the main processor 621 is in an inactive (eg, sleep) state, or the main processor 621 is active (eg, executing an application). ), together with the main processor 621, at least one of the components of the electronic device 601 (eg, the display device 660, the sensor module 676, or the communication module 690) It is possible to control at least some of the related functions or states. According to one embodiment, the coprocessor 623 (eg, image signal processor or communication processor) may be implemented as part of another functionally related component (eg, camera module 680 or communication module 690). have.

The memory 630 may store various data used by at least one component (eg, the processor 620 or the sensor module 676 ) of the electronic device 601 . The data may include, for example, input data or output data for software (eg, the program 640 ) and instructions related thereto. The memory 630 may include a volatile memory 632 or a non-volatile memory 634 .

The program 640 may be stored as software in the memory 630 , and may include, for example, an operating system 642 , middleware 644 , or an application 646 .

The input device 650 may receive a command or data to be used in a component (eg, the processor 620 ) of the electronic device 601 from the outside (eg, a user) of the electronic device 601 . The input device 650 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 655 may output a sound signal to the outside of the electronic device 601 . The sound output device 655 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

The display device 660 may visually provide information to the outside (eg, a user) of the electronic device 601 . The display device 660 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 660 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 670 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 670 obtains a sound through the input device 650 or an external electronic device (eg, a sound output device 655 ) directly or wirelessly connected to the electronic device 601 . The electronic device 602) (eg, a speaker or headphones) may output sound.

The sensor module 676 detects an operating state (eg, power or temperature) of the electronic device 601 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 676 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 677 may support one or more designated protocols that may be used for the electronic device 601 to directly or wirelessly connect with an external electronic device (eg, the electronic device 602 ). According to an embodiment, the interface 677 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 678 may include a connector through which the electronic device 601 can be physically connected to an external electronic device (eg, the electronic device 602 ). According to an embodiment, the connection terminal 678 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 679 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 679 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 680 may capture still images and moving images. According to one embodiment, the camera module 680 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 688 may manage power supplied to the electronic device 601 . According to an embodiment, the power management module 688 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 689 may supply power to at least one component of the electronic device 601 . According to one embodiment, battery 689 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 690 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 601 and an external electronic device (eg, the electronic device 602 , the electronic device 604 , or the server 608 ). It can support establishment and communication through the established communication channel. The communication module 690 may include one or more communication processors that operate independently of the processor 620 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 690 is a wireless communication module 692 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 694 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 698 (eg, a short-range communication network such as Bluetooth, WiFi direct, or infrared data association (IrDA)) or a second network 699 (eg, a cellular network, the Internet, or It may communicate with the external electronic device 604 through a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into a single component (eg, a single chip), or may be implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 692 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 696 within a communication network, such as the first network 698 or the second network 699 . The electronic device 601 may be identified and authenticated.

The antenna module 697 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 697 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 697 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network such as the first network 698 or the second network 699 is connected from the plurality of antennas by, for example, the communication module 690 . can be selected. A signal or power may be transmitted or received between the communication module 690 and the external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 697 .

At least some of the components are connected to each other through a communication method (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI))) between peripheral devices and a signal ( E.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 601 and the external electronic device 604 through the server 608 connected to the second network 699 . Each of the external electronic devices 602 and 604 may be the same as or different from the electronic device 601 . According to an embodiment, all or part of the operations performed by the electronic device 601 may be executed by one or more of the external electronic devices 602 , 604 , or 608 . For example, when the electronic device 601 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 601 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 601 . The electronic device 601 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, or client-server computing technology may be used.

According to various embodiments, an electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ) may communicate with an external device (eg, the second electronic device of FIG. 1 ) through a first communication method. 102 or a communication circuit (eg, the Bluetooth module unit 220 of FIG. 2 or the wireless communication module 692 of FIG. 6 ) for transmitting and receiving a sound signal to and from the external electronic device 602 of FIG. 6), a memory (eg: memory 230 of FIG. 2 or memory 630 of FIG. 6 ), a processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ), and the processor (eg, the processor of FIG. 2 ). 260 or the processor 620 of FIG. 6 ) performs a first NREC technology (noise reduction and echo) in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ). cancellation) is applied, and transmits a first acoustic signal to the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ), and the external device (eg, the second electronic device 602 of FIG. 6 ) : Receive a second acoustic signal corresponding to the first acoustic signal from the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 , and the external device (eg, the second electronic device of FIG. 1 ) When the first NREC technology is applied by the device 102 or the external electronic device 602 of FIG. 6 , the residual echo amount or the residual noise amount for the second sound signal is checked, and the residual echo amount or the The residual noise amount may be compared with a preset reference value, and the second NREC technique may be applied based on the comparison.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) is the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device of FIG. 6 ) If the device 602) does not apply the first NREC technology, the second NREC technology may be applied regardless of the comparison.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) is the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device of FIG. 6 ) When the device 602) applies the first NREC technique, the second NREC technique may be applied based on the comparison.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may perform the comparison based on a root mean square (RMS) value of the second acoustic signal. have.

According to various embodiments, the first sound signal may be generated based on a test sound source generated by the electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ). .

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) transmits the first sound signal to the external device ( Example: It can transmit to the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ).

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) receives a call for a call connection from the outside and, when the call is connected, receives a sign language sound received from the outside. The first acoustic signal may be transmitted to the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ).

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may store the result according to the comparison in the memory (eg, the memory 230 of FIG. 2 or the processor 620 of FIG. 6 ). It may be stored in the memory 630). The processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) receives a call for call connection from the outside and applies the second NREC technology based on the stored result when the call is connected. can do.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may transmit a result according to the comparison to an external server. The processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) receives a call for a call connection from the outside and, when the call is connected, based on the information received from the external server, the second NREC technology can be applied.

According to various embodiments, the first communication method may include Bluetooth communication or BLE communication.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may determine the application level of the second NREC technology based on the comparison.

According to various embodiments, a wireless communication method performed by an electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ) is performed by an external device (eg, the second electronic device of FIG. 1 ). An operation of determining whether the first noise reduction and echo cancellation (NREC) technology is applied in 102 or the external electronic device 602 of FIG. 6 , the external device (eg, the second electronic device 102 of FIG. 1 ) or transmitting a first acoustic signal to the external electronic device 602 of FIG. 6 ), and the operation from the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ) An operation of receiving a second acoustic signal corresponding to the first acoustic signal, and performing the first NREC technology in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ) In the case of application, the method may include checking the residual echo amount for the second sound signal, comparing the residual echo amount with a preset reference value, and applying the second NREC technology based on the comparison. have.

According to various embodiments, the operation of applying the second NREC technology includes applying the first NREC technology in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ). When not applied, the operation of applying the second NREC technology may be included regardless of the comparison.

According to various embodiments, the operation of applying the second NREC technology includes applying the first NREC technology in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ). When applied, it may include an operation of applying the second NREC technology based on the comparison.

According to various embodiments, the comparing may include performing the comparison based on a root mean square (RMS) value of the second acoustic signal.

According to various embodiments, the first sound signal may be generated based on a test sound source generated by the electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ). .

According to various embodiments, the transmitting of the first sound signal may include transmitting the first sound signal to the external device (eg, the second electronic device 102 of FIG. 1 ) when a call for a call connection is received from the outside. Alternatively, it may include an operation of transmitting to the external electronic device 602 of FIG. 6 .

According to various embodiments, the operation of transmitting the first sound signal may include receiving a call for a call connection from the outside and, when a call is connected, convert a sign language sound received from the outside as the first sound signal to the external device (eg: transmitting to the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ).

An electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

Various embodiments of the present document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutes of the corresponding embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items unless clearly indicated otherwise in a related context. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A , B, or C" each may include any one of, or all possible combinations of, items listed together in the corresponding one of the phrases. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the component from other Order) is not limited. Some (eg, first) component is referred to as “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When mentioned, it means that any of the above components can be connected to the other components directly (eg by wire), wirelessly, or via a third component.

The term "module" used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits. The module may be an integrally configured component or a minimum unit of the component or a part thereof that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 636 or external memory 638) readable by a machine (eg, electronic device 601). may be implemented as software (eg, the program 640) including For example, a processor (eg, processor 620 ) of a device (eg, electronic device 601 ) may call at least one command among one or more commands stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here,'non-transient' only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term refers to the case where data is semi-permanently stored in the storage medium. It does not distinguish between temporary storage cases.

According to an embodiment, a method according to various embodiments disclosed in the present document may be provided by being included in a computer program product. Computer program products can be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or two user devices (e.g., compact disc read only memory (CD-ROM)). It can be distributed (e.g., downloaded or uploaded) directly between, e.g. smart phones), online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a storage medium that can be read by a device such as a server of a manufacturer, a server of an application store, or a memory of a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular number or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar to that performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be sequentially, parallel, repeatedly, or heuristically executed, or one or more of the operations may be executed in a different order or omitted. Or one or more other actions may be added.

Claims (20)

In the electronic device,
a communication circuit for transmitting and receiving a sound signal to and from an external device by a first communication method;
Memory; and
processor; including;
The processor is
Check whether the first noise reduction and echo cancellation (NREC) technology is applied in the external device,
Transmitting a first acoustic signal to the external device,
receiving a second sound signal corresponding to the first sound signal from the external device;
When the external device applies the first NREC technology, a residual echo amount or a residual noise amount for the second sound signal is checked;
comparing the residual echo amount or the residual noise amount with a preset reference value;
An electronic device that applies a second NREC technology based on the comparison. The method of claim 1, wherein the processor is
When the external device does not apply the first NREC technology, the electronic device applies the second NREC technology regardless of the comparison. The method of claim 1, wherein the processor is
When the external device applies the first NREC technology, the electronic device applies the second NREC technology based on the comparison. The method of claim 1, wherein the processor is
The electronic device performs the comparison based on a root mean square (RMS) value of the second acoustic signal. The method of claim 1, wherein the first acoustic signal is
An electronic device generated based on the test sound source generated by the electronic device. The method of claim 1, wherein the processor is
When receiving a call for a call connection from an external device, the electronic device transmits the first acoustic signal to the external device. The method of claim 1, wherein the processor is
An electronic device that receives a call for a call connection from the outside and transmits, as the first sound signal, a sign language sound received from the outside to the external device when the call is connected. The method of claim 1, wherein the processor is
An electronic device that stores a result according to the comparison in the memory. The method of claim 8, wherein the processor
An electronic device that receives a call for call connection from the outside and applies the second NREC technology based on the stored result when the call is connected. The method of claim 1, wherein the processor is
An electronic device for transmitting a result according to the comparison to an external server. 11. The method of claim 10, wherein the processor
An electronic device that applies the second NREC technology based on information received from the external server when receiving a call for call connection from the outside and a call is connected. The method of claim 1, wherein the first communication method is
An electronic device comprising Bluetooth communication or BLE communication. The method of claim 1, wherein the processor is
The electronic device determines an application level of the second NREC technology based on the comparison. A wireless communication method performed in an electronic device, the method comprising:
checking whether a first noise reduction and echo cancellation (NREC) technique is applied in an external device;
transmitting a first sound signal to the external device;
receiving a second sound signal corresponding to the first sound signal from the external device;
checking a residual echo amount with respect to the second sound signal when the first NREC technology is applied by the external device;
comparing the residual echo amount with a preset reference value; and
and applying a second NREC technique based on the comparison. The method of claim 14, wherein the applying the second NREC technology comprises:
and applying the second NREC technology regardless of the comparison when the external device does not apply the first NREC technology. The method of claim 14, wherein the applying the second NREC technology comprises:
and applying the second NREC technology based on the comparison when the external device applies the first NREC technology. The method of claim 14, wherein the comparing comprises:
and performing the comparison based on a root mean square (RMS) value of the second acoustic signal. 15. The method of claim 14, wherein the first acoustic signal is
A method of generating a test sound source generated by the electronic device. The method of claim 14, wherein the transmitting of the first sound signal comprises:
and transmitting the first sound signal to the external device when receiving a call for a call connection from the outside. The method of claim 14, wherein the transmitting of the first sound signal comprises:
Receiving a call for call connection from the outside and when the call is connected, transmitting a sign language sound received from the outside as the first sound signal to the external device.

Images