JP2016100688A - Terminal device, audio signal processing system and program for terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform specification of a virtual sound source or the like or movement of a virtual sound source or the like to a desired position with an intuitive and simple operation in an audio system containing plural speakers and an audio amplifier for supplying an audio signal to each speaker.SOLUTION: When a terminal device 10 is oriented to a predetermined position (S35), a rotational angle around a Z-axis, based on the direction of a Y-axis perpendicular to the Z-axis, and a slope angle around an axis which is perpendicular to an axis of the terminal device 10, directed from the terminal device 10 to a predetermined position and also perpendicular to the z-axis are detected by a sensor of the terminal device 10, and the rotational angle and the slope angle are output as angle information. The terminal device 10 compares position information calculated on the basis of the angle information (S37) with position information of a control target stored in a target position information storage unit, and determines that the control target is specified (S39) when the deviation between both the position information is within a predetermined range (S39).SELECTED DRAWING: Figure 6

Description

  The present invention relates to a technology for reproducing highly realistic sounds using a plurality of speakers, and more particularly, to a technology for supporting the specification and position setting of a virtual sound source or the like.

  As an example of this kind of technology, by outputting sounds of the same volume and phase from two speakers, the listener feels as if there is a virtual speaker in the position between the speakers (ie, A technique of localizing a sound image at a position between the speakers). Also, it is generally performed to give a listener a sense of sound as if a sound image is moving (a sense of sound as if a virtual sound source is moving) by applying a sound effect due to volume change or frequency change. Conventionally, this type of technology has often been used in relatively large-scale systems such as audio systems installed in movie theaters and theme parks, but in recent years it has been applied to home audio systems such as home theater systems. Are also being adopted.

JP 2009-065452 A

  However, in an audio system that enables the reproduction of sound with a high sense of presence using these multiple speakers, a technology that allows the user to specify the positions of virtual speakers and virtual sound sources through intuitive and easy-to-understand operations, and the specified virtual Conventionally, a technique for moving a speaker or a virtual sound source to a desired position by an intuitive and easy-to-understand operation has not been proposed. Also,

  The present invention has been made in view of the above problems, and it is possible to specify a virtual sound source in an audio system having a plurality of speakers or an apparatus capable of outputting a multi-channel acoustic signal, or a desired sound source such as a virtual sound source. An object is to provide a technique for realizing movement to a position by an intuitive and easy-to-understand operation.

  In order to solve the above-described problem, the terminal device of the present invention has a rotation angle around the vertical axis with respect to an axis orthogonal to the vertical axis when the terminal device is directed to a predetermined position, and orthogonal to the vertical axis. An angle information output unit that detects an inclination angle around an axis to be output and outputs the rotation angle and the inclination angle as angle information, a target position information storage unit that stores position information of a plurality of control targets, and the angle The position information calculated based on the angle information output from the information output unit is compared with the position information of the plurality of control targets stored in the target position information storage unit, and the control target is specified. A control target specifying unit.

  According to the terminal device of the present invention, when the terminal device is directed to a predetermined position, the angle information output unit causes the rotation angle around the vertical axis with respect to the axis orthogonal to the vertical axis to be orthogonal to the vertical axis. The tilt angle around the axis is output as angle information. The control target specifying unit calculates position information based on the angle information, compares the calculated position information with the position information of a plurality of control targets stored in the target position information storage unit, and specifies the control target. I do. Therefore, the user can specify the control target by performing an intuitive and easy-to-understand operation of directing the terminal device in a direction in which the sound to be specified can be heard. In the present invention, the “control target” is a concept including a speaker, a virtual speaker, a virtual sound source, and the like.

  As a more preferable aspect, after the control target is specified by the control target specifying unit, when the terminal device is directed to a desired position, the angle information output unit outputs the angle based on the angle information. A position information update unit that updates the content stored in the target position information storage unit may be provided with the position information calculated as described above as new position information of the control target. In this case, by performing an intuitive and easy-to-understand operation that directs the terminal device to the position where the specified control target is to be installed, the position information of the position is calculated, and the target position is the new position information of the specified control target. The stored contents of the position information storage unit are updated. Therefore, the specified control object can be moved to a desired installation position by an intuitive and easy-to-understand operation.

  As a more preferable aspect, after the control target is specified by the control target specifying unit, when the terminal device is directed to a desired position, based on the angle information output from the angle information output unit. It is only necessary to provide a transmission unit that transmits the position information calculated in this way as new position information of the control target to an external audio signal processing apparatus that outputs an audio signal corresponding to the control target. In this case, by performing an intuitive and easy-to-understand operation of directing the terminal device to the position where the specified control target is to be installed, the position information of the position is calculated, and as the new position information of the specified control target, It is transmitted to an external audio signal processing apparatus that outputs an audio signal corresponding to the control target. Therefore, the identified control object can be moved to a desired installation position while listening to an audio signal corresponding to the control object by an intuitive and easy-to-understand operation.

  As a more preferable aspect, the apparatus includes a distance adjustment instruction unit that instructs adjustment of the distance between the terminal device and a target position, and the position information includes a distance increased or decreased based on an instruction from the distance adjustment instruction unit, You may make it use the positional information calculated based on the said angle information output from an angle information output part. In this case, when the user operates the distance adjustment instruction unit to instruct the adjustment of the distance between the terminal device and the target position, the distance increased or decreased based on the instruction and the angle information output unit are output. Calculation of position information is calculated based on the angle information. Therefore, regardless of whether the control target is far from the terminal device or the control target close to the terminal device, the position of the control target can be accurately adjusted by an intuitive and easy-to-understand operation. Can do.

  As a further preferable aspect, when the control target is specified by the control target specifying unit, the calculated position information is compared with the position information of a plurality of control targets stored in the target position information storage unit. And a notifying unit for notifying when the positional information is within a predetermined range. In this case, since the notification unit notifies that the control target has been specified, the user can intuitively understand that the control target has been specified. In the present invention, “notification” is a concept including display of a control object on the display unit, vibration of the terminal device, pronunciation from the terminal device, and the like.

  In order to solve the above problems, an audio signal processing system of the present invention performs a predetermined process on an input signal based on position information and a terminal device, and outputs a signal of a channel corresponding to each of a plurality of speakers. An audio signal processing system having a signal processing device, wherein the terminal device has a rotation angle around the vertical axis with respect to an axis orthogonal to the vertical axis when the terminal device is directed to a predetermined position; An angle information output unit that detects an inclination angle around an axis orthogonal to the vertical axis and outputs the rotation angle and the inclination angle as angle information, and at least one target that stores position information of a plurality of control targets A position information storage unit; position information calculated based on the angle information output from the angle information output unit; and a plurality of information stored in the target position information storage unit. It compares the position information of the control target and a control target specifying unit that performs a specific control object, and wherein the.

  According to the audio signal processing system of the present invention, therefore, the user can specify the control target by performing an intuitive and easy-to-understand operation of directing the terminal device in a direction in which the desired sound can be heard. . In the present invention, the “control target” is a concept including a speaker, a virtual speaker, a virtual sound source, and the like.

According to a more preferable aspect, a reproduction control unit that emphasizes and reproduces the control target specified by the control target specifying unit may be provided. In this case, it can be intuitively known that the control target can be specified.
According to a further preferred aspect, the apparatus includes a distance adjustment instruction unit that instructs adjustment of a distance between the terminal device and a target position, and the position information is a distance that is increased or decreased based on an instruction from the distance adjustment instruction unit, A reproduction control unit that uses position information calculated based on the angle information output from the angle information output unit, and emphasizes and reproduces the control target as the difference between the position information and the target position is closer You may make it prepare. In this case, the distance can be adjusted intuitively.
The present invention can be conceptualized not only as a terminal device but also as a program for a terminal device including a processor. The program may be stored in a recording medium.

It is a figure which shows the structural example of the audio signal processing system of 1st Embodiment of this invention. It is a figure which shows an example of speaker arrangement | positioning in an audio signal processing system. It is a block diagram which shows the structural example of the audio signal processing apparatus contained in an audio signal processing system. It is a block diagram which shows the structural example of the terminal device contained in an audio signal processing system. It is a figure for demonstrating the angle information output from a terminal device. It is a flowchart which shows the whole process in a terminal device. It is a flowchart which shows the specific process of the target sound source in a terminal device. It is a flowchart which shows the position designation | designated process of the virtual sound source in a terminal device. It is a figure which shows the example of a display at the time of the reset process of a terminal device. It is a figure for demonstrating the reset direction of a terminal device. It is a figure for demonstrating the three-dimensional coordinate space used by 1st Embodiment. It is a figure which shows a speaker management table. It is a figure which shows a virtual sound source management table. It is a figure which shows the example of a display of the terminal device at the time of the start of the specific process of a target sound source. It is a figure for demonstrating the coordinate calculation process in the case of the specific process of the target sound source in 1st Embodiment. It is a figure for demonstrating the coordinate calculation process in the case of the specific process of the target sound source in 1st Embodiment. It is a figure for demonstrating the example of a coordinate calculation in the case of the specific process of the target sound source in 1st Embodiment. It is a figure for demonstrating the example of a coordinate calculation in the case of the specific process of the target sound source in 1st Embodiment. It is a figure which shows the example of a display of a terminal device when a target sound source is specified. It is a figure which shows the example of a display of a terminal device at the time of the start of the setting position designation | designated process of a virtual sound source. It is a figure for demonstrating the coordinate calculation example in the case of the position specification process of the target sound source in 1st Embodiment. It is a figure for demonstrating the coordinate calculation example in the case of the position specification process of the target sound source in 1st Embodiment. It is a figure for demonstrating the coordinate calculation example in the case of the position specification process of the target sound source in 1st Embodiment. It is a figure for demonstrating the coordinate calculation example in the case of the position specification process of the target sound source in 1st Embodiment. It is a figure which shows the virtual sound source management table after an update. It is a flowchart which shows the whole process of the terminal device in 2nd Embodiment. It is a flowchart which shows the specific process of the target sound source of the terminal device in 2nd Embodiment. It is a flowchart which shows the position designation | designated process of the virtual sound source of the terminal device in 2nd Embodiment. It is a figure which shows the example of a display of the terminal device at the time of adjusting distance. It is a figure which shows the example of a display of the terminal device at the time of adjusting distance. It is a figure for demonstrating the sound source which can be specified and position designation by adjustment of distance. It is a figure for demonstrating the three-dimensional coordinate space used by 3rd Embodiment. It is a figure for demonstrating the coordinate calculation process in 3rd Embodiment. It is a figure for demonstrating the three-dimensional coordinate space used by 3rd Embodiment. It is a figure for demonstrating the three-dimensional coordinate space used by 3rd Embodiment. It is a figure for demonstrating the three-dimensional coordinate space used by 3rd Embodiment. It is an external view of the sound reproduction apparatus which concerns on a modification. It is a block diagram of a main-body part. It is a block diagram of a sound image localization part.

<A: First Embodiment>
<A-1: Configuration of Audio Signal Processing System>
FIG. 1 shows a configuration example of an audio signal processing system according to the first embodiment. The audio signal processing system 1A includes a terminal device 10 such as a smartphone, an audio signal processing device 20, and speakers SP1 to SP9. The terminal device 10 is a communication device such as a smartphone and can communicate with the audio signal processing device 20. The form of communication may be either wireless or wired, but for example, communication is possible via a wireless LAN (Local Area Network). Further, the terminal device 10 can download an application program from a predetermined site on the Internet. Such an application program may include a program for specifying a virtual sound source and a program for specifying a set position of the virtual sound source.

  The audio signal processing device 20 is a so-called multichannel amplifier. The audio signal processing device 20 generates output audio signals OUT1 to OUT9 obtained by adding sound effects to the input audio signals IN1 to IN9, and supplies OUT1 to OUT9 to the speakers SP1 to SP9. The speakers SP1 to SP9 are connected to the audio signal processing device 20 by wire or wirelessly.

  FIG. 2 shows an arrangement example of the speakers SP1 to SP9 in the listening room of the audio signal processing system 1A. In this example, nine speakers SP1 to SP9 are arranged in the listening room, but the number of speakers is not limited to nine, and may be five or less, or ten or more. In this case, the number of input audio signals may be 5 or less, or 10 or more. In the present embodiment, for example, a left and right presence speakers are added to a 7.1 channel surround system. Note that the description of the subwoofer speaker is omitted.

  In this audio signal processing system 1A, speaker position information indicating the positions of the speakers SP1 to SP9 in the listening room is known. When the user A views the sound emitted from the speakers SP1 to SP9 at a predetermined position (hereinafter referred to as “reference position Pref”), a desired acoustic effect is obtained. In this example, the center speaker SP1 is disposed in front of the reference position Pref, the right front speaker SP2 is disposed obliquely to the right of the reference position Pref, and the right surround speaker SP3 is disposed obliquely to the right of the reference position Pref. The surround speaker SP4 is disposed obliquely to the left of the reference position Pref, and the left front speaker SP5 is disposed obliquely to the left of the reference position Pref. Further, the right front presence speaker SP6 is disposed above and obliquely forward to the right of the reference position Pref, the right rear presence speaker SP7 is disposed above and obliquely rearward to the right of the reference position Pref, and the left rear presence speaker SP8 is disposed at the reference position Pref. The left front presence speaker SP9 is disposed above and diagonally to the left of the reference position Pref.

  In the present embodiment, the audio of nine channels including a center channel, a right front channel, a left front channel, a right surround channel, a left surround channel, a right front presence channel, a left front presence channel, a right rear presence channel, and a left rear presence channel. A signal is supplied from a playback device (not shown) to the audio signal processing device 20. In the present embodiment, each of these nine channels (or any two or more mixing results of these nine channels) is converted into a virtual sound source and installed at a desired position (that is, audio converted into a virtual sound source). Setting the desired position as the localization position of the sound image corresponding to the signal) can be performed by the user through an intuitive and easy-to-understand operation.

For example, the position between the left front presence speaker SP9, the left front speaker SP5, the left surround speaker SP4, and the left rear presence speaker SP8 as a virtual sound source V1 obtained by converting the sound image R1 included in the left front presence channel into a virtual sound source (in FIG. 2, When the sound image R1 included in the left front presence channel is specified as an operation target by operating the terminal device 10, the audio signal processing device 20 is included in the left front presence channel. An audio signal for creating the sound image R1 is selected. Next, when the operation of the terminal device 10 instructs to place the sound image R1 at the position of the virtual sound source V1, the audio signal processing device 20 causes the sound image R1 included in the left front presence channel to be localized at the position. The left front presence channel audio signal is distributed to the left front presence speaker SP9, left front speaker SP5, left surround speaker SP4 and left rear presence speaker SP8. In the above description, when the terminal device 10 specifies R1, the audio signal processing device 20 selects a corresponding signal, and then the terminal device 10 instructs the change position. However, the terminal device 10 specifies R1. When the position is changed, the audio signal processing device 20 may select the corresponding signal and control the position.
Hereinafter, the audio signal processing device 20 and the terminal device 10 that clearly show the features of the present embodiment will be mainly described.

<A-2: Configuration of Audio Signal Processing Device 20>
An audio signal processing device 20 shown in FIG. 3 includes a CPU 210 that functions as a control center of the entire device, a communication interface 220 that performs communication with the outside, a memory 230 that stores programs and data and functions as a work area of the CPU 210, and a microphone. An external interface 240 that receives a signal from an external device and supplies it to the CPU 210, a reference signal generation circuit 250 that generates reference signals Sr1 to Sr9, a selection circuit 260, and m processing units U1 to Um are provided. The m processing units U1 to Um and the CPU 210, based on the speaker position information indicating the positions of the plurality of speakers SP1 to SP9 and the virtual sound source position information (coordinate information) indicating the position of the virtual sound source, input audio signal IN1. Output audio signals OUT1 to OUT9 obtained by adding sound effects to .about.IN9 are generated for each of the plurality of speakers SP1 to SP9.

  Here, the j-th processing unit Uj (j is an arbitrary natural number satisfying 1 ≦ j ≦ m) includes a virtual sound source unit 300, a frequency correction unit 310, a gain distribution unit 320, and adders 331 to 339. The other processing units U1, U2,... Uj-1, Uj + 1,... Um are configured in the same manner as the processing unit Uj.

  The virtual sound generator 300 generates a virtual sound source audio signal based on the input audio signals IN1 to IN9. In this example, since m processing units U1 to Um are provided, output audio signals OUT1 to OUT9 corresponding to m virtual sound sources can be generated. The virtual sound source generating unit 300 includes nine switches SW1 to SW9 and a mixer 301. The CPU 210 controls the virtual sound generator 300. More specifically, the CPU 210 stores a virtual sound source management table for managing m virtual sound sources in the memory 230, and controls the virtual sound source generating unit 300 with reference to the virtual sound source management table. In the virtual sound source management table, data indicating which input audio signals IN1 to IN9 should be mixed for each virtual sound source (for example, channel identifiers indicating channels to be mixed and whether to mix each channel). For example, a logical value to represent). Then, the CPU 210 refers to the virtual sound source management table and sequentially turns on the switch corresponding to the input audio signal to be mixed among the input audio signals IN1 to IN9 to capture the input audio signal to be mixed. . For example, when the input audio signals to be mixed are IN1, IN2, and IN5, first, the CPU 210 turns on the switch SW1 corresponding to the input audio signal IN1, and turns off the other switches SW2 to SW9. Next, the CPU 210 turns on the switch SW2 corresponding to the input audio signal IN2, and turns off the other switches SW1, SW3 to SW9. Next, the CPU 210 turns on the switch SW5 corresponding to the input audio signal IN5 and turns off the other switches SW1 to SW4 and SW6 to SW9.

  The frequency correction unit 310 performs frequency correction on the output signal of the virtual sound source unit 300. Specifically, under the control of the CPU 210, the frequency correction unit 310 adjusts the frequency characteristics so that the higher frequency components are attenuated as the distance increases, according to the distance from the position of the virtual sound source to the reference position Pref. to correct. This is for reproducing the acoustic characteristic that the attenuation amount of the high frequency component increases as the distance from the virtual sound source to the reference position Pref increases.

  The memory 230 stores an attenuation amount table in advance. The attenuation amount table stores data representing the relationship between the distance from the virtual sound source to the reference position Pref and the attenuation amount of each frequency component. On the other hand, the virtual sound source management table stores virtual sound source position information indicating the position of each virtual sound source. The virtual sound source position information is given in three-dimensional orthogonal coordinates with the reference position Pref as the origin. The virtual sound source position information may be represented by two-dimensional orthogonal coordinates or polar coordinates. In this example, it is assumed that the virtual sound source position information is given as coordinate information of three-dimensional orthogonal coordinates.

  The CPU 210 first reads the contents of the virtual sound source management table stored in the memory 230, calculates the distance from each virtual sound source to the reference position Pref based on the contents of the read virtual sound source management table, and second The frequency correction unit obtains the attenuation amount of each frequency according to the distance to the reference position Pref calculated with reference to the attenuation amount table, and thirdly, obtains the frequency characteristic according to the acquired attenuation amount. 310 is controlled.

  The gain distribution unit 320 distributes the output signal of the frequency correction unit 310 to the speakers SP1 to SP9 under the control of the CPU 210, and outputs a plurality of distributed audio signals Aj [1] to Aj [9]. The gain of the audio signal for each of the speakers SP1 to SP9 decreases as the distance between the speakers SP1 to SP9 and the virtual sound source increases. Thereby, it is possible to form a sound field as if sound is radiated from a place set as the position of the virtual sound source. For example, the gains of the audio signals Aj [1] to Aj [9] for the speakers SP1 to SP9 are proportional to the reciprocal of the distance between the speakers SP1 to SP9 and the virtual sound source. Alternatively, the gain may be proportional to the square or the inverse of the fourth power of the distance between the speakers SP1 to SP9 and the virtual sound source. When there are speakers SP1 to SP9 whose distance from the virtual sound source is almost zero, the gains of the audio signals Aj [1] to Aj [9] for the other speakers SP1 to SP9 are set to zero.

  The memory 230 stores, for example, a speaker management table. The speaker management table stores speaker position information indicating the position in association with the identifiers of the speakers SP1 to SP9 and information indicating the distance between the reference position Pref. The speaker position information is represented by, for example, three-dimensional orthogonal coordinates, two-dimensional orthogonal coordinates, or polar coordinates with the reference position Pref as the origin.

  The CPU 210 first refers to the virtual sound source management table and the speaker management table stored in the memory 230, calculates the distances between the speakers SP1 to SP9 and the respective virtual sound sources, and secondly calculates them. Based on the distance, the gain of the audio signal for each of the speakers SP1 to SP9 is calculated, and a control signal designating the gain is supplied to each of the processing units U1 to Um.

  The adders 331 to 339 of the processing unit Uj are the audio signals Aj [1] to Aj [9] output from the gain distribution unit 320 and the audio signal Oj-1 [1] supplied from the previous processing unit Uj-1. ] To Oj-1 [9] are added to output audio signals Oj [1] to Oj [9]. Thus, the audio signal Om [k] (k is an arbitrary natural number from 1 to 9) output from the processing unit Um is represented by Om [k] = A1 [k] + A2 [k] +... + Aj [k ] + ... + Am [k].

  The reference signal generation circuit 250 generates reference signals Sr <b> 1 to Sr <b> 9 and outputs them to the selection circuit 260 under the control of the CPU 210. The CPU 210 generates the reference signal generation circuit 250 so as to generate the reference signals Sr1 to Sr9 when measuring the distances of the plurality of speakers SP1 to SP9. Further, the CPU 210 selects the reference signals Sr1 to Sr9 when measuring the distances of the plurality of speakers SP1 to SP9, and selects the audio signals Om [1] to Om [9] when applying the acoustic effect. The selection circuit 260 is controlled to supply the output audio signals OUT1 to OUT9 obtained in this way to each of the plurality of speakers SP1 to SP9.

<A-3: Configuration of the terminal device 10>
FIG. 4 shows an example of the hardware configuration of the terminal device 10. The terminal device 10 stores a CPU 100 that functions as a control center of the entire device, a memory 110 that stores application programs and the like, and functions as a work area of the CPU 100, an operation unit 120 that allows a user to input instructions, and a display that displays operation details. Unit 130, a communication interface 140 that communicates with the outside, a gyro sensor 151, an acceleration sensor 152, an orientation sensor 153, and a vibration generation unit 160 and a sound generation unit 161.

  As shown in FIG. 5, the gyro sensor 151 includes a pitch angle (pitch), a roll angle (roll), and a yaw angle (yaw) that are rotation angles of the X axis, the Y axis, and the Z axis orthogonal to the attitude of the terminal device 10. ) Is output. From these angles, the direction in which the terminal device 10 is facing can be specified. The acceleration sensor 152 measures the component of acceleration applied to the terminal device 10 with respect to the orthogonal X axis, Y axis, and Z axis. In this case, the acceleration measured by the acceleration sensor 152 is represented by a three-dimensional vector, and the direction in which the terminal device 10 is facing can be specified based on the three-dimensional vector. The direction sensor 153 measures the direction by detecting geomagnetism, for example. With this orientation, the direction in which the terminal device 10 is facing can be specified. However, the signals output from the gyro sensor 151 and the acceleration sensor 152 are the three-axis coordinate system of the terminal device 10 and not the coordinate system fixed to the listening dream. Therefore, the directions measured by the gyro sensor 151 and the acceleration sensor 152 are relative. That is, a certain target fixed in the listening room is used as a reference, and an angle with respect to the reference is obtained as a relative direction. On the other hand, the signal output from the orientation sensor 153 is an orientation on the earth and indicates an absolute direction.

The CPU 100 measures the direction in which the terminal device 10 is directed using at least one output of the gyro sensor 151, the acceleration sensor 152, and the direction sensor 153 by executing the application program. The terminal device 10 in this example includes the gyro sensor 151, the acceleration sensor 152, and the direction sensor 153, but may include at least one of them. The gyro sensor 151 and the acceleration sensor 152 output an angle. The angle is a value relative to some standard. The reference may be any target in the listening room, but in this example, the reference is the center speaker SP1 among the plurality of speakers SP1 to SP9.
On the other hand, when the direction of the plurality of speakers SP1 to SP9 is measured using the direction sensor 153, it is not necessary to input the reference direction. This is because the direction sensor 153 outputs a value indicating an absolute direction.

  In the terminal device 10 of the present embodiment, when the program for specifying the position of the virtual sound source is activated, the terminal device 10 communicates with the audio signal processing device 20 and stores it in the memory 230 of the audio signal processing device 20. The virtual sound source management table is read and stored in the memory 110 of the terminal device 10. The virtual sound source management table stores virtual sound source position information indicating the position of each virtual sound source. The virtual sound source position information is given in three-dimensional orthogonal coordinates with the reference position Pref as the origin. Note that the virtual sound source position information may be expressed in polar coordinates. In this example, it is assumed that the virtual sound source position information is given as coordinate information of three-dimensional orthogonal coordinates.

<A-4: Operation of Audio Signal Processing System>
Next, the operation of the audio signal processing system is divided into a reset process for setting a reference angle, a specific process for specifying a virtual sound source to be moved as a target sound source, and a process for specifying the position to move the virtual sound source. I will explain. 6 to 8 show the contents of the reset process, the target sound source specifying process, and the virtual sound source position specifying process executed by the terminal device 10.

<A-4-1: Reset processing>
When specifying the virtual sound source to be moved using the terminal device 10 as the target sound source, the user first operates the operation unit (not shown) of the terminal device 10 to specify the position of the virtual sound source. Start the program. When the program is activated, the terminal device 10 communicates with the audio signal processing device 20, reads the virtual sound source management table stored in the memory 230 of the audio signal processing device 20, and stores it in the memory 110 of the terminal device 10. (S30). As shown in FIG. 9, for example, the display unit 130 of the terminal device 10 includes an image schematically showing the speaker arrangement in the two-dimensional space and a message such as “Please click the setting button toward the reset direction”. Then, the setting button B is displayed (S31). The user holds the terminal device 10 at the reference position Pref, and, as shown in FIG. 10, directs the Y axis of the terminal device 10 in a predetermined reset direction (in the present embodiment, the direction of the center speaker SP1). Press the setting button B in the state. When detecting the pressing of the setting button B (S32), the CPU 100 resets yaw to zero (S33). In this example, an angle information output unit is configured by at least one of the gyro sensor 151 and the acceleration sensor 152, and yaw as angle information is acquired by the angle information output unit. As described above, the gyro sensor 151 and the acceleration sensor 152 output an angle. The CPU 100 performs the process of resetting yaw to zero, assuming that the Y axis of the terminal device 10 is directed in the reset direction on the XY plane shown in FIG. As described above, in this embodiment, the user who specifies the target sound source of the virtual sound source and specifies the position of the virtual sound source is standing at the reference position Pref with the terminal device 10, and thus the terminal device 10. The center position and the reference position Pref substantially coincide with each other. Therefore, the position of the reference position Pref substantially coincides with the coordinate origin of the two-dimensional coordinate space. In the present embodiment, since yaw is acquired as a relative angle, the reset process as described above is necessary. However, when yaw is acquired as an absolute angle, the reset process as described above is not necessary. It is also conceivable that yaw is automatically reset by another sensor.

  In the present embodiment, an angle information output unit is configured by at least one of the gyro sensor 151 and the acceleration sensor 152, and the angle information output unit is a Z-axis based on the direction of the Y-axis orthogonal to the Z-axis that is the vertical axis. An axis (X shown in FIG. 5) that is orthogonal to the rotation angle (yaw) around the axis and the axis of the terminal device 10, which is orthogonal to the axis from the terminal device 10 toward the position of the target sound source. A tilt angle (pitch) around the axis is output as angle information.

<A-4-2: Target sound source identification process>
When the reset process is completed, the user directs the terminal device 10 in the direction of the virtual sound source to be moved and specifies the sound source through an intuitive operation. In the present embodiment, the virtual sound source to be moved is the sound of each channel, and the number thereof is nine. In the initial state, the sound of each channel is output from any one of the speakers, and the input audio signal is not mixed. That is, the center channel sound is the center speaker SP1, the right front channel sound is the right front speaker SP2, the left front channel sound is the speaker SP5, the right surround channel sound is the right surround speaker SP3, and the left surround channel sound is the left surround. Speaker SP4, right front presence channel sound is right front presence speaker SP6, left front presence channel sound is left front presence speaker SP9, right rear presence channel sound is right rear presence speaker SP7, and left rear presence channel sound is Output from the left rear presence speaker SP8. However, the present invention is not limited to this example, and a sound source obtained by mixing sounds of each channel may be used as a virtual sound source for movement.

In this embodiment, as shown in FIG. 11, the center of the terminal device 10 is the coordinate origin, the length in the X-axis direction is 2, the length in the Y-axis direction is 2, and the length in the Z-axis direction is 2. An example in which the sound of the specified channel is moved as a virtual sound source in the three-dimensional coordinate space will be described. In the present embodiment, speakers and virtual sound sources are not arranged on the ceiling surface and the bottom surface in the three-dimensional coordinate space shown in FIG.
The position information of each speaker is set by a user operation, automatic sound field measurement, or the like, or is set in advance and stored in the memory 230 as a speaker management table TBL1. FIG. 12 shows an example of the speaker management table TBL1. The speaker management table TBL1 stores position information of each speaker as X, Y, and Z coordinates. The speaker management table TBL1 also includes information indicating the distances from the reference position Pref to the speakers SP1 to SP9, but is omitted in FIG. The speaker management table TBL1 shown in FIG. 12 is an example in which each speaker is arranged in a three-dimensional coordinate space as shown in FIG. 11. For example, the position information of the right front presence speaker SP6 is (−1, 1,1).

  As described above, since the sound of each channel is output from any one speaker in the initial state, the position information of each channel in the initial state matches the position information of each speaker. In the present embodiment, the position information of each channel is stored in the memory 230 as the virtual sound source table TBL2. The virtual sound source table TBL2 is read by the terminal device 10 and stored in the memory 110 serving as a target position information storage unit of the terminal device 10. FIG. 13 shows an example of the virtual sound source table TBL2 in the initial state. As shown in FIG. 13, the position information of each channel in the initial state matches the position information of each speaker shown in FIG. The virtual sound source table TBL2 also includes a logical value indicating whether or not to mix each channel, but is omitted in FIG.

<A-4-2-1: Specific processing of target sound source in two-dimensional coordinate space>
In the present embodiment, the terminal device 10 specifies the sound of each channel having the position information as described above as the target sound source to be moved. Note that when performing the target sound source identification process, it is assumed that any audio signal including sounds of all channels is reproduced in the audio signal processing system 1A.
When the reset process described above is completed, a message such as “Please turn to the direction of the moving sound source” is displayed on the display unit 130 of the terminal device 10 as shown in FIG. 14, for example (S34). . The user turns the terminal device 10 in the direction of the sound source to be moved while listening to the reproduced sound reproduced in the audio signal processing system 1A. As an example, a case will be described in which the sound source R1 of the left front presence channel is specified as the target sound source as shown in FIG.

  After displaying the message shown in FIG. 14 on the display unit 130, the CPU 100 of the terminal device 10 starts executing the target sound source specifying process (S35). The target sound source identification process is a process executed at regular time intervals. The specific contents of the target sound source identification process are shown in FIG. As described above, the position information of each channel is represented by the coordinates in the three-dimensional coordinate space. In this embodiment, first, the coordinates in the two-dimensional coordinate space of the XY plane are obtained, and then the two-dimensional coordinate space of the YZ plane. Each channel is specified by obtaining the coordinates at. When the user directs the terminal device 10 to the direction of the sound source to be moved, the CPU 100 serving as the control target specifying unit uses only the yaw of the angle information (FIG. 7: S100), and the position information on the XY plane (X , Y) is calculated (FIG. 7: S101). The CPU 100 executes these processes at predetermined time intervals. As described above, in the present embodiment, the user who wants to specify the target sound source holds the terminal device 10 and stands at the reference position Pref, so the center position of the terminal device 10 and the reference position Pref are It almost agrees. Therefore, the position of the reference position Pref substantially coincides with the coordinate origin of the two-dimensional coordinate space.

FIG. 15 shows an operation when a sound source to be operated is specified in a two-dimensional coordinate space on a rectangle having a coordinate origin at the center of the terminal device 10, a length in the Y-axis direction of 2, and a length in the X-axis direction of 2. It is a figure for demonstrating. In this case, if the value of yaw is −45 ° to 45 °, CPU 100 as the control target specifying unit sets X to −1 to 1 and Y to 1 according to the value of yaw. If the yaw value is 45 ° to 135 °, the CPU 100 as the control target specifying unit sets Y to +1 to −1 and X to 1 according to the yaw value. If the value of yaw is −45 ° to −135 °, the CPU 100 as the control target specifying unit sets Y to +1 to −1 and sets X to −1 according to the value of yaw. Then, the CPU 100 as the control target specifying unit sets the value of X to 1 to 0 according to the value of yaw and sets Y = −1 if the value of yaw is 135 ° to 180, and the value of yaw Is −135 ° to −180 °, X is set to −1 to 0 according to the value of yaw, and Y is set to −1. That is, the angle information is converted into coordinates (X, Y) on the boundary of the two-dimensional coordinate space on the rectangle shown in FIG.
For example, as shown in FIG. 17, when the user points the terminal device 10 toward the left front presence channel, the coordinates of the sound source to be specified by the user updated at predetermined time intervals are approximately (−1. , 1).

<A-4-2-2: Target sound source identification processing in three-dimensional coordinate space>
When setting the virtual sound source position and the speaker position in a three-dimensional coordinate space having a predetermined width with the center of the terminal device 10 as the coordinate origin, the pitch is used (FIG. 7: S100), and the coordinates in the height direction are used. Z may be obtained (FIG. 7: S101). The order of obtaining the coordinates of each axis may be any order. FIG. 16 is a rectangle on which the center of the terminal device 10 is the origin of coordinates, the length in the Z-axis direction is 2, and the length in the Y-axis direction is 2 as well. It is a figure for demonstrating operation | movement when pinpointing a target sound source in a two-dimensional coordinate space. Specifically, if the value of pitch is −45 ° to 45 °, Z is set to −1 to 1 according to the value of pitch, and if the value of pitch is smaller than −45 °, Z is set to −1. If the value of pitch is greater than 45 °, Z may be set to +1. According to such an aspect, the angle information is converted into coordinates (X, Y, Z) on the side surface of the cubic three-dimensional coordinate space shown in FIG.
For example, as shown in FIG. 17, when the user points the terminal device 10 toward the left front presence channel, the coordinates of the sound source to be specified by the user are (1, 1) on the YZ plane. Therefore, the coordinates in the three-dimensional coordinate space are approximately (−1, 1, 1) together with the coordinates (−1, 1) on the XY plane.

  Next, the CPU 100 obtains the coordinates of the direction in which the user points the terminal device 10 every predetermined time as described above, and compares the coordinates with the channel position information stored in the virtual sound source table TBL2 stored in the memory 110, A process of specifying which channel the sound source to be moved by the user is performed (FIG. 7: S102). Specifically, the CPU 100 determines whether the difference between the coordinates obtained as described above and the coordinates stored as the position information in the virtual sound source table TBL2 is equal to or less than a predetermined value at predetermined time intervals. The channel to which the sound source to be moved is specified. If it can be specified, for example, information for identifying the specified target sound source is output as the output of the target sound source specifying process in step S35. If it cannot be specified, for example, information indicating that it has not been specified is output as the output of the target sound source specifying process in step S35. As described above, in the present embodiment, the calculation of the position of the destination of the terminal device and the identification of the target sound source are executed every predetermined time.

  After starting the target sound source identification processing in step S35, it is confirmed whether or not the target sound source has been identified (S38). In the present embodiment, as an example, the process of step S38 is repeated until the target sound source can be specified. That is, when similar or approximate coordinates do not exist in the virtual sound source table TBL2 and cannot be specified (S38: NO), for example, a message such as “Please turn to the direction of the sound source to be moved” is displayed. The display unit 130 continues to display the target sound source. However, if it cannot be specified even after a certain period of time has elapsed, the processing may be terminated due to a timeout or the processing may be cancelled.

  When the CPU 100 confirms that the target sound source can be specified (S38: YES), the CPU 100 stops the target sound source specifying process in step S35, and, for example, as shown in FIG. A message such as “Is it?” And the YES button C and NO button D are displayed on the display unit 130 of the terminal device 10 (S39). Further, if the identification can be made, the terminal device 10 may be vibrated in real time by the vibration generating unit 160, or the sound may be output from the speaker of the sound generating unit 161 of the terminal device 10 in real time. Further, when there are a plurality of candidates that can be specified as the target sound source, the plurality of candidates may be displayed on the display unit 130 of the terminal device 10. Further, if the identification message can be identified, the confirmation message button in step S39 may not be displayed, but only the identified channel name may be displayed, and the identification process of the target sound source may be continued simply by storing the identified channel.

  As described above, the CPU 100 as the control target specifying unit outputs the yaw output from the angle information output unit configured by at least one of the gyro sensor 151 and the acceleration sensor 152 when the terminal device 10 is directed to the target sound source. The position information (coordinates) is calculated based on the angle information including the pitch, and the calculated position information is compared with the position information of each channel in the virtual sound source table TBL2 stored in the memory 110 as the target position information storage unit. If the position information shift is within a predetermined range, the corresponding channel as the operation target sound source is presented (displayed) to prompt the user to determine the operation target.

  That is, when the user presses the NO button in the display state shown in FIG. 19 (S40: NO), the target sound source specifying process is restarted from the beginning. However, when the user presses the YES button C in the display state shown in FIG. 19 (S40: YES), the CPU 100, for example, as shown in FIG. The message and the movement button E are displayed on the display unit 130 of the terminal device 10 (S41).

<A-4-3: Specification of virtual sound source installation position>
Next, when the CPU 100 detects that the user has pressed the movement button E shown in FIG. 20 (S42: YES), it starts the virtual sound source installation position designation process (S43). FIG. 8 shows specific contents of the virtual sound source installation position designation process. The virtual sound source installation position designation process is a process executed at predetermined time intervals. In this case, the CPU 100 that detects that the movement button E is pressed functions as a setting position instruction unit. The CPU 100 also functions as a position information update unit. In the virtual sound source installation position designation process, as in the target sound source specifying process, the yaw of the angle information is used, and the two-dimensional coordinates on the XY plane are used. The coordinates in the space are obtained using the pitch in the two-dimensional coordinate space of the YZ plane, and the coordinates in the three-dimensional coordinate space of the installation position of the virtual sound source are obtained (FIG. 8: S200). Then, the CPU 100 sends, to the audio signal processing device 20, virtual sound source information including information for identifying a virtual sound source that is currently controlled, for example, a channel name and position information including the calculated coordinates, at predetermined time intervals. Transmit (FIG. 8: S201). Further, the CPU 100 updates the virtual sound source management table stored in the memory 110 (FIG. 8: S202).

  When receiving the virtual sound source information, the CPU 210 of the audio signal processing device 20 updates the virtual sound source management table TBL2, and calculates the input audio signal by gain distribution when the virtual sound source is placed in the middle of setting at a predetermined time interval. , Output audio signal. While pressing the move button E, the user directs the terminal device 10 to a position where the virtual sound source is to be moved, confirms the sound image position in the middle of setting, moves the target sound source to the desired position, and presses the move button E at the desired position. When released (S46: YES), the virtual sound source installation position designation process is completed. For example, as shown in FIGS. 21 and 23, while the user presses the move button E, the terminal device 10 is pointed at a position V1 between the left front presence speaker SP9 and the left rear presence speaker SP8, and the move button E is released. In this case, since the value of yaw is −74 °, X is set to −1. As for Y, as shown in FIG.

(Equation 1)
y = tan16 ° ≈0.29
It becomes. Therefore, the coordinates on the XY plane of the virtual sound source are (−1, 0.29).

Also, the coordinate Z in the height direction is obtained using the pitch. As shown in FIG.
If the pitch value is 27 °,

(Equation 2)
z = tan 27 ° ≈0.51
It becomes. Therefore, since the coordinates on the XZ plane of the virtual sound source are (−1, 0.51), the coordinates of the three-dimensional coordinate space are combined with the coordinates (−1, 0.29) obtained on the XY plane. The coordinates are approximately (-1, 0.29, 0.51).

  After calculating the coordinates of the virtual sound source as described above, the CPU 100 causes the display unit 130 of the terminal device 10 to display a confirmation message, a YES button, and NO, for example, “Do you want to move to this position?” A button may be displayed. The user can confirm the position of the virtual sound source while listening to it, and presses the NO button to change the position. When the CPU 100 detects that the NO button is pressed, the CPU 100 returns the position information of the sound source to the position information before starting the movement, and updates the virtual sound source management table stored in the memory. In addition, virtual sound source information including position information before the start of movement is transmitted to the audio signal processing device 20. When receiving the virtual sound source information, the CPU 210 of the audio signal processing device 20 updates the virtual sound source management table TBL2, calculates the input audio signal by gain distribution when the virtual sound source is placed at the position before the movement start, and the audio signal. Is output. The CPU 100 displays an instruction indicating that the terminal device 10 shown in step S41 is directed toward the virtual sound source, and repeats the above-described processing. However, when the position of the virtual sound source is a desired position, the user presses the YES button. When the CPU 100 detects that the YES button is pressed, the CPU 100 completes the process. The final confirmation process as described above may be performed.

In the above example, since the position of the left front presence channel is moved as a virtual sound source, the coordinate value of the left front presence channel in the virtual sound source table TBL2 is finally (-1, 0) as shown in FIG. .29, 0.51).
When detecting that the movement button E has been released (S46: YES), the CPU 100 transmits information indicating that the movement of the virtual sound source is completed to the audio signal processing device 20 (S47). When the audio signal processing device 20 receives the information indicating that the movement of the virtual sound source is completed, the audio signal processing device 20 may reproduce the entire channel including the virtual sound source for which the user has designated the position.

  As described above, the CPU 100 functioning as the setting position instruction unit, after the target sound source as the control target is specified, when the movement button E is pressed and the terminal device 10 is directed to a desired position, for a predetermined time. The destination position is calculated at intervals, and the virtual sound source management table TBL2 is updated with the calculated position as a new position of the virtual sound source.

  As described above, according to the present embodiment, the virtual sound source is specified by an intuitive operation such as pointing the terminal device 10 toward the virtual sound source in a state where the program for specifying the position of the virtual sound source is activated. be able to. After the identification, the virtual sound source table TBL2 is updated and updated at predetermined time intervals by an intuitive operation such that the terminal device 10 is directed to a place where the virtual sound source is desired while pressing the movement button E. Since the audio signal is reproduced based on the information, the virtual sound source can be installed at a desired location while listening to the reproduced sound in real time.

  In the present embodiment, when the position of the virtual sound source is designated, the virtual sound source table TBL2 is updated. Therefore, the sound source moved as the virtual sound source is specified as a new target sound source and moved to another position. It becomes possible. Therefore, according to the present embodiment, the position of the virtual sound source can be freely changed by an intuitive operation.

  In the present embodiment, the example in which the specific process and the setting position specifying process of the present invention are performed using the sound image of each channel as a control target has been described. However, the present invention is not limited to the example described in the present embodiment. For example, a sound image obtained by mixing a plurality of channels may be set as a control target, or a speaker or a virtual speaker may be set as a control target. When a speaker is a control target, a speaker management table, not a virtual sound source management table, may be transmitted from the audio signal processing device 20 to the terminal device 10 and the terminal device 10 may perform processing based on the speaker management table. Further, the content of the speaker management table updated in the terminal device 10 may be reflected in the audio signal processing device 20. A virtual speaker is a speaker that sounds as if there is a speaker where there is no physical speaker by outputting the same sound from a plurality of speakers. The virtual speaker may be managed by a virtual sound source management table or may be managed by a speaker management table.

<B: Second Embodiment>
Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, the position indicated by the terminal device 10 is projected on a boundary in the X-axis direction, the Y-axis direction, or the Z-axis direction in the three-dimensional coordinate space, and only the angle information is used to project the position. The example which calculates | requires a coordinate was demonstrated. In the present embodiment, the coordinates of the position indicated by the terminal device 10 are obtained using distance information in addition to angle information. FIG. 26 to FIG. 28 are flowcharts showing the contents of the target sound source specifying process in the terminal device 10 according to this embodiment, and FIG. 29 is a diagram showing a display example of the display unit 130 of the terminal device 10 according to this embodiment. FIG. 30 is a diagram illustrating a display example of the display unit 130 of the terminal device 10 according to the present embodiment. FIG. 31 is a diagram illustrating an example of a target sound source that can be specified by the terminal device 10 according to the present embodiment and a virtual sound source whose position can be specified. In the flowcharts shown in FIGS. 26 to 30, the same step numbers are given to the common parts with the flowcharts shown in FIGS. 6 to 8.

  Also in this embodiment, when the program for specifying the position of the virtual sound source is started, the processing of steps S30 to S33 shown in FIG. 26 is performed, and further, as shown in FIG. 29, the terminal device 10 is directed to the target sound source. Further, a display for instructing to adjust the distance is performed on the display unit 130 of the terminal device 10 (S50). After displaying the message shown in FIG. 29 on the display unit 130, the CPU 100 of the terminal device 10 starts executing the target sound source specifying process including the distance (S51). The target sound source identification process including the distance is a process executed at regular time intervals. The specific contents of the target sound source identification process including the distance are shown in FIG.

  The display for prompting the distance adjustment shown in FIG. 29 includes a fader F that can be moved in the arrow direction and a setting button G. When the user moves fader F to the “far” side, the target sound source existing at a position farther than the current position can be specified, and when fader F is moved to the “near” side. Thus, it is possible to identify the target sound source that is present at a position closer to the current position.

  Specifically, when the CPU 100 functioning as a distance adjustment instruction unit detects the movement of the fader F, the CPU 100 instructs the adjustment of the distance according to the movement direction and the movement amount of the fader F. And CPU100 which functions also as a control object specific | specification part adjusts a distance according to this instruction | indication (S150). The process of detecting the movement of the fader F and the process of adjusting the distance are performed at predetermined time intervals. If the movement of the fader F is not detected, the following process (S100 ~) is performed. When the movement of the fader F is detected, specifically, the length of the hypotenuse a in the triangle shown in FIGS. 22 and 24 is changed according to the moving direction of the fader F. Further, as in the first embodiment, angle information is acquired at predetermined time intervals (S100), and the coordinates of the target sound source are calculated at predetermined time intervals (S101). In the present embodiment, the virtual sound source table TBL2 stored in the memory 230 of the audio signal processing device 20 and the memory 110 serving as the target position information storage unit of the terminal device 10 stores the position information of each channel from the user. Coordinates that take distance into account are stored.

  The CPU 100 as the control target specifying unit of the terminal device 10 determines whether the coordinates of the target sound source close to the coordinates calculated after adjusting the distance exist in the virtual sound source table TBL2 at predetermined time intervals (S102). If it does not exist, for example, information indicating that the target sound source could not be specified is output as the output of the target sound source specifying process in step S51. If the coordinates of the target sound source close to the calculated coordinates exist, it is determined that the target sound source as the control target has been specified. Then, the CPU 100 outputs, for example, information for identifying the specified target sound source as the output of the target sound source specifying process in step S51. As described above, in the present embodiment, the adjustment of the distance, the calculation of the position of the destination of the terminal device, and the identification of the target sound source are executed every predetermined time.

  After starting the target sound source identification processing in step S51, it is confirmed whether or not the target sound source has been identified (S38). In the present embodiment, as an example, the process of step S38 is repeated until the target sound source can be specified. In other words, when similar or approximate coordinates do not exist in the virtual sound source table TBL2 and cannot be specified (S38: NO), for example, “adjust the distance toward the direction of the moving sound source” The message is continuously displayed on the display unit 130 of the terminal device 10, and the target sound source identification process is continued. However, if it cannot be specified even after a certain period of time has elapsed, the processing may be terminated due to a timeout or the processing may be cancelled.

  When the CPU 100 confirms that the target sound source can be specified (S38: YES), the CPU 100 stops the target sound source specifying process including the distance in step S50. For example, as shown in FIG. A message such as “Do you want to move the channel?” And the YES button C and NO button D are displayed on the display unit 130 of the terminal device 10 (S39). Similarly to the first embodiment, the terminal device 10 may be vibrated in real time by the vibration generating unit 160 or sound may be output from the speaker of the sound generating unit 161 of the terminal device 10 in real time. Further, when there are a plurality of candidates that can be specified as the target sound source, the plurality of candidates may be displayed on the display unit 130 of the terminal device 10. Further, if the identification message can be identified, the confirmation message button in step S39 may not be displayed, but only the identified channel name may be displayed, and the identification process of the target sound source may be continued simply by storing the identified channel.

  As described above, the CPU 100 as the control target specifying unit outputs the yaw output from the angle information output unit configured by at least one of the gyro sensor 151 and the acceleration sensor 152 when the terminal device 10 is directed to the target sound source. The position information (coordinates) is calculated based on the angle information consisting of the pitch and the distance information based on the movement of the fader F, and the calculated position information and the virtual sound source table stored in the memory 110 as the target position information storage unit Comparison with the position information of each channel in TBL2 is performed, and when the positional information shift is within a predetermined range, the corresponding channel is presented (displayed) as the sound source to be operated, and the operation target is determined.

  When the user presses the NO button in the display state shown in FIG. 19 (S40: NO), the target sound source specifying process is restarted from the beginning. However, when the user presses the YES button C in the display state shown in FIG. 19 (S40: YES), the CPU 100 adjusts the distance in the direction to be moved as shown in FIG. And the like, and the movement button E are displayed on the display unit 130 of the terminal device 10 (S52). When the CPU 100 detects that the user has pressed the display button, that is, the movement button E (S42: YES), the CPU 100 starts specifying the virtual sound source setting position including the distance (S60).

  FIG. 28 shows the specific contents of the virtual sound source installation position designation process including the distance. The virtual sound source installation position designation process is a process executed at predetermined time intervals. In this case, the CPU 100 that detects that the movement button E is pressed functions as a distance adjustment instruction unit. When the user operates the fader F and the CPU 100 detects the movement of the fader F, the CPU 100 instructs the adjustment of the distance according to the moving direction and the moving amount of the fader F. And CPU100 which functions also as a position information update part adjusts a distance according to this instruction (S250). The process of detecting the movement of the fader F and the process of adjusting the distance are performed at predetermined time intervals. If the movement of the fader F is not detected, the following process (S200 ~) is performed. When the movement of the fader F is detected, specifically, the length of the hypotenuse a in the triangle shown in FIGS. 22 and 24 is changed according to the moving direction of the fader F, as in the above example. . Furthermore, as in the first embodiment, angle information is acquired at predetermined time intervals, and the coordinates of the set position of the virtual sound source are calculated (S200). Then, information for identifying a virtual sound source, such as a channel name and virtual sound source information including the position information of the virtual sound source, is transmitted to the audio signal processing device 20 at predetermined time intervals (S201). Further, the CPU 100 updates the virtual sound source management table stored in the memory 110 (FIG. 8: S202). Alternatively, the fader may have the same meaning as the movement button, and it may be operated easily with one hand by assuming that the movement button is pressed only while the user operates the fader.

When receiving the virtual sound source information, the CPU 210 of the audio signal processing device 20 updates the virtual sound source management table TBL2, and calculates the input audio signal by gain distribution when the virtual sound source is placed in the middle of setting at a predetermined time interval. , Output audio signal. While pressing the move button E, the user directs the terminal device 10 to a position where the virtual sound source is to be moved, confirms the sound image position in the middle of setting, moves the target sound source to the desired position, and presses the move button E at the desired position. When released (S46: YES), the virtual sound source installation position designation process is completed.
When detecting that the movement button E has been released (S46: YES), the CPU 100 transmits information indicating that the movement of the virtual sound source is completed to the audio signal processing device 20 (S47). When the audio signal processing apparatus 20 receives information indicating that the movement of the virtual sound source has been completed, the audio signal processing apparatus 20 may reproduce the entire channel including the virtual sound source for which the user has designated the position. Therefore, the user can recognize that the distance of the virtual sound source with respect to himself / herself changes according to the operation of the fader F, and listen to the sound of the virtual sound source whose distance changes in real time at the optimal position. Can be installed.

  As described above, when the CPU 100 functioning as the distance adjustment instruction unit instructs the adjustment of the distance between the terminal device 10 and the target position according to the user's operation, the CPU 100 functioning also as the control target specifying unit responds to the instruction. Accordingly, the distance between the current terminal device and the target position is increased or decreased. That is, in the case of an instruction to bring the target position closer to the terminal device 10, the distance is made shorter than the current time, and in the case of an instruction to move the target position away from the terminal device 10, the distance is made longer than the current time. The CPU 100 as the control target specifying unit calculates the position information of the target position based on the distance thus increased or decreased based on the instruction and the angle information output from the sensor as the angle information output unit. Then, the CPU 100 as the control target specifying unit compares the calculated position information of the target position with the position information of each channel in consideration of the distance stored in the virtual sound source table TBL2, and the difference between the position information is predetermined. If it is within the range, it is determined that the target sound source has been specified.

  Further, when the CPU 100 functioning as a distance adjustment instruction unit instructs the adjustment of the distance between the terminal device 10 and the set position of the target sound source in response to a user operation, the CPU 100 functioning also as a position information update unit responds to the instruction. Accordingly, the distance between the current terminal device and the set position is increased or decreased. That is, in the case of an instruction to bring the set position closer to the terminal device 10, the distance is made shorter than the present, and in the case of an instruction to move the set position away from the terminal device 10, the distance is made longer than the present. The CPU 100 as the position information update unit calculates the position information of the set position based on the distance thus increased or decreased based on the instruction and the angle information output from the sensor as the angle information output unit. Then, the CPU 100 as the position information update unit updates the contents of the virtual sound source table TBL2 using the calculated position information of the target sound source as new position information. In this way, the setting position of the virtual sound source is designated. The new position information is transmitted to the audio signal processing device 20 in real time, and the CPU 210 of the audio signal processing device 20 updates the contents of the virtual sound source table TBL2 with the new position information. The virtual sound source setting position can be specified while listening.

  As described above, according to the present embodiment, since the distance between the control target and the user is taken into account in specifying the control target and specifying the installation position of the control target, for example, as shown in FIG. Sound images R1 to R4 having different distances from the user can be specified, and virtual sound sources V1 to V4 can be specified at positions having different distances from the user. Therefore, according to the present embodiment, it is possible to more freely specify the control target and specify the position.

  In the present embodiment, the distance is adjusted using the fader displayed on the display unit 130 of the terminal device 10, but the present invention is not limited to this example, and the numerical value representing the distance on the display unit 130. May be input. Moreover, you may use roll which is one of the angle information obtained from the terminal device 10 shown in FIG. For example, when the roll angle increases counterclockwise, the length of the hypotenuse a in the triangle shown in FIGS. 22 and 24 is shortened, and when the roll angle increases clockwise, FIG. You may make it lengthen the length of the hypotenuse a in the triangle shown in FIG. Alternatively, the distance may be shortened when the roll angle increases counterclockwise, and the distance may be increased when the roll angle increases clockwise. When the roll angle is used, it may be difficult to confirm the display on the display unit 130. Therefore, when the control target can be identified, the vibration function of the terminal device 10 is used to identify the terminal device 10. A sound such as a buzzer sound may be generated using a sound function.

  In this embodiment, the example in which the distance is adjusted in both the control target specifying process and the setting position specifying process has been described, but either the control target specifying process or the setting position specifying process is performed. The distance may be adjusted in the processing.

<C: Third Embodiment>
Next, a third embodiment of the present invention will be described with reference to FIGS. In the first embodiment, as shown in FIG. 11, the center of the terminal device 10 is the coordinate origin, the length in the X-axis direction is 2, the length in the Y-axis direction is 2, and the length in the Z-axis direction is The coordinates of the target sound source and the virtual sound source were obtained in the two-dimensional coordinate space. However, the present invention is not limited to this example. For example, as shown in FIG. 32, the center of the terminal device 10 is the coordinate origin, the radius is 1, and the length in the Z-axis direction is 2. The coordinates of the target sound source and the virtual sound source may be obtained by projecting onto the figure. Also in this case, a speaker and a virtual sound source are not arranged on the ceiling surface and the bottom surface. The coordinates of XY on the XY plane shown in FIG. 33 are obtained as follows.

(Equation 3)
x = sin (yaw)
y = cos (yaw)
Further, the Z coordinate may be obtained based on the pitch as in the first embodiment.

  In both cases of the first embodiment shown in FIG. 11 and the third embodiment shown in FIG. 32, when the speaker and the virtual sound source are arranged on the ceiling surface and the bottom surface, the pitch is + 45 ° to + 90 ° or −45 °. By multiplying the XY coordinates on the XY plane obtained as described above by (90-pitch) / 45 at the time of ˜−90 °, the position on the ceiling or bottom of the three-dimensional coordinate space (X, Y, Z) can be determined.

  Furthermore, as shown in FIG. 34, the position indicated by the terminal device 10 may be obtained as polar coordinates on a sphere having a radius r. In this case, the coordinates of X, Y, and Z can be obtained as follows.

(Equation 4)
x = rcos (pitch) sin (yaw)
y = rcos (pitch) cos (yaw)
z = rsin (pitch)

  In this case, among the polar coordinates stored in the table, a virtual sound source or the like having the polar coordinates closest to the polar coordinates calculated from the angle of the terminal device 10 may be estimated as the sound source that the user wants to specify. Moreover, when designating the setting position of a virtual sound source or the like, polar coordinates calculated from the angle of the terminal device 10 may be stored in a table.

  Further, as shown in FIGS. 35 and 36, a threshold value is provided for each predetermined angle in the XY plane, the YZ plane, or the XZ plane, and the region to which the speaker and the virtual sound source belong is stored as position information. May be. In the example of FIGS. 35 and 36, the XY plane is divided into areas A1 to A16, and the YZ plane is divided into areas B1 to B16. The intervals between the angles of the regions do not need to be equal, and may be further subdivided than in this example, or may be roughly divided. In this case, a virtual sound source or the like belonging to an area calculated from the angle of the terminal device 10 may be estimated as a sound source that the user wants to specify. When a set position of a virtual sound source or the like is designated, an area to which the designated position belongs may be stored in the table as a position state.

  Further, the position information of the speaker and the virtual sound source may be stored at the yaw and pitch angles without considering the depth. In this case, the control target may be a speaker or a virtual sound source that is closest to the angle of the terminal device 10. Or it is good also as a control object, when the angle of the terminal device 10 approaches the angle of a speaker or a virtual sound source.

<D: Fourth Embodiment>
Next, a fourth embodiment of the present invention will be described with reference to FIG. In the above-described embodiment, the example in which the control unit and the operation confirmation message are displayed on the display unit 130 of the terminal device 10 has been described. That is, in the above-described embodiment, the CPU 100 and the display unit 130 are configured as a notification unit that notifies that a control target has been specified. However, the present invention is not limited to this example. For example, the vibration function by the vibration generating unit 160 or the sound function by the sound generating unit 161 of the terminal device 10 shown in FIG. May be. That is, you may comprise CPU100 and the vibration generation part 160 or the sound generation part 161 as an alerting | reporting part which alert | reports that the control object was specified.

  For example, when the user directs the terminal device 10 in the direction of the sound source in order to specify the target sound source, if there is a target sound source having position information close to the angle of yaw and pitch of the terminal device 10, vibration is shortened once. Or a preset sound may be generated. In addition, the number of times that vibration is generated and the number of times that sound is generated may be changed for each control target. For example, when the left front channel can be specified as a control target, vibration is generated once, when the center channel can be specified twice, and when the right front channel can be specified three times, vibration is generated. It is also possible to change the frequency | count of performing and the frequency | count of generating a sound for every control object. When configured in this manner, the user can know that the control target has been specified without looking at the display unit 130 of the terminal device 10, and convenience can be improved.

<F: Modification>
Although each embodiment of the present invention has been described above, it goes without saying that the following modifications may be added to these embodiments.
(1) In each of the above embodiments, the terminal device 10 obtains angle information, and also calculates coordinates and specifies a control target in the terminal device 10. However, the angle information may be transmitted from the terminal device 10 to the audio signal processing device 20, and the audio signal processing device 20 may calculate the coordinates and specify the control target.

(2) In each of the above embodiments, processing is performed only for one type of control target. However, as described above, there are a plurality of objects to be controlled, such as a sound image by each channel, a sound image by mixing a plurality of channels, a virtual speaker, and a speaker. Therefore, a list of control targets may be displayed on the display unit 130 of the terminal device 10 and the user may be allowed to select which control target is to be processed. In addition, the list display screen for the control target and the screen for selecting the control target may be separated.

(3) In each of the above-described embodiments, an example has been described in which processing for specifying a set position of a control target is performed after the control target is specified. However, editing processing such as adjusting the volume and sound quality may be performed after specifying the control target. In this case, the display unit 130 of the terminal device 10 may perform adjustment display of volume and sound quality, or may be adjusted by changing the attitude of the terminal device 10. Note that the content of editing varies depending on the control target, and accordingly, a screen with different content of editing may be displayed depending on the control target.

(4) In each of the above embodiments, the case where the sound of all channels is always reproduced has been described. However, when the control target is specified, the control target sound may be emphasized and reproduced. In this case, other sounds may be muted, or the volume of only the sound to be controlled may be increased. Alternatively, all the sounds may be erased when the process for specifying the control target is started, and the sound may be emitted from that location only when the orientation of the terminal device 10 approaches the control target. The sound may be a currently played sound or a fixed sound such as a beep sound. Furthermore, in the configuration in which the distance can be adjusted as in the second embodiment described above, reproduction is performed with emphasis, for example, by increasing the sound of the control target as the position indicated by the terminal device 10 approaches the target position. It may be.

(5) In each of the above-described embodiments and modifications, the case of using one terminal device 10 has been described. However, a plurality of terminal devices 10 may be used. When a plurality of terminal devices 10 are used to perform a specific process such as a virtual sound source in each terminal device 10, a plurality of pieces of virtual sound source position information in the virtual sound source management table TBL 2 updated in the audio signal processing device 20 are stored. The terminal device 10 may be configured to always acquire the content, and the contents of the virtual sound source management table TBL2 may be synchronized between the audio signal processing device 20 and the plurality of terminal devices 10. Further, immediately before performing the specific processing of the virtual sound source or the like in each terminal device 10, the content of the virtual sound source management table TBL 2 is acquired from the audio signal processing device 20 and stored in the memory 110 of each terminal device 10. The table TBL2 may be updated.

(6) In the above embodiments and modifications, the present invention is applied to the audio signal processing system 1A including the terminal device 10 and the audio signal processing device 20, but the present invention is not limited to a portable audio player, a smartphone, or the like. As described above, the present invention can also be applied to a sound reproducing apparatus that reproduces various sounds such as voice and musical tone. FIG. 37 is an external view of a sound reproducing device according to a modification of the present invention. The sound reproducing device 30 is a portable device (portable audio player) that reproduces various sounds such as voice and musical sound, and includes a main body 312 and a sound emitting body 314. The main body 312 generates and outputs two stereo audio signals SOUT (SOUT_R, SOUT_L). The sound emitting body 314 is a device (headphone or earphone) that emits reproduced sound corresponding to each acoustic signal SOUT output from the main body 312 and is the head of a user who listens to the reproduced sound (hereinafter referred to as “listener”). It is attached to the part. The sound emitter 314 is attached to the listener's right ear and emits a reproduced sound corresponding to the acoustic signal SOUT_R, and the sound emitter 314 is attached to the listener's left ear and reproduces the reproduced sound corresponding to the acoustic signal SOUT_L. It is comprised with the sound emission part 314L to radiate | emit. The listener can carry the main body 312 in the body (for example, in a pocket of clothes) and move the sound emitting body 314 on the head.

  FIG. 38 is a block diagram of the main body 312. As shown in FIG. 38, the main body 312 is realized by a computer system including an arithmetic processing device 320, a storage device 332, an input device 334, a display device 336, and a signal processing device 340. The arithmetic processing device 320, the storage device 332, and the signal processing device 340 are accommodated in a housing 350 (FIG. 37) in which the input device 334 and the display device 336 are arranged. The arithmetic processing unit 320 realizes a plurality of functions by executing a program stored in the storage device 332.

  The storage device 332 stores a program executed by the arithmetic processing device 320 and data used by the arithmetic processing device 320. A known recording medium such as a semiconductor recording medium or a magnetic recording medium is arbitrarily employed as the storage device 332. The storage device 332 stores an acoustic signal S0 (sample series) representing an acoustic waveform for each piece of music, for example. Further, the storage device 332 stores a plurality of transfer characteristic data D representing transfer characteristics (head related transfer function) given to the acoustic signal S0. Furthermore, the storage device 332 stores the virtual sound source management table TBL2 described in the above embodiments.

  The signal processing device 340 is an electronic circuit (DSP) that processes the acoustic signal S0 and generates acoustic signals SOUT (SOUT_R, SOUT_L). As illustrated in FIG. 38, the signal processing device 340 includes a sound image localization unit 342 and a D / A conversion unit 344. The sound image localization unit 342 localizes the sound image perceived by the listener when listening to the reproduced sound from the sound emitting body 314 to a virtual sounding point (hereinafter referred to as “virtual sounding point”) at a specific position. The sound signal Q (Q_R, Q_L) is generated by performing sound image localization processing for localizing the virtual sound source to the virtual sounding point on the sound signal S0. The D / A converter 344 converts the digital acoustic signal Q (Q_R, Q_L) generated by the sound image localization unit 342 into an analog acoustic signal SOUT (SOUT_R, SOUT_L) and outputs the analog acoustic signal SOUT to the sound emitter 314. Note that the position information of the virtual pronunciation point is stored in the virtual sound source management table TBL2.

  FIG. 39 is a block diagram of the sound image localization unit 342. As shown in FIG. 39, the sound image localization unit 342 includes a signal separation unit 372, a convolution operation unit 374, and a signal synthesis unit 376. The signal separation unit (surround codec) 372 generates a plurality of systems (5.1ch) of acoustic signals S (Sd_L, Sd_R, Sd_C, Sd_LS, Sd_RS, SLF) from the acoustic signal S0 stored in the storage device 332. Each of the five systems of acoustic signals Sd (Sd_L, Sd_R, Sd_C, Sd_LS, Sd_RS) other than the acoustic signal SLF comes from a specific direction (hereinafter referred to as “sound receiving direction”) with respect to the user who is the listener. It corresponds to the sound to be. More specifically, the sound signal Sd_L and the sound signal Sd_R correspond to sound coming from the left and right in front of the listener. The acoustic signal Sd_C corresponds to the sound coming from the front of the listener, and the acoustic signal Sd_LS and the acoustic signal Sd_RS correspond to the sound coming from the left and right behind the user who is the listener. On the other hand, the acoustic signal SLF corresponds to low-frequency sound.

  The convolution operation unit 374 adds a transfer characteristic (head related transfer function) H to each acoustic signal Sd processed by the signal separation unit 372. As shown in FIG. 39, the convolution operation unit 374 includes five filter processing units 378 to which the respective acoustic signals Sd (Sd_L, Sd_R, Sd_C, Sd_LS, Sd_RS) other than the acoustic signal SLF are supplied. Each filter processing unit 378 includes a right ear filter 378R and a left ear filter 378L. Each of the filter 378L and the filter 378R is an FIR (Finite Impulse Response) filter that performs a convolution operation of the transfer characteristic H on the acoustic signal Sd supplied from the signal separation unit 372. The transfer characteristic H is a coefficient sequence representing, for example, a waveform on the time axis of the impulse response, and each filter so that the sound image of the reproduced sound is localized at the virtual sounding point, that is, so that the virtual sound source is localized at the virtual sounding point. The arithmetic processing unit 320 individually sets the filter 378R and the filter 378L of the processing unit 378.

  The signal synthesis unit 376 adds the acoustic signal Sd (Sd_L, Sd_R, Sd_C, Sd_LS, Sd_RS) processed by the filter 378L of each filter processing unit 378 and the acoustic signal SLF generated by the signal separation unit 372 to add the acoustic signal. A signal Q_L is generated. Similarly, the signal synthesis unit 376 generates the acoustic signal Q_R by adding the acoustic signal Sd (Sd_L, Sd_R, Sd_C, Sd_LS, Sd_RS) and the acoustic signal SLF after processing by the filter 378R of each filter processing unit 378. To do. The acoustic signal Q_L and the acoustic signal Q_R generated by the signal synthesis unit 76 are converted into the acoustic signal SOUT_L and the acoustic signal SOUT_R by the D / A conversion unit 344, and then output to the sound emitting body 314.

  The input device 334 in FIG. 38 is configured by an operator that is operated by the user for an instruction to the sound reproduction device 30. For example, by appropriately operating the input device 334, the user selects a music piece (acoustic signal S0) to be reproduced by the sound reproducing device 30 and specifies an initial position of a virtual sounding point of the virtual sound source. The display device 336 displays, for example, names of a plurality of music pieces that are candidates for selection by the user, images representing the relationship between listeners and virtual pronunciation points, or moving images such as movies and animations. Similarly to the above embodiments, the display device 336 performs display for prompting the user to perform an operation, display for requesting confirmation, and the like when performing the virtual sound source specifying process and the virtual sound source setting position specifying process.

  As shown in FIG. 38, the sound reproducing device 30 includes a gyro sensor 361 and an acceleration sensor 362. Each of the gyro sensor 361 and the acceleration sensor 362 is a sensor that detects its own direction.

  In the sound reproduction apparatus 30 as described above, the virtual sound source is specified in the state where the virtual sound source is localized at the virtual sounding point, and the virtual sound source is specified as in the above-described embodiments by starting the program for specifying the position of the virtual sound source. It is possible to perform processing and designation processing of the setting position of the virtual sound source. That is, by directing the sound reproducing device 30 in the direction of the virtual sounding point, the virtual sound source of the virtual sounding point can be specified, and the sound reproducing device 30 is pointed in the desired direction while pressing the movement button. The virtual sounding point of the sound source can be moved in a desired direction. In this modification example, the reset direction when the yaw reset process is performed is the front of the user. By providing the receiver of FIG. 3 with a function corresponding to the sound image localization unit 342, the user may listen with earphones instead of a plurality of speakers.

DESCRIPTION OF SYMBOLS 1A ... Audio signal processing system, 10 ... Terminal device, 20 ... Audio signal processing device, 30 ... Sound reproduction device, 100 ... CPU, 110 ... Memory, 151 ... Gyro sensor, 152 ... Acceleration sensor, 153 ... Direction sensor, 210 ... CPU, 230 ... memory, 301 ... mixer, 310 ... frequency correction unit, 320 ... gain distribution unit, IN1-IN9 ... input audio signal, OUT1-OUT9 ... output audio signal, Pref ... reference position, SP1 ... center speaker, SP2 ... Right front speaker, SP3 ... Right surround speaker, SP4 ... Left surround speaker, SP5 ... Left front speaker, SP6 ... Right front presence speaker, SP7 ... Right rear presence speaker, SP8 ... Left rear presence speaker, SP9 ... Left front presence speaker , TBL1 ... speaker management table, TBL2 ... virtual sound source table.

Claims (9)

When the terminal device is directed in a predetermined direction, a rotation angle around the vertical axis with respect to an axis orthogonal to the vertical axis and an inclination angle around an axis orthogonal to the vertical axis are detected and the rotation An angle information output unit that outputs the angle and the tilt angle as angle information;
A target position information storage unit that stores position information of a plurality of control targets;
The position information calculated based on the angle information output from the angle information output unit is compared with the position information of a plurality of control targets stored in the target position information storage unit, and the control target is specified. A control target specifying unit to perform,
A terminal device comprising: Position information calculated based on the angle information output from the angle information output unit when the terminal device is pointed to a desired position after the control target is specified by the control target specifying unit A position information update unit that updates the storage content of the target position information storage unit as new position information of the control target,
The terminal device according to claim 1. Position information calculated based on the angle information output from the angle information output unit when the terminal device is pointed to a desired position after the control target is specified by the control target specifying unit Including a transmission unit that transmits to the external audio signal processing apparatus that outputs an audio signal corresponding to the control target as new position information of the control target.
The terminal device according to claim 1. A distance adjustment instruction unit for instructing adjustment of the distance between the terminal device and the target position;
The position information calculated based on the distance increased or decreased based on an instruction from the distance adjustment instruction unit and the angle information output from the angle information output unit is used as the position information.
The terminal device according to claim 1, wherein the terminal device is a terminal device. When the control target is specified by the control target specifying unit, the calculated position information is compared with the position information of a plurality of control targets stored in the target position information storage unit, and the position information of each other An informing unit for informing when the deviation is within a predetermined range;
The terminal device according to claim 1, wherein the terminal device is a terminal device. An audio signal processing system having a terminal device and an audio signal processing device that performs predetermined processing on an input signal based on position information and outputs a signal of a channel corresponding to each of a plurality of speakers,
When the terminal device is directed in a predetermined direction, a rotation angle around the vertical axis with respect to an axis orthogonal to the vertical axis and an inclination angle around an axis orthogonal to the vertical axis are detected and the rotation An angle information output unit that outputs the angle and the tilt angle as angle information;
At least one target position information storage unit that stores position information of a plurality of control targets;
The position information calculated based on the angle information output from the angle information output unit is compared with the position information of a plurality of control targets stored in the target position information storage unit, and the control target is specified. A control target specifying unit to perform,
An audio signal processing system comprising: A reproduction control unit that emphasizes and reproduces the control target specified by the control target specifying unit;
The audio signal processing system according to claim 6. A distance adjustment instruction unit for instructing adjustment of the distance between the terminal device and the target position;
As the position information, using the position information calculated based on the distance increased or decreased based on the instruction from the distance adjustment instruction unit and the angle information output from the angle information output unit,
A reproduction control unit that emphasizes and reproduces the control target as the difference between the position information and the target position is closer,
The audio signal processing system according to claim 6 or 7, wherein A program for a terminal device having a processor,
The processor;
Detecting a rotation angle around the vertical axis with respect to an axis orthogonal to the vertical axis and an inclination angle around an axis orthogonal to the vertical axis when the terminal device is directed to a predetermined position, and rotating the terminal device An angle information output unit for outputting the angle and the tilt angle as angle information;
A target position information storage unit for storing position information of a control target;
Position information calculated based on the angle information output from the angle information output unit when the terminal device is directed to the predetermined position, and the position of the control target stored in the target position information storage unit A control target specifying unit for performing comparison with information and specifying the control target;
A program for a terminal device, which is made to function as:

Images