JP6643168B2 - Karaoke device and program - Google Patents

Description

  The present invention relates to a karaoke apparatus and a program.

  2. Description of the Related Art In recent years, karaoke in which music data including only accompaniment is reproduced and the user sings along with the reproduced music data has been recognized as entertainment or hobbies. During the reproduction of the music data, general-purpose image data set in advance for each music data is displayed on a display unit such as a monitor.

  Recently, with the spread of the Internet and mobile phones and the development of communication technology, image data desired by a user has been obtained via a mobile terminal device such as a mobile phone, and the obtained image data has been obtained during reproduction of music data. A karaoke apparatus for displaying image data on a display unit has also appeared (for example, Patent Document 1).

JP 2015-191035 A

  However, in the karaoke apparatus disclosed in Patent Literature 1, the image data is acquired via the portable terminal device of the user who has set the image data. Therefore, when the user who has set the image data is different from the user who sings the music of the music data being reproduced, the mobile terminal device of the user who has set the image data transfers the image data during the singing of another user. During this time, other operations are not accepted or the operation becomes extremely slow. As a result, the user who has set the image data feels inconvenience in using his or her own portable terminal device.

  The present invention has been made to solve the problem, and an object of the present invention is to provide a karaoke apparatus that allows a user other than the singing user to use his / her own portable terminal device as usual. It is in.

  In order to solve the problem, the present invention relates to a karaoke apparatus capable of communicating with a user's portable terminal apparatus, and a receiving unit for receiving setting data including at least image identification data for identifying image data to be displayed during reproduction of music data. Storage control for associating image identification data included in the setting data, music identification data for identifying the music data, and singing user identification data for identifying a user who sings a song of the music data in a storage means Means, acquisition means for acquiring music data based on the music identification data stored by the storage control means, music reproduction means for reproducing the music data acquired by the acquisition means, and music reproduction means The singing user identification data associated with the music identification data of the music data to be reproduced Instruction transmission means for transmitting image acquisition instruction data for acquiring the image data indicated by the image identification data to the portable terminal device of the user indicated by the singing user identification data, based on the image identification data and the image identification data; Display control means for displaying the acquired image data on a display unit while acquiring the image data transmitted from the portable terminal device based on the image acquisition instruction data transmitted by the instruction transmission means during reproduction And a configuration comprising:

  The present invention transmits image acquisition instruction data to be displayed during reproduction of music data to a portable terminal device of a user who sings a song of music data, and acquires image data from the portable terminal device during reproduction of the music data. At the same time, the obtained image data can be displayed on the display unit.

  Therefore, the present invention uses the mobile terminal device 20 of the singing user when acquiring the image data during the singing and displaying the image and the lyrics indicated by the image data. A user other than the user can use his / her own portable terminal device as usual.

FIG. 1 is a system configuration diagram showing a configuration of an embodiment in a karaoke communication system according to the present invention. FIG. 3 is a conceptual diagram showing an operation outline of the karaoke communication system in one embodiment. It is a block diagram showing composition of a karaoke device of one embodiment. It is a figure showing an example of access user data stored in a karaoke device in one embodiment. It is a figure showing an example of reservation list data stored in a karaoke device in one embodiment. It is a block diagram showing composition of a personal digital assistant of one embodiment. It is a flowchart (the 1) which shows the reproduction | regeneration process of the karaoke data performed by the karaoke apparatus of one Embodiment. It is a flowchart (the 2) which shows the reproduction | regeneration processing of the karaoke data performed by the karaoke apparatus of one Embodiment.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. An embodiment described below is a karaoke communication system including a plurality of portable communication terminal devices and a karaoke device capable of communicating with the portable communication terminal device, or a karaoke device according to the present application and the karaoke device. This is an embodiment when a program is applied.

[1] Karaoke Communication System [1.1] Overview of Karaoke Communication System First, an overview of a karaoke communication system 1 of the present embodiment will be described with reference to FIG. FIG. 1 is a system configuration diagram showing a configuration of the karaoke communication system 1 in the present embodiment.

  In the following description, in order to prevent the figure from being complicated, some users, some entertainment facilities (hereinafter, referred to as “stores”) 50, and portable communication terminal devices (hereinafter, “mobile terminals”) Only the apparatus 20) and the karaoke apparatus 10 are shown. That is, in the actual karaoke communication system 1, there are more karaoke apparatuses 10, users, portable terminal apparatuses 20, and stores 50 than shown in each figure.

  The karaoke communication system 1 of the present embodiment includes, for example, a karaoke device 10 installed in a store 50 including a plurality of karaoke rooms, and a plurality of mobile terminal devices 20 that execute various functions in cooperation with the karaoke device 10. , A management server device 30 connected to the network N, and an external storage device 40 connected to the network N, and provide a service related to karaoke (hereinafter referred to as a “karaoke providing service”) to the user. It is.

  The karaoke communication system 1 of the present embodiment is a system in which karaoke data is stored in a database, and the karaoke data stored in the database is reproduced.

  In particular, each karaoke data includes at least a song ID for identifying the karaoke data, song data, and lyrics data indicating lyrics displayed when each song data is reproduced. It has a configuration for reproducing music data of karaoke data selected by the user and displaying lyrics.

  The karaoke communication system 1 has a configuration in which the lyrics and the image indicated by the image data are displayed during the reproduction of the karaoke data based on the image data stored in the karaoke device 10 or the external storage device 40.

  When using the karaoke system 10, the karaoke communication system 1 can use image data obtained from an external data providing server device (hereinafter, referred to as a "data providing server device") 80. It has a simple configuration.

  That is, during the reproduction of the karaoke data, the karaoke communication system 1 uses the mobile terminal device 20 under the instruction of the user instead of displaying the general-purpose image indicated by the general-purpose image data stored in the karaoke device 10. Image data provided by the data providing server device 80 is set, and based on the set image data, the karaoke device 10 (specifically, a display unit 115 described later) displays an image indicated by the lyrics and the image data, Is displayed.

  Normally, when acquiring image data from an external website provided by the data providing server device 80 or the like, the image data is acquired via the portable terminal device 20 of the user who has set the acquisition of the image data. Is done.

  However, the portable terminal device 20 of the user who has set the acquisition of the image data does not accept another operation while transferring the image data to the karaoke device 10 while singing another user, or The operation often becomes extremely slow.

  In particular, when sequentially reproducing the image data while acquiring the image data such as streaming, the load for executing these processes increases, so that other processes and other operations in the mobile terminal device 20 are restricted. Often done.

  On the other hand, a user who sings based on the karaoke data (hereinafter, referred to as “singing user”) sings while singing, and thus the mobile terminal device 20 of the singing user is not operated in many cases. .

  Therefore, in the present embodiment, the user who sets the image data (hereinafter, referred to as “the singing user”) acquires and transfers the image data provided by the data providing server device 80 or the like using the mobile terminal device 20 of the singing user. It is possible to reduce the processing load on the portable terminal device 20 of other users and other users, and to allow other users other than the singing user who is singing to use their own portable terminal device 20 as usual.

  In FIG. 1, the external storage device 40 is connected to a network N in order to allow the karaoke device 10 to directly access each database (hereinafter, referred to as “DB”) stored in the external storage device 40. Although the configuration example in which the external storage device 40 is directly connected to the management server device 30 is shown, the external storage device 40 may be mounted in the management server device 30.

  Further, the network N is configured by interconnecting a public telephone network including a mobile telephone network and an IP (Internet Protocol) network, for example. However, the configuration of the network N is not limited to this.

  Further, the management and operation entity of the external storage device 40 may be provided with a dedicated computer. However, in the present embodiment, in order to make the description concrete, the description is made assuming that the management server device 30 manages and operates the external storage device 40. Do.

  The data providing server device 80 is a server device that provides various data such as image data based on an address such as a URL, and is a conventionally used server device.

[1.2] Schematic Configuration of Karaoke Communication System Next, a schematic configuration of the karaoke apparatus 10 of the present embodiment will be described.

The karaoke communication system 1 of the present embodiment includes:
(1) Image data (hereinafter, referred to as “internal image data”) stored in advance in the portable terminal device 20 owned by the user, and
(2) Image data that has been uploaded in advance to the data providing server device 80 and is in a state where the user using the mobile terminal device 20 can freely browse and acquire (download or stream, etc.) via the network N. (Hereinafter, referred to as “external image data”)
Can be used as image data (hereinafter, referred to as “setting image data”) to be displayed as lyrics.

  Then, when one image data is set as the set image data from the image data stored in the mobile terminal device 20 or the data providing server device 80, the karaoke device 10 performs The acquisition instruction data for acquiring the image data including the data (for example, URL) regarding the acquisition source of the setting image data is transmitted to the corresponding portable terminal device 20. The karaoke device 10 acquires the setting image data from the mobile terminal device 20 and causes the display unit 115 to display the acquired setting image data and the lyrics data of the karaoke data.

  The setting image data may be image data for displaying a still image in a slide show format, or may be moving image data composed of a plurality of frame images. However, in the present embodiment, the description will be made using moving image data in order to make the description concrete.

  The karaoke apparatus 10 is an apparatus such as a home-use game machine and a personal computer in addition to the business karaoke apparatus in the store 50.

Specifically, the karaoke apparatus 10
(1) a karaoke data acquisition function of acquiring karaoke data from the external storage device 40 based on a user's music selection operation;
(2) a music playback function for playing back karaoke data obtained from the external storage device 40 or music data included in the karaoke data stored in advance in the karaoke device 10 and outputting musical tones;
(3) a lyrics display function for displaying lyrics in the lyrics data included in the karaoke data with the output of the musical sound;
(4) an image display function for displaying the general-purpose image data acquired from the external storage device 40 or the like in synchronization with the karaoke data being reproduced, and
(5) a registration function that enables communication between each mobile terminal device 20 and the karaoke device 10 in cooperation with the management server device 30 and the plurality of mobile terminal devices 20;
(6) Instead of the image display function of (4), display is performed based on the setting image data and lyrics data provided by the mobile terminal device 20 or by the data providing server device 80 via the mobile terminal device 20. Setting image display function,
And various other functions.

  The karaoke apparatus 10 also identifies the user who has executed the reservation process in conjunction with the mobile terminal device 20 or a remote controller (not shown) together with the music ID of the karaoke data to be reproduced (hereinafter, referred to as a “reserved user”). The data (that is, user ID) or the user ID of another user is stored as singing user identification data (hereinafter, referred to as “singing user ID”). The karaoke apparatus 10 generates reservation list data (hereinafter, referred to as “reservation list data”) in which the reproduction order of the karaoke data indicated by the music ID is specified, or adds to and updates the already generated reservation list data. A configuration for executing a reservation process is provided.

  In the present embodiment, karaoke data to be reproduced in association with each music ID having a specified reproduction order is referred to as reservation data. That is, the reservation list data indicates a set of reservation data.

  The mobile terminal device 20 is, for example, a terminal device such as a smartphone, a mobile phone, and a tablet-type data mobile terminal device, and is a terminal device that can be carried (portable) by a user.

  Specifically, the mobile terminal device 20 acquires resource data described in a markup language such as XML (extensible Markup Language) or JSON (JavaScript (registered trademark) Object Notation) based on the URL, A browsing function for displaying images, playing sounds, and performing data communication based on the acquired resource data is provided.

  The portable terminal device 20 has a touch panel function and stores an application for operating the karaoke device 10.

  The operation application is an application capable of performing various operations of the karaoke apparatus 10, such as selection of karaoke data, reproduction and suspension of karaoke data, and start and termination of a scoring application.

  The operation application may include music selection data including a music ID required for music selection, and may have a configuration in which the music selection data is acquired from the management server device 30.

In particular, in the present embodiment, the operation application is:
(1) a function of setting a setting image, a function of displaying a list of internal image data stored in the mobile terminal device 20 based on a user's input operation,
(2) For external image data on the data providing server device 80, based on image-related data such as a keyword set by the user, the URL of the relevant image data (that is, an external image address to be described later), title, time length, A function of acquiring external image data including a thumbnail image and the like and displaying a list of the external image data; and
(3) a function of determining one image data from the list by the user,
Is provided.

  Further, when the user performs a touch operation on the image displayed on the touch panel, the mobile terminal device 20 determines an operation instruction associated with the image touched by the touch operation, and determines the determined operation. A configuration for receiving an instruction is provided.

  Further, the mobile terminal device 20 acquires setting image data from the data providing server device 80 during reproduction of the karaoke data and transmits the setting image data to the karaoke device 10 based on instruction data described later transmitted from the karaoke device 10. Is provided.

  The management server device 30 manages the external storage device 40, manages various services including a karaoke providing service provided to the user in the karaoke communication system 1, and has a POS (POINT OF SALE) system function. It is.

  In particular, the management server device 30 manages user-related data (hereinafter, referred to as “user management data”) stored in the external storage device 40 and various types of karaoke data. The management server device 30 is configured to read various designated data from the external storage device 40 based on the instructions from the karaoke device 10 and the portable terminal device 20 and transmit the data to the karaoke device 10 or the portable terminal device 20. .

  The external storage device 40 is configured by a storage area such as a hard disk drive (HDD) or a solid state drive (SSD). In the external storage device 40, a user management DB 401 and a karaoke data DB 402 are constructed in a storage area, and are managed and operated by the management server device 30.

  The user management DB 401 is user management data of a user who uses the karaoke device 10 and is stored in the external storage device 40.

  Specifically, the user management data includes a user ID for identifying each user, a user name, gender, age, an e-mail address, a favorite image, and an ID for identifying the portable terminal device 20 carried by each user (hereinafter, “ID”). Terminal ID ”).

  The karaoke data DB 402 includes genre data indicating a hierarchical genre of karaoke data such as "Japanese music", "J-POP", or "rock", a music ID for identifying each karaoke data, and a music title (music). The karaoke data is a database in which a plurality of karaoke data including a karaoke name, a singer name (artist name), and image genre data indicating a genre of an image are stored in the external storage device 40. Note that some karaoke data may be stored in the karaoke device 10.

  The karaoke data includes karaoke music data, lyrics data to be displayed in synchronization with the reproduction of the music data, and control data for controlling the display of the lyrics data.

  Further, the karaoke music data includes MIDI (Musical Instrument Digital Interface) data for controlling reproduction of performance sounds of a plurality of musical instruments, music composition data indicating a music composition such as A melody, B melody, chorus, and song parts. And pitch melody data for guiding the melody, and the like.

[1.3] Outline of Operation of Karaoke Communication System Next, an outline of the karaoke communication system 1 of the present embodiment will be described with reference to FIG. FIG. 2 is a conceptual diagram showing an outline of the operation of the karaoke communication system 1 in the present embodiment.

  First, the portable terminal device 20 of the image setting user who sets an image acquires the already generated reservation list data from the karaoke device 10, and determines the reservation list data based on the acquired reservation list data and the operation input of the image setting user. It includes image identification data for identifying image data to be displayed during the reproduction of the reproduced karaoke data (that is, data including an external image address such as a URL for acquiring image data from the data providing server device 80) and a music ID. The setting data is transmitted ([1] in FIG. 2).

  Then, when the karaoke apparatus 10 receives the setting data from the portable terminal apparatus 20 of the image setting user, the image identification data included in the setting data, the music ID for identifying the karaoke data, and the singing for singing the music of the karaoke data A singing user ID for identifying the user is associated and added to the corresponding reservation data in the reservation list data and updated ([2] in FIG. 2).

  The karaoke device 10 acquires the karaoke data from the external storage device 40 based on the music ID of the reservation list data at the timing of reproducing the karaoke data indicated by the earliest music ID in the reservation list data ([FIG. 3]).

  In addition, if the reservation list data includes image identification data in association with the earliest music ID in the reservation list data, the karaoke apparatus 10 issues an image acquisition instruction based on the singing user ID and the image identification data associated with the music ID. (Hereinafter, referred to as “image acquisition instruction data”), and transmits the generated image acquisition instruction data to the portable terminal device 20 of the singing user indicated by the singing user ID ([4] in FIG. 2). ).

  Then, the portable terminal device 20 of the singing user, based on the image acquisition instruction data transmitted from the karaoke device 10, transmits data indicating a request including image identification data to the data providing server device 80 (hereinafter, “image acquisition request data”). Is transmitted ([5] in FIG. 2).

  The data providing server device 80 starts transmitting setting image data corresponding to the image acquisition request data transmitted from the singing user's mobile terminal device 20 to the singing user's mobile terminal device 20 ([6] in FIG. 2). .

  When the reproduction of the karaoke data is started, the portable terminal device 20 of the singing user obtains the setting image data transmitted from the data providing server device 80 and sequentially transmits the obtained setting image data to the karaoke device 10. ([7] in FIG. 2).

  The karaoke device 10 reproduces the karaoke data obtained from the external storage device 40. The karaoke device 10 acquires the setting image data transmitted from the singing user's portable terminal device 20 based on the image acquisition instruction data during the reproduction of the karaoke data, and performs the setting based on the acquired setting image data. To display an image on the display unit 115 ([8] in FIG. 2).

  When the karaoke device 10 acquires the set image data in synchronization with the start of the reproduction of the karaoke data, the karaoke device 10 transmits the image acquisition instruction data to the portable terminal device 20 of the singing user before the start of the reproduction of the karaoke data. At the start of the reproduction of the karaoke data, the reception of the setting image data from the portable terminal device 20 of the singing user is started.

  In addition, when the karaoke device 10 receives an instruction to acquire the setting image data during the reproduction of the karaoke data, the karaoke device 10 transmits the image acquisition instruction data to the mobile terminal device 20 of the singing user at the timing when the instruction is received, The reception of the setting image data from the portable terminal device 20 of the singing user is started. In particular, the mobile terminal device 20 transmits the setting image data to the karaoke device 10 by streaming.

[2] Specific Configuration of Each Apparatus [2.1] Karaoke Apparatus Next, the karaoke apparatus 10 of the present embodiment will be described with reference to FIGS. FIG. 3 is a block diagram illustrating a configuration of the karaoke apparatus 10 according to the present embodiment, and FIG. 4 is a diagram illustrating an example of access user data in the storage unit 119 according to the present embodiment. FIG. 5 is a diagram illustrating an example of the reservation list data in the storage unit 119 according to the present embodiment.

  As shown in FIG. 3, the karaoke apparatus 10 of the present embodiment outputs from the microphone M a communication control unit 111 that performs communication for exchanging various data such as karaoke data and image data via the network N. A voice input processing unit 112 for generating audio data by performing predetermined processing on the reproduced audio signal, a karaoke reproducing unit 113 for reproducing music data included in the karaoke data, and a musical tone corresponding to the reproduced music data. And a loudspeaker processor 114 for loudspeaker to the speaker SP.

  The karaoke apparatus 10 includes a display unit 115, a display control unit 116 that controls the display unit 115, a short-range wireless communication unit 117 that performs communication with the mobile terminal device 20 according to a short-range wireless communication standard, and The control unit 118 includes a control unit 118 that performs integrated control, a storage unit 119 that stores various data for realizing each function, and a data processing unit 120 that performs various processes using the data.

  The karaoke apparatus 10 includes a speaker SP and a microphone M, and is connected to the control unit 118 by a bus or a predetermined transmission line.

  Note that, for example, the communication control unit 111 of the present embodiment configures an “acquisition unit” of the present invention in cooperation with the control unit 118, and the karaoke playback unit 113 configures a “song reproduction unit” of the present invention. . Further, for example, the display control unit 116 constitutes “display control means” of the present invention in conjunction with the data processing unit 120. Further, for example, the short-range wireless communication unit 117 of the present embodiment configures a “reception unit” of the present invention in conjunction with the control unit 118, and the registration unit 123 configures a “storage control unit” of the present invention. .

  The communication control unit 111 establishes a communication line with the management server device 30 via the network N under the control of the system control unit 118, and exchanges various data.

  In particular, the communication control unit 111 adds the music ID to the reservation list data based on the reservation processing from the portable terminal device 20 via the short-range wireless communication unit 117 and the music corresponding to the music ID indicated by the instruction. A process for acquiring karaoke data including data from the management server device 30 is executed. Then, the communication control unit 111 supplies the music data included in the obtained karaoke data to the karaoke reproducing unit 113.

  The karaoke reproducing unit 113 includes a MIDI sound source and, under the control of the control unit 118, reproduces the MIDI sound source based on the music data included in the karaoke data acquired (downloaded) from the external storage device 40 via the management server device 30. The music playback process to be controlled is executed.

  Then, the karaoke reproducing unit 113 outputs the musical sound data generated by the music reproducing process to the loudspeaker processing unit 114.

  Under the control of the control unit 118, the loudspeaker processing unit 114 converts the tone data output from the karaoke reproducing unit 113 into an analog audio signal, amplifies the converted audio signal to a predetermined level, and amplifies the speaker SP. Perform processing to output to.

  Note that the speaker SP is configured by a speaker system including a plurality of speaker units that are more suitable for an installation place where the karaoke apparatus 10 is provided. Further, the loudspeaker processor 114 may perform various signal processing such as reverberation processing, and output the audio signal after the signal processing from the speaker SP.

  The display unit 115 includes, for example, an organic EL (Electro-Luminescence) element, a liquid crystal display element, or a CRT (Cathode Ray Tube), and displays predetermined image data under the control of the display control unit 116.

  Specifically, the display unit 115 displays an image and an image of lyrics superimposed on the image based on the image data supplied from the mobile terminal device 20 and the lyrics data included in the karaoke data.

  The display control unit 116 performs a display process based on the lyrics data and the image data under the control of the control unit 118 and the data processing unit 120, and generates display data for displaying an image in which the lyrics and the setting image are superimposed. And outputs it to the display unit 115.

  The short-range wireless communication unit 117 includes an infrared light receiving unit or an antenna according to a predetermined communication standard, and performs infrared communication such as IrDA (Infrared data Association) or Bluetooth (registered trademark), IEEE802.15.4, Data is exchanged with the portable terminal device 20 in accordance with a short-range wireless communication standard such as a wireless LAN.

  For example, the short-range wireless communication unit 117 outputs an instruction command corresponding to the instruction transmitted from the mobile terminal device 20 to the bus.

  Further, for example, when receiving various data including the setting image data from the mobile terminal device 20, the short-range wireless communication unit 117 outputs the received data to the bus and obtains the image obtained by the data processing unit 120. The instruction data is transmitted to the mobile terminal device 20.

  The communication between the portable terminal device 20 and the karaoke device 10 may be executed via the network N or the management server device 30.

  The control unit 118 mainly includes a central processing unit (CPU) (not shown), a cache memory, and a RAM, and integrally controls each unit. In addition, the control unit 118 executes a process for realizing each of the functions while interlocking with each unit.

  The storage unit 119 stores various data in a storage area such as an HDD or an SSD (Solid State Drive). In the storage area, access user data in which data related to the user of the portable terminal device 20 capable of communicating with the karaoke device 10 is listed, and image identification data, music ID, image setting user ID, and singing user ID are stored. The associated reservation list data is stored.

The access user data is, for example, as shown in FIG.
(1) a user ID for identifying a user;
(2) the user name of the user;
(3) user data relating to the user;
Are associated, and access user data is stored in the storage area.

  The user data includes, for example, the user's gender, age, mail address, favorite image, and terminal ID for identifying the portable terminal device 20 owned by the user.

The reservation list data is, for example, as shown in FIG.
(1) A number indicating the playback order,
(2) a song ID for identifying karaoke data to be reproduced by a number,
(3) a singing user ID for identifying a user (singing user) who sings the song of the karaoke data indicated by the song ID;
(4) image identification data for identifying image data to be displayed during reproduction of the karaoke data indicated by the music ID;
(5) an image setting user ID for identifying a user (image setting user) who has set the image data indicated by the image identification data;
Are associated data, and are stored in the storage area.

In particular, the image identification data includes, as shown in FIG.
(4A) external image flag data indicating whether or not the target image data is external image data acquired from an external device other than the mobile terminal device 20;
(4B) an external image address indicating the location of the image data in the case of external image data;
(4C) internal image flag data indicating whether or not the target image data is internal image data stored in the mobile terminal device 20;
It is included.

  In the present embodiment, the image data is moving image data, and the external image address in the image identification data is data indicating a location where the moving image data is stored. The external image address is, for example, a URL.

  Further, when a new reservation process is performed, reservation data such as a music ID is added to the end of the reservation list data.

  Note that when the flag data of the external image data or the internal image data is not held, it indicates that the general-purpose image data stored in the storage area of the storage unit 119 is used.

  The storage unit 119 stores a program used when executing processing for realizing each function.

  The data processing unit 120 includes the same or independent CPU as the control unit 118, and a ROM / RAM 121 that stores various programs necessary for driving the karaoke apparatus 10 and is used as a work area.

  In addition, the data processing unit 120 realizes an acquisition unit 122, a registration unit 123, and an instruction unit 124 by executing an application stored in the ROM / RAM 121.

  Note that, for example, the acquisition unit 122 of the present embodiment constitutes a “reception unit” of the present invention, and the registration unit 123 constitutes a “storage control unit” of the present invention. Further, for example, the instruction unit 124 of the present embodiment constitutes an “instruction transmission unit” of the present invention in conjunction with the control unit 118.

  The acquisition unit 122 acquires various data required to execute the processing. Specifically, the acquisition unit 122 executes a reception process of receiving, from the portable terminal device 20, setting data including image identification data to be displayed during the reproduction of the karaoke data, in conjunction with the short-range wireless communication unit 117.

  The registration unit 123 causes the storage unit 119 to register various data. Specifically, the registration unit 123 executes an access user addition process for adding an access user in the storage unit 119 based on the data acquired by the acquisition unit 122. Further, the registration unit 123 executes a reservation process for adding to the reservation list data in the storage unit 119 based on the data acquired by the acquisition unit 122.

  The instruction unit 124 generates various instructions in cooperation with the short-range wireless communication unit 117, and transmits the instructions to an external device. Specifically, the instruction unit 124 performs an instruction transmission process of generating image acquisition instruction data and transmitting the generated image acquisition instruction data to the mobile terminal device 20.

[2.2] Each Process Executed in Karaoke Device Next, details of each process executed in the karaoke device 10 of the present embodiment will be described.

(Access user addition processing)
The registration unit 123 enables communication between the karaoke device 10 and the portable terminal device 20 owned (operated) by each user, and adds data on the communicable portable terminal device 20 to the access user data.
(1) Receive a use registration instruction including a user ID and a terminal ID from the portable terminal device 20 via the short-range wireless communication unit 117,
(2) acquiring data related to the user ID acquired in (1) from the management server device 30;
(3) The user ID of (1) is compared with the user ID of (2),
(4) If the user IDs match, the portable terminal device 20 identified by the corresponding terminal ID and the karaoke device 10 can communicate, and the user ID, the user name, and the terminal ID are added to the access user data, It has a function of executing processing to be stored in the storage unit 119.

  For example, when the acquisition unit 122 receives a use registration instruction including the user ID “User001”, the user name “AAA”, and the terminal ID “M001”, the registration unit 123 stores the access user data as shown in FIG. “User001” is added to the user ID column, “AAA” is added to the user name column, and “M001” is added to the terminal ID column, and the access user data is updated.

(Reception processing)
The mobile terminal device 20 of the image setting user executes a reservation process or an image setting data generation process. The mobile terminal device 20 transmits to the karaoke device 10 the reservation data including the generated music ID and the singer user ID, or the setting data including the music ID and the image identification data.

  Then, the acquisition unit 122 receives the reservation data or the setting data transmitted from the mobile terminal device 20 of the image setting user via the short-range wireless communication unit 117.

  In particular, in the reservation process, the acquisition unit 122 of the present embodiment performs the reservation data or the setting data not only before the karaoke data is reproduced by the karaoke reproduction unit 113, but also during the reproduction of the karaoke data by the karaoke reproduction unit 113. Is accepted.

  In addition, the acquisition unit 122 not only receives the setting data before the reproduction of the karaoke data of the reserved music, but also receives the setting data for the karaoke data being reproduced.

(Reservation processing)
When the acquisition unit 122 acquires the setting data or the reservation data by the reception process, the registration unit 123 adds the setting data or the reservation data acquired by the acquisition unit 122 to the reservation list data in the storage unit 119 and updates the reservation list data.

  Specifically, when only the setting data is acquired, the acquiring unit 122 specifies the corresponding reservation data in the reservation list data based on the music ID included in the setting data, and sets the specified reservation data to the specified reservation data. Add content.

  When the setting data and the reservation data are acquired, the content of the setting data is added when the reservation data is newly added to the reservation list data.

  For example, the acquisition unit 122 includes a music ID “12345”, a singing user ID “User001”, an external video flag indicating an external video, and an external image address “https: // OOOOOOOOOOO”. A case where image identification data and setting data including the image setting user ID “User002” are acquired will be described.

  In this case, as illustrated in FIG. 5, the registration unit 123 sets “12345” in the song ID column, “User001” in the singing user ID column, “○” in the external image column, “Https: // XXXXXXXXXXXX” is added to the external image address column, and “User002” is added to the image setting user ID column.

  Further, for example, a case will be described in which the acquisition unit 122 has acquired reservation data including a music ID “12348” and a singing user ID “User003”.

  In this case, as illustrated in FIG. 5, the registration unit 123 adds “12348” to the song ID column and “User003” to the singing user ID column in the reservation list data.

  Note that when the registration unit 123 acquires the setting data having the image identification data for the karaoke data being reproduced, that is, when acquiring the setting data including no music ID and including only the image identification data, the registration unit 123 performs the reservation. This is instructed to the instruction unit 124 without adding to the list data.

  The instruction unit 124 executes an instruction transmission process for displaying the setting image data for the karaoke data being reproduced, as described later.

(Karaoke data acquisition processing)
The communication control unit 111 works with the control unit 118 to acquire karaoke data based on the music ID stored in the reservation list data in the storage unit 119. Specifically, the control unit 118 acquires the music ID of the karaoke data to be reproduced (karaoke data having the earliest reproduction order of the reservation list data) with reference to the reservation list data. The communication control unit 111 acquires, from the management server device 30, karaoke data indicated by the music ID acquired by the control unit 118.

  For example, as shown in FIG. When “1” is a playback target, the control unit 118 acquires the music ID “12345” from the reservation list data. The communication control unit 111 acquires the karaoke data indicated by the music ID “12345” acquired by the control unit 118 from the management server device 30.

(Instruction transmission processing)
The instruction unit 124 is linked with the control unit 118, and based on the singing user ID associated with the song ID of the karaoke data reproduced by the karaoke reproducing unit 113 and the image identification data, the image data indicated by the image identification data. Is generated and transmitted to the portable terminal device 20 of the user indicated by the singing user ID of the generated image acquisition instruction data.

  Specifically, the instruction unit 124 refers to the reservation list data in the storage unit 119 and determines the image identification data associated with the music ID of the karaoke data to be reproduced.

  The instruction unit 124 refers to the external image flag and the internal image flag of the determined image identification data, and determines whether the image data indicated by the image identification data is external image data that is external image data of the mobile terminal device 20; It is determined whether the image data is internal image data that is image data inside the mobile terminal device 20.

  If the image data is external image data, the instruction unit 124 determines the singing user ID associated with the image identification data with reference to the reservation list data in the storage unit 119.

  Further, the instruction unit 124 refers to the access user data in the storage unit 119 and determines whether communication with the mobile terminal device 20 of the singing user indicated by the determined singing user ID is possible.

  When the singing user can communicate with the mobile terminal device 20, the instruction unit 124 generates image acquisition instruction data including at least the external moving image address of the determined image identification data, and the generated image acquisition instruction data is a short-range wireless communication. It is transmitted to the mobile terminal device 20 of the singing user via the communication unit 117.

  For example, as shown in FIG. When “1” is a playback target, the instruction unit 124 determines that the image data indicated by the image identification data is external image data. Then, when the instruction unit 124 can communicate with the mobile terminal device 20 of the user indicated by the singing user ID “User001”, the instruction unit 124 acquires an image including the external moving image address “https: // OOOOOOOOOOO”. The instruction data is generated, and the generated image acquisition instruction data is transmitted to the mobile terminal device 20 of the singing user indicated by the singing user ID “User001”.

  On the other hand, when communication with the mobile terminal device 20 of the singing user is not possible, the instruction unit 124 refers to the access user and determines whether communication with the mobile terminal device 20 of the image setting user indicated by the image setting user ID is possible. I do.

  Then, when communication with the portable terminal device 20 of the image setting user is possible, the instruction unit 124 generates image acquisition instruction data including at least the external moving image address of the determined image identification data, and the generated image acquisition instruction data is The image is transmitted to the portable terminal device 20 of the image setting user via the distance wireless communication unit 117.

  For example, as shown in FIG. When “1” is a reproduction target, communication with the singing user's mobile terminal device 20 indicated by the singing user ID “User001” is disabled, and the image setting user's mobile terminal device 20 indicated by the image setting user ID “User002” When communication is possible, the instruction unit 124 generates image acquisition instruction data including the external moving image address “https: // XXXXXXXXXXXX”, and the generated image acquisition instruction data is the image setting user. The image is transmitted to the portable terminal device 20 of the image setting user indicated by the ID “User002”.

  When the image data indicated by the image identification data is the internal image data, the instruction unit 124 determines the image setting user ID associated with the song ID of the karaoke data to be reproduced with reference to the reservation list data. . Then, referring to the access user, the instruction unit 124 determines whether or not communication with the user indicated by the determined image setting user ID, that is, the mobile terminal device 20 of the image setting user is possible.

When the image setting instruction data can be communicated with the user's mobile terminal device 20, the instruction unit 124 generates internal image acquisition instruction data, and the generated internal image acquisition instruction data is used for image setting via the short-range wireless communication unit 117. It is transmitted to the portable terminal device 20 of the user.

  For example, as shown in FIG. When “2” is a playback target, the instruction unit 124 determines that the image data is internal image data. When the instruction unit 124 can communicate with the singing user's mobile terminal device 20 indicated by the singing user ID “User003”, the instructing unit 124 generates internal image acquisition instruction data, and the generated internal image acquisition instruction data includes the singing user ID “ "User003" is transmitted to the portable terminal device 20 of the user.

  In any of the following cases, the instruction unit 124 generates and generates data for acquiring general-purpose image data stored in the external storage device 40 (hereinafter, referred to as “general-purpose image acquisition instruction data”). The obtained general-purpose image acquisition instruction data is transmitted to the management server device 30 via the network N.

(1) When the image identification data is not stored in the reservation list data (2) The image data indicated by the image identification data is an external image and cannot communicate with the portable terminal devices 20 of both the singing user and the image setting user. Case (3): When the image data is an internal image and communication with the portable terminal device 20 of the image setting user is not possible

  For example, in the reservation list data table of FIG. When “4” is a reproduction target, the instruction unit 124 generates general-purpose image acquisition instruction data, and transmits the general-purpose image acquisition instruction data to the management server device 30 via the network N. However, the general-purpose image data may be stored in the storage unit 119. In this case, the instruction unit 124 acquires the general-purpose image data from the storage unit 119.

(Music playback processing and image display processing)
When the instruction transmitting process is completed, the karaoke reproducing unit 113 reproduces the music data included in the karaoke data acquired by the karaoke data acquiring process in conjunction with the acquiring unit 122.

  Then, the display control unit 116 displays the acquired image data while acquiring the image data received in the instruction transmission process while the music data is being reproduced by the karaoke reproduction unit 113 in cooperation with the acquisition unit 122. It is displayed on the section 115.

  For example, when the image acquisition instruction data is transmitted to the singing user's mobile terminal device 20 in the instruction transmission process, the singing user's mobile terminal device 20 sets the setting image data from the data providing server device 80 based on the image acquisition instruction data. And transmits the setting image data to the karaoke apparatus 10.

  Then, the display control unit 116 displays the acquired setting image data while acquiring the setting image data transmitted from the portable terminal device 20 of the singing user based on the image acquisition instruction data during the reproduction of the karaoke data. It is displayed on the section 115.

  Further, for example, when the image acquisition instruction data is transmitted to the image setting user's mobile terminal device 20 in the instruction transmission process, the image setting user's mobile terminal device 20 transmits the data provision server device 80 based on the image acquisition instruction data. , And transmits the setting image data to the karaoke apparatus 10.

  Then, during the reproduction of the karaoke data, the display control unit 116 acquires the setting image data transmitted from the portable terminal device 20 of the image setting user based on the image acquisition instruction data, and displays the acquired setting image data. It is displayed on the display unit 115.

  Further, for example, when the internal image acquisition instruction data is transmitted to the image setting user's mobile terminal device 20 in the instruction transmission process, the image setting user's mobile terminal device 20 performs, based on the internal image acquisition instruction data, The image data to be displayed is determined from the image data stored in the terminal storage unit 230, and the determined setting image data is transmitted to the karaoke apparatus 10.

  The display control unit 116 acquires the setting image data transmitted from the mobile terminal device 20 of the image setting user based on the internal image acquisition instruction data during the reproduction of the karaoke data. Is displayed on the display unit 115.

  For example, when the general-purpose image acquisition instruction data is transmitted to the management server device 30 in the instruction transmission process, the management server device 30 transmits the image data from the karaoke data DB 402 of the external storage device 40 based on the general-purpose image acquisition instruction data. Is determined, and the determined general-purpose image data is transmitted to the karaoke apparatus 10.

  Then, during the reproduction of the karaoke data, the display control unit 116 acquires the general-purpose image data transmitted from the management server device 30 based on the general-purpose image acquisition instruction data, and displays the acquired general-purpose image data on the display unit 115. Display.

  Note that the display control unit 116 may use general-purpose image data stored in the storage unit 119.

[2.3] Portable Terminal Device Next, the configuration and operation of the portable terminal device 20 of the present embodiment will be described with reference to FIG. FIG. 6 is a configuration diagram illustrating a configuration of the mobile terminal device 20 according to the present embodiment.

  As shown in FIG. 6, the portable terminal device 20 of the present embodiment includes a network communication unit 210 that is connected to the network N, a short-range wireless communication unit 220 that performs short-range wireless communication with the karaoke device 10, and various types of A terminal storage unit 230 that stores data, a terminal data processing unit 240 that executes each process, a terminal display unit 250, a terminal display control unit 260 that controls display of an image on the terminal display unit 250, and a touch panel. An operation unit 270 and a terminal management control unit 280 are provided.

  The components of the mobile terminal device 20 are interconnected by a bus B, and perform transmission and reception of data.

  The network communication unit 210 is a predetermined network interface, and under the control of the terminal data processing unit 240 and the terminal management control unit 280, the management server device 30 or the data providing server device connected to the network N via the base station BS. 80, and exchanges various data with the management server device 30 or the data providing server device 80.

  The short-range wireless communication unit 220 communicates with the karaoke apparatus 10 in a short-range according to infrared communication such as IrDA (Infrared data Association), or short-range wireless communication standards such as Bluetooth (registered trademark), IEEE 802.15.4, or wireless LAN. A wireless network is constructed to exchange data with the karaoke device 10.

  The communication between the mobile terminal device 20 and the karaoke device 10 may be executed via the network N or the management server device 30.

  The terminal storage unit 230 is configured by, for example, an electrically erasable programmable read only memory (EEPROM) or a flash memory.

  The terminal storage unit 230 includes: an application storage unit 231 in which various applications are stored; a setting data storage unit 232 in which reservation data or setting data generated by the terminal data processing unit 240 is stored; An image acquisition instruction data storage unit 233 for storing the received image acquisition instruction data, and a RAM 234 functioning as a work area while the operation application is running.

  In particular, the various applications include a touch panel operation application for operating the karaoke apparatus 10 including a setting operation for setting setting image data to be displayed during the reproduction of the karaoke data.

  The terminal data processing unit 240 is configured by an independent central processing unit (CPU) or a central processing unit (CPU) of the terminal management control unit 280, and performs various data processing according to an application stored in the application storage unit 231. Execute

  In particular, the terminal data processing unit 240 performs a process of adding data related to the user stored in the terminal storage unit 230 to the user management DB 401 of the external storage device 40 in cooperation with the management server device 30.

  Further, the terminal data processing unit 240 works with the karaoke device 10 and the management server device 30 to determine karaoke data to be reproduced in the karaoke device 10 from the karaoke data DB 402 of the external storage device 40 based on a user's operation input. Execute the reservation process.

  Then, the terminal data processing unit 240 operates in conjunction with the karaoke device 10 and the management server device 30 to generate reservation data and setting data for setting image data to be displayed during the reproduction of the karaoke data in the karaoke device 10. Execute image setting data generation processing.

(Reservation processing)
In particular, the reservation process executed in the terminal data processing unit 240 is based on the premise that the user has logged in to the karaoke communication system.
(A1) A song is determined based on a singer, a song name, a keyword, or the like according to a user operation;
(A2) Acquire the song ID of the determined song from the karaoke data DB 402 stored in the external storage device 40,
(A3) One or more portable terminal devices 20 capable of communicating with the karaoke device 10 are listed from the access user data, and the user ID of the operator (that is, the reserved user identification data of the logged-in user, for example, Login ID) is determined as the singing user ID, or the user ID of another user is determined as the singing user ID,
(A4) The reservation data including the music ID and the singing user ID is transmitted to the karaoke device 10, and the karaoke device 10 adds the music ID and the singing user ID to the reservation list data based on the received reservation data.

  In the process (A3), the terminal data processing unit 240 causes the terminal display unit 250 to display a selection menu of the singing user based on the acquired access user data, and selects one user including the operator from the menu. The ID may be determined, or the user ID of the logged-in user may be automatically determined.

(Image setting data generation processing)
Image setting data generation processing executed in the terminal data processing unit 240 includes:
(B1) Obtain reservation list data provided in the karaoke apparatus 10,
(B2) acquiring image identification data (for example, URL) for identifying image data to be displayed during the reproduction of the karaoke data based on a user's operation input;
(B3) Setting data including the user ID of the operator and the acquired image identification data is generated as the image setting user ID.

  Note that the terminal data processing unit 240 performs an image setting data generation process of setting the setting image data together with the generation of the reservation data, or an image of the setting data for displaying the setting image data for the karaoke data being reproduced. When executing the setting data generation processing, the processing of the above (B2) and (B3) may be executed without acquiring the reservation list data.

  When displaying the setting image data on the music being reproduced, the terminal data processing unit 240 may generate the setting data including only the image identification data without including the music ID.

  Specifically, when acquiring the image identification data, the terminal data processing unit 240 causes the terminal display control unit 260 and the operation unit 270 to execute a predetermined application in conjunction with the internal image data or the external image data. A setting data including a flag indicating whether the setting is internal image data, a stored folder name in the case of internal image data, and an external address in the case of external image data is generated.

  Note that the terminal data processing unit 240 may simultaneously execute the reservation process and the image setting data generation process. In this case, the terminal data processing unit 240 executes the image setting data generation processing at the time of the reservation processing to generate the reservation data and the setting data, and transmits the reservation data and the setting data to the karaoke apparatus 10.

  On the other hand, the terminal data processing unit 240 executes each process of setting to enable communication with the mobile terminal device 20 in cooperation with the karaoke device 10 and the management server device 30.

  The terminal display unit 250 includes an image display area of a predetermined size (for example, 5 inches, W480 × H960 pixels), is configured by a panel of a liquid crystal element or an EL (Electro Luminescence) element, and generated by the terminal display control unit 260. A predetermined image is displayed based on the display data.

  Further, the terminal display unit 250 displays an instruction image that accepts various operation instructions of the karaoke device 10 in conjunction with the operation unit 270.

  The terminal display control unit 260 generates display data for displaying a predetermined image on the terminal display unit 250 under the control of the terminal data processing unit 240 and the terminal management control unit 280, and displays the terminal display based on the generated display data. The unit 250 displays a predetermined image.

  The operation unit 270 is a touch panel including a touch sensor provided on the terminal display unit 250, and includes various confirmation buttons, operation buttons for inputting operation commands, and other keys. Used when performing operations.

  The terminal management control unit 280 is mainly configured by a central processing unit (CPU), includes various input / output ports such as a key input port and a display control port, and has overall functions of the mobile terminal device 20 and various functions. Controls general functions for executing programs.

  In particular, the terminal management control unit 280 transmits the setting data generated by the terminal data processing unit 240 to the karaoke device 10 via the short-range wireless communication unit 220.

  Further, the terminal management control unit 280 receives the image acquisition instruction data transmitted from the karaoke device 10 via the short-range wireless communication unit 220. Then, the terminal management control unit 280 causes the data providing server device 80 to transmit the image acquisition request data via the network communication unit 210.

  Further, the terminal management control unit 280 acquires the setting image data transmitted from the data providing server device 80 based on the image acquisition request data via the network communication unit 210. Then, the terminal management control unit 280 transmits the acquired setting image data to the karaoke device 10 via the short-range wireless communication unit 220.

[3] Operation of Karaoke Apparatus Next, the operation of the karaoke data reproduction processing executed by the karaoke apparatus 10 of the present embodiment will be described with reference to FIGS. FIGS. 7 and 8 are flowcharts showing the karaoke data reproduction processing executed by the karaoke apparatus 10 of the present embodiment.

  In this operation, prior to the following processing, the user management DB 401 in the external storage device 40 and the karaoke data DB 402 have various data. The storage unit 119 of the karaoke apparatus 10 stores data exemplified in FIGS.

  In this operation, it is assumed that the karaoke apparatus 10 is energized (power is on) and is in a reservation standby state.

  First, the control unit 118 refers to the reservation list data in the storage unit 119 at a predetermined timing in the reservation standby state, and determines whether or not there is reservation data, that is, karaoke data to be reproduced (step S101). ).

  At this time, if the control unit 118 determines that there is no reservation data, it ends this operation and returns to the reservation standby state, and if it determines that there is reservation data, the communication control unit 111 The karaoke data is acquired from the external storage device 40 on the basis of the music ID (step S102).

  Next, the instruction unit 124 refers to the image identification data of the reservation list data, and determines whether image data to be displayed during the reproduction of the karaoke data to be reproduced is set (step S103).

  At this time, when the instruction unit 124 determines that the image data is not set, the instruction unit 124 transmits the general-purpose image acquisition instruction data to the management server device 30 via the communication control unit 111 (step S104), and proceeds to step S201. Move to.

  On the other hand, when determining that the image data is set, the instruction unit 124 refers to the image identification data of the reservation list data in the storage unit 119, and determines whether the set image data is external image data. Is determined (step S105).

  At this time, if the instruction unit 124 determines that the image data is not external image data of the mobile terminal device 20, that is, if it determines that the image data is internal image data stored inside the mobile terminal device 20, Referring to the user data, it is determined whether or not communication with the mobile terminal device 20 of the image setting user indicated by the image setting ID is possible (step S106).

  If the instruction unit 124 determines in the process of step S106 that communication with the portable terminal device 20 of the image setting user is impossible, the process proceeds to step S104. If it is determined that communication is possible with the mobile terminal device 20 of the image setting user, the internal image acquisition instruction data is transmitted to the mobile terminal device 20 of the image setting user via the short-range wireless communication unit 117 (step S107). , To step S201.

  Next, in the process of step S105, when determining that the set image data is the external image data, the instruction unit 124 refers to the access user data and refers to the singing user's mobile terminal device 20 indicated by the singing user ID. It is determined whether or not communication is possible (step S108).

  At this time, when the instruction unit 124 determines that communication with the mobile terminal device 20 of the singing user is possible, the instruction unit 124 transmits the external image acquisition instruction data to the mobile terminal device 20 of the singing user via the short-range wireless communication unit 117. Transmit (step S109), and proceed to step S201.

  If the instruction unit 124 determines that communication with the mobile terminal device 20 of the singing user is not possible, the instruction unit 124 refers to the access user data and determines whether communication with the mobile terminal device 20 of the image setting user indicated by the image setting ID is possible. A determination is made (step S110).

  At this time, the instruction unit 124 proceeds to step S104 when it is determined that communication with the image setting user's mobile terminal device 20 is not possible, and when it is determined that communication with the image setting user's mobile terminal device 20 is possible, The external image acquisition instruction data is transmitted to the portable terminal device 20 of the image setting user via the short-range wireless communication unit 117 (step S111), and the process proceeds to step S201.

  Next, the karaoke reproducing unit 113 and the display control unit 116 acquire the karaoke data and the general-purpose image data or the setting image data instead of the general-purpose image data in conjunction with the acquisition unit 122 via the communication control unit 111. Based on the obtained karaoke data, the display processing of the lyrics data, the reproduction processing of the music data, and the image data display processing based on the general-purpose image data or the setting image data are started (step S201).

  For example, when performing the processing of step S201 via step S104, the display control unit 116 causes the display unit 115 to display the general-purpose image data and the lyrics data acquired from the external storage device 40.

  Further, for example, when the process of step S201 is performed via step S107, the display control unit 116 displays the internal image data and the lyrics data acquired from the mobile terminal device 20 of the image setting user on the display unit 115. To be displayed.

  Further, for example, when performing the processing of step S201 via step S109, the display control unit 116 displays the external image data and the lyrics data acquired from the portable terminal device 20 of the singing user on the display unit 115. To be displayed.

  Then, for example, when executing the processing of step S201 via step S111, the display control unit 116 displays the external image data and the lyrics data acquired from the mobile terminal device 20 of the image setting user on the display unit 115. To be displayed.

  In the process of step S201, the karaoke reproducing unit 113 executes the reproduction of the music data and the display of the lyrics data based on the corresponding karaoke data regardless of the step.

  Next, the acquiring unit 122 determines whether or not the setting data transmitted from the portable terminal device 20 capable of accessing the karaoke data being reproduced is received based on the reservation list data (Step S202).

  At this time, if the acquisition unit 122 determines that the setting data transmitted from the mobile terminal device 20 has not been received, the control unit 118 determines whether to end the reproduction of the karaoke data (step S203). .

  If it is determined that the reproduction of the karaoke data is not to be ended (that is, to be continued), the control unit 118 proceeds to step S202. Transition.

  On the other hand, in the process of step S202, if the setting unit 122 determines that the setting data is accepted, the control unit 118 specifies the karaoke data in the setting data, that is, associates the song ID with the song ID. It is determined whether or not there is (step S204).

  If the control unit 118 determines that the music ID is associated, the control unit 118 updates the reservation list data by associating the image ID data included in the setting data with the music ID of the corresponding reservation data in the reservation list data. (Step S205) If the process proceeds to step S202, but determines that the music ID is not associated, the control unit 118 proceeds to step S105.

  Next, if the control unit 118 determines in the process of step S203 that the reproduction of the karaoke data has ended, the control unit 118 transmits data indicating an instruction to end the reproduction operation to the portable terminal device 20 that supplies the image data. (Step S206). At this time, the control unit 118 deletes the reservation data related to the karaoke data from the reservation list data.

  Next, the control unit 118 refers to the reservation list data in the storage unit 119 again and determines whether or not there is reservation data (step S207).

  At this time, when the control unit 118 determines that there is reservation data, the control unit 118 shifts to the process of step S102, and when it determines that there is no reservation data, shifts to the reservation standby state (step S208). End the operation.

  As described above, the image acquisition instruction data to be displayed during the reproduction of the karaoke data is transmitted to the portable terminal device of the user who sings the song of the karaoke data, and the image data is transmitted from the portable terminal device during the reproduction of the karaoke data. While acquiring, the acquired image data can be displayed on the display unit.

  Therefore, in the karaoke communication system 1 of the present embodiment, even if the user who has set the image data is different from the user who sings the song of the karaoke data being reproduced, another user other than the user who is singing himself or herself Can be used as usual.

[4] Modification [4.1] Modification 1
In the embodiment, the image data displayed during the reproduction of the karaoke data is the moving image data, but may be the still image data.

  For example, a plurality of still image data are stored in the data providing server device 80, and the portable terminal device 20 of the singing user provides the still image data at regular intervals (for example, 10 seconds) based on the image acquisition instruction data. It is acquired from the server device 80 and transmitted to the karaoke device 10.

  Then, the display control unit 116 of the karaoke device 10 displays the still image data transmitted from the portable terminal device 20 of the singing user on the display unit 115, and switches the display at regular intervals.

  The image data displayed during the reproduction of the karaoke data may be a combination of moving image data and still image data.

  For example, the instruction unit 124 of the karaoke device 10 transmits image acquisition instruction data for causing the mobile terminal device 20 of the singing user or the image setting user to acquire moving image data or still image data based on the reproduction state of the karaoke data.

  Then, the display control unit 116 executes a mixed display control process of displaying the moving image data and the still image data received from the mobile terminal device 20 in combination.

  In the mixed display control process, for example, the instruction unit 124 transmits image acquisition instruction data for acquiring partial data of moving image data from a series of moving image data when the chorus part of the karaoke data is being reproduced, When a portion other than the rust portion is being reproduced, image acquisition instruction data for acquiring still image data from the series of moving image data may be transmitted.

[4.2] Modification 2
In the embodiment, the karaoke apparatus 10 based on the singing sound of the singer has been described, but the present invention can also be applied to the karaoke apparatus 10 or the karaoke communication system 1 based on the sound of a musical instrument such as a guitar or a drum. In this case, the karaoke apparatus 10 may acquire the musical instrument sound or the musical instrument signal using the microphone M or another input device.

[4.3] Modification 3
The management server device 30 in the embodiment may be configured by one server device, or may be configured as a system by a plurality of server devices. Further, the DB 401 and the DB 402 of the external storage device 40 may be constituted by one database or a plurality of databases.

1 Karaoke communication system 10 Karaoke device 20 Portable terminal device 30 Management server device 40 Storage device 50 Store 80 Data providing server device 111 Communication control unit 112 Voice input / output unit 113 Karaoke playback unit 114 Voice amplification unit 115 Display unit 116 Display control unit 117 Short-range wireless communication unit 118 Control unit 119 Storage unit 120 Data processing unit 121 ROM / RAM
122 acquisition part 123 registration part 124 instruction part 210 network communication part 220 short-range wireless communication part 230 terminal storage part 240 terminal data processing part 250 terminal display part 260 terminal display control part 270 operation part 280: terminal management control unit 401: user management DB
402… DB for karaoke data

Claims (6)

A karaoke device capable of communicating with a user's portable terminal device,
Receiving means for receiving setting data including at least image identification data for identifying image data to be displayed during reproduction of music data;
Storage control means for storing the image identification data included in the setting data, the music identification data for identifying the music data, and the singing user identification data for identifying the user singing the music of the music data in the storage means; ,
Acquisition means for acquiring music data based on the music identification data stored by the storage control means,
Music playback means for playing back the music data acquired by the acquisition means,
Image acquisition instruction data for acquiring image data indicated by the image identification data based on the singing user identification data and the image identification data associated with the music identification data of the music data reproduced by the music reproduction means. Instruction transmitting means for transmitting to the mobile terminal device of the user indicated by the singing user identification data,
During the reproduction of the music data, while acquiring the image data transmitted from the portable terminal device based on the image acquisition instruction data transmitted by the instruction transmitting means, the acquired image data is displayed on the display unit. Display control means for displaying,
A karaoke apparatus comprising: The karaoke apparatus according to claim 1,
The receiving means,
Receiving the setting data for the music data being played by the music playing means,
The instruction transmitting means,
Based on the image identification data included in the setting data and the singing user identification data associated with the song identification data of the music data being reproduced, the image is displayed on the portable terminal device of the user indicated by the singing user identification data. A karaoke apparatus for transmitting the image acquisition instruction data for acquiring image data indicated by identification data. The karaoke device according to claim 1 or 2,
The setting data includes at least the image identification data, image setting user identification data that identifies a user who sets the image data indicated by the image identification data,
The instruction transmitting means,
Determine whether it is possible to communicate with the user's mobile terminal device indicated by the singing user identification data,
A karaoke apparatus characterized by transmitting the image acquisition instruction data to the portable terminal device of the user indicated by the singing user identification data, when the communication is possible with the portable terminal device of the user indicated by the singing user identification data. The karaoke device according to claim 3,
The instruction transmitting means,
A karaoke apparatus characterized by transmitting the image acquisition instruction data to the user's portable terminal device indicated by the image setting user identification data when communication with the user's portable terminal device indicated by the singing user identification data is not possible. The karaoke apparatus according to any one of claims 1 to 4,
The image data is moving image data or still image data,
The instruction transmitting means,
Based on the reproduction status of the music data, the mobile terminal device transmits the image acquisition instruction data to acquire the moving image data or the still image data,
The display control means,
A karaoke apparatus, wherein the karaoke apparatus performs a mixed display control process for combining and displaying the moving image data and the still image data received from the portable terminal device. A program for controlling a karaoke device capable of communicating with a user's portable terminal device by a computer,
Said computer,
Receiving means for receiving setting data including at least image identification data for identifying image data to be displayed during reproduction of music data,
Storage control means for storing image identification data included in the setting data, music identification data for identifying the music data, and singing user identification data for identifying a user who sings a song of the music data in a storage means,
Acquisition means for acquiring music data based on the music identification data stored by the storage control means,
Music playback means for playing back the music data acquired by the acquisition means,
Image acquisition instruction data for acquiring image data indicated by the image identification data based on the singing user identification data and the image identification data associated with the music identification data of the music data reproduced by the music reproduction means. From the mobile terminal device based on the image acquisition instruction data transmitted by the instruction transmission unit during the reproduction of the music data, and to the mobile terminal device of the user indicated by the singing user identification data. Display control means for displaying the acquired image data on the display unit while acquiring the transmitted image data,
A program characterized by functioning as a program.

Images