JP5582797B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method, and a program , and more particularly, to a technique suitable for use in receiving and reproducing media data via a network.

  In recent years, many home appliances using a network have become widespread, and digital AV devices and personal computers (PCs) can be connected to each other in a home network. Along with this, a technical specification called DLNA (Digital Living Network Alliance) has been stipulated in order to formulate specifications for mutual use of media data such as moving images, music, and still images.

  In the DLNA guidelines, a server that provides media data is defined as DMS (Digital Media Server), and a client to be played back is defined as DMP (Digital Media Player). The DLNA guidelines define the connection conditions between the DMS and DMP. As a result, devices that comply with the DLNA guidelines can be connected to each other by simply connecting the lines without requiring special settings, and can share media data. For example, media data such as movies, music, and still image files stored on a PC having a server function or a LAN connection type hard disk can be accessed via a LAN and played back by a network media player (DMP). it can.

  UPnP is an example of a protocol that is the basis of this DLNA guideline. Furthermore, UPnP-AV is used as a protocol for using media data such as video and music through a network based on UPnP. This UPnP-AV does not stipulate the transfer method of the media data file itself, but stipulates a service related to information such as metadata attached to the media data file, a service related to connection, and the like. In particular, in a service called CDS (Content Directory Service), accompanying information (metadata) of a media data file can be acquired, and the metadata can be created, deleted, or modified.

  This metadata describes a URL for transferring a media data file. By accessing this URL, the media data file can be transferred by a GET command of the HTTP protocol. For example, Patent Document 1 discloses a system that manages metadata of media data files provided via a network.

JP 2005-216171 A

  As described above, in order to play media data such as moving images and still images by DMP through a network, CDS, which is a service for acquiring the metadata, is required. In order to reproduce more media data desired by the user through DMP via the DMP, as a function of this CDS, a media data file containing contents more in accordance with the user's intention is included. A playlist is required. However, the conventional system has a problem that it is not possible to create a media data reproduction list that sufficiently reflects the user's intention.

An object of the present invention is to provide an information processing apparatus, an information processing method, and a program capable of creating a content reproduction list according to a user's intention.

An information processing apparatus according to the present invention includes a receiving unit that receives a setting of a content to be extracted from content recorded in a recording unit, and a content that includes an image of a predetermined person or object. If it is a setting to be extracted, and if the received setting is a setting for extracting content including an excitement of audio, the content recorded in the recording means is transmitted to the search device, and the received setting is determined in advance. 1st transmission for transmitting the metadata associated with the content recorded in the recording means to the search device when it is set to extract the content associated with the metadata corresponding to the region included in the region and means, the location of the content that the search device from a content transmitted to the retrieval device in accordance with the setting out extraction To the content list, and a holding means for holding a content list indicating the location of the content in accordance with the set a content metadata the retrieval device is extracted from the meta data transmitted to the retrieval device is associated, And a second transmission unit configured to transmit the list information to the reproduction apparatus in response to a request for obtaining list information indicating one or more content lists held in the holding unit.

  According to the present invention, a user can obtain a playlist that includes more desired content.

It is a figure which shows an example of the network structure of a media data delivery system. It is a block diagram which shows the structural example of the camera adapter apparatus which concerns on embodiment. It is a block diagram which shows the structural example of the media player which concerns on embodiment. It is a timing chart which shows an example of the operation | movement procedure of a system. It is a figure which shows the example which described the content list in XML.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram illustrating an example of a network configuration of a media data distribution system according to the present embodiment.
As shown in FIG. 1, a camera adapter device 100 is equipped with a camera 200 such as a digital still camera or a digital video camera. The camera 200 is taken out by a user in a state where a battery or a battery is attached, and a still image or a moving image is taken and attached to the camera adapter device 100. The camera adapter device 100 can distribute media data of an image taken by the camera 200 to the media player 400 via the router 600 with a wireless access point function.

  The recognition / search information engine PC 300 is a personal computer (PC) equipped with a function for creating accompanying information (metadata) of media data files, and is connected to the home network 500. The recognition / search information engine PC 300 searches the media data generated by the camera 200 for the contents set in the installed search engine, and creates the reproduction position information of the media data based on the result. Make a notification. This search engine is equipped with functions of a recognition engine for recognizing and discriminating a person or an object included in a still image or a moving image, or an engine for detecting a voice or the like by detecting a voice level. Furthermore, the media data generated by the camera 200 is also equipped with a function such as a position information engine that extracts data in a range set by the user from GPS data given at the time of shooting.

  The router 600 is a router with a wireless access point, performs wireless communication with the camera adapter device 100, and mediates connection with the home network 500. The media player 400 receives the media data distributed from the camera adapter device 100, decodes each media data encoded by various formats, and outputs it to the television monitor 700. The display device 800 is a display device having a media player function, and is a device such as a digital photo frame, for example. Communication of media data and the like is performed by communication complying with the Content Directly Service standard (CDS standard) defined by UPnP.

Hereinafter, the overall operation of the media data distribution system in the network configuration shown in FIG. 1 will be described in detail.
FIG. 2 is a block diagram illustrating a configuration example of the camera adapter device 100 according to the present embodiment.
In FIG. 2, the power supply unit 102 is for supplying power via the power cable 109 when the camera 200 is connected to the camera adapter device 100. That is, when the camera 200 is connected to the camera adapter apparatus 100 with a battery mounted, power is supplied to charge the battery. The USB I / F 103 is a communication interface that exchanges media data and control data with the camera 200 through the USB cable 108.

  The flash memory 106 is an electrically erasable / recordable nonvolatile memory. The switch button 107 is an operation unit including various buttons and a touch panel. For example, when the switch button 107 is pressed, media data recorded on a recording medium such as an SD card of the camera 200 is input. Then, uploading or the like is performed to an external storage device via the wireless LAN I / F 104 of the camera adapter device 100, the router 600, and the home network 500. In addition, the wireless LAN I / F 104 packetizes and transmits media data, and measures adaptation of wireless communication with the router 600 via the antenna unit 105. The system control unit 101 is for controlling the camera adapter device 100 as a whole, and detects and gives instructions to the power supply unit 102, the USB I / F 103, and the wireless LAN I / F 104.

FIG. 3 is a block diagram illustrating a configuration example of the media player 400 according to the present embodiment.
In FIG. 3, a LAN I / F unit 401 receives packet data of media data distributed from the camera adapter device 100 while measuring adaptation of the home network 500, and performs depacketization. Then, the depacketized media data is output to the transport decoder 402. The transport decoder 402 extracts multiplexed still image data, moving image data, and audio data from the media data input from the LAN I / F unit 401. Then, still image data and moving image data are output to the video decoder 403, and audio data is output to the audio decoder 404.

  The video decoder 403 performs decoding processing such as JPEG on the still image data input from the transport decoder 402, and H.264 for the moving image data. A decoding process such as H.264 is performed. The decoded still image data and moving image data are output to the display control unit 405. The audio decoder 404 performs decoding processing such as MP3 and Dolby Digital on the audio data input from the transport decoder 402 and outputs the decoded audio data to the audio DA 407.

  The display control unit 405 is for switching the screen or multiplexing and outputting to the video DA 406. In addition, the display control unit 405 performs video so that a character signal related to the operation and the still image data or moving image data output from the video decoder 403 are combined and displayed in accordance with the operation of the operation unit 410 or the remote controller 413. The video signal is output to the DA 406.

  The video DA 406 converts the video signal input from the display control unit 405 into an analog signal, and outputs the video signal from the D terminal or the like to the television monitor 700. The audio DA 407 converts the audio data input from the audio decoder 404 into an analog signal, and outputs the audio signal to an audio output device (not shown) such as a speaker. Note that the video signal and the audio signal may be output to an external device as digital signals such as HDMI without being converted into analog signals. In this case, the video DA 406 and the audio DA 407 may not have an analog signal conversion function.

  The USB I / F unit 408 is for transferring media data when connected to an external storage device or the like using a cable. When the media data to be transferred needs to be decoded, the media data is once output to the transport decoder 402, and the processing as described above is performed. The decoded media data is output to the display control unit 405.

  The remote control light receiving unit 409 receives an infrared signal from the remote control 413 and sends the information to the system control unit 411. The operation unit 410 is an operation unit of the media player 400 as with the remote controller 413. In response to an operation of the operation unit 410 or the remote controller 413 by the user, the system control unit 411 selects desired media data from the list of media data notified from the camera adapter device 100. Furthermore, media data recorded on the recording medium of the camera 200 connected to the camera adapter device 100 can be played back and displayed.

  The system control unit 411 includes a program execution device, and controls each part of the media player 400 according to the operation of the operation unit 410 or the remote controller 413. The memory unit 412 stores a program executed by the system control unit 411, and the program is transferred to the system control unit 411 when the program is executed.

  The internal configuration of the recognition / search information engine PC 300 is the same as that of a known personal computer (PC), and the above-described search program and a program for creating a content list described later are stored in the ROM. Yes. When media data is received via an I / F (not shown) and media data satisfying a predetermined condition is searched and a content list is created, the program is expanded from ROM to RAM and controlled by the CPU. . Then, the created content list is transmitted from the I / F.

  In the present embodiment, as shown in FIG. 1, a camera adapter device 100, a router 600, and a media player 400 (or a display device 800 equipped with a media player function) are connected to a home network 500. However, the present invention is not limited to the example shown in FIG. 1, and a large number of devices may exist as long as they can be identified by an address or the like. The home network 500 may be anything as long as it is a network such as the Internet or an intranet having a sufficient bandwidth for transmitting packet data.

  On the other hand, the media player 400 is assumed to be a built-in device such as a game machine or a network-compatible television. Therefore, the physical connection form to the home network 500 may be not only wired but wireless, but any physical form may be used as long as the connection is made according to the protocol.

  Next, an operation when the media data recorded on the recording medium of the camera 200 connected to the camera adapter device 100 is reproduced and displayed by a user operation on the media player 400 will be described.

  FIG. 4 is a timing chart showing an example of an operation procedure of the media data distribution system in the present embodiment. In FIG. 4, the camera adapter device 100 and the recognition / search information engine PC 300 are connected to the home network 500, and an operation procedure by a user operation from the media player 400 or the display device 800 is shown.

  First, the device type, address, and the like, which are information necessary for the media player 400 to access the camera adapter device 100, follow a protocol such as UPnP in accordance with, for example, a procedure defined by normal DLNA. It is assumed that the media player 400 has already acquired such information. In addition, it is assumed that recorded media data in various formats is stored in a recording medium attached to the camera 200. For example, in the case of a digital camera, if it is still image data, it is a file such as JPEG, CCD-RAW, or TIFF, and if it is moving image data, it is an AVI file that is MPEG4 or MJPEG. H.264 and other files. On the other hand, in the case of an AVCHD digital video camera, H. This is an MPEG2TS format file in which H.264 video is multiplexed with Dolby Digital (AC3) audio.

  First, before the camera 200 is connected to the camera adapter device 100, the media player 400 sets in advance what kind of content list is created for the camera adapter device 100 (T1). As the type of setting, first, in the case of still image data, it is a setting for extracting a certain person or object. In the case of moving image data, the setting is to extract a scene in which a certain person or object is shown. In addition, a certain thing is a car, a flower, and also according to each kind etc., for example.

  The second setting is to extract a scene in which sound is rising from moving image data. For example, a few minutes before and after the scene where cheers are raised are extracted. The third setting is for extracting data included in a certain range from metadata attached to still image data or moving image data. For example, based on the GPS information attached to still image data, what is in the range / region of a certain map is extracted. Although the three types of settings have been described above, other setting methods may be used as long as the search can be performed by the search engine of the recognition / search information engine PC300.

  Hereinafter, among the media data recorded on the recording media of the camera 200 connected to the camera adapter device 100, the media player 400 reproduces a still image in which “person-XXX” appears or a video scene that is shown. The operation will be described as an example. In T1, first, the media player 400 makes a setting for the camera adapter device 100 so as to create a list of still images or moving image scenes of “person-XXX”. Specifically, the system control unit 411 generates a content list creation request and transmits the content list creation request to the camera adapter device 100 via the LAN I / F unit 401.

  Next, when the camera 200 is connected to the camera adapter device 100 via the USB cable 108, the system control unit 101 searches for media data stored in the recording medium of the camera 200 through the USB I / F 103 (T2). Then, still image data or moving image data is selected, and the media data is transferred from the USB I / F 103 to the system control unit 101. Further, the system control unit 101 transfers the media data to the recognition / search information engine PC 300 via the wireless LAN I / F 104 (T3).

  The recognition / search information engine PC 300 that has received the media data searches the transferred media data for a still or moving image scene that includes “person-XXX”, in order to reflect the creation request, Create a list of search results. For example, in the case of still image data, a file name is created. In the case of moving image data, a file name and position information indicating from what byte to what byte of the file are created. Then, the created list is transferred to the camera adapter device 100 (T4).

  The camera adapter device 100 receives the list created by the recognition / search information engine PC 300 via the wireless LAN I / F 104. Then, the system control unit 101 functions as a list information creating unit, and in the case of still image data, the file name is left as it is, and in the case of moving image data, the media data name (file name) corresponding to each position information is changed, Create a new content list. Then, a new content list (list information) whose file name has been changed is held in a memory (not shown) or the flash memory 106 in the system control unit 101. At this time, if it is held in the flash memory 106, it can be used as it is when the camera 200 in which the same media data is stored in the recording medium is connected next time.

  When creating the media data name, for example, for the A byte to B byte of the “Movie1.mts” file, the file name is “000-Movie1.mts”. Also, for the C byte to D byte of the “Movie1.mts” file, the file name is “001-Movie1.mts”. At this time, when a playback request with the file name “000-Movie1.mts” is received from the media player 400, the A byte to the B byte of the “Movie1.mts” file can be played back. Keep it. Therefore, the camera adapter device 100 also keeps the content list before the change at the same time.

  As a second setting, the same procedure can be used when creating a content list in which scenes with high sound are extracted from moving image data. A plurality of settings can be made by holding the content list in the flash memory 106.

  On the other hand, as a third setting, when creating a content list in which items included in a certain range are extracted, some of the steps described above are different. In this case, instead of transferring the media data stored in the recording medium of the camera 200 to the recognition / search information engine PC 300, only the metadata of the stored media data is transferred to the recognition / search information engine PC 300. For example, GPS information attached as metadata of still image data is transferred to the recognition / search information engine PC300. Then, the recognition / search information engine PC 300 extracts a still image shot within a set range on a certain map, and notifies the camera adapter device 100 of the file name of the corresponding media data. In response to this notification, the system control unit 101 creates a content list and stores it in the memory of the system control unit 101 or in the flash memory 106.

  On the other hand, even in the case of moving image data, if GPS information for each certain time is attached as metadata, the file name of the moving image data, the accompanying GPS information, and the reproduction position information at that time Is transferred to the recognition / search information engine PC300. Then, the recognition / retrieval information engine PC 300 extracts a corresponding one in the same procedure, and returns a corresponding one. The camera adapter apparatus 100 creates a content list together with still image data and holds it similarly. At this time, if the likelihood of the GPS information attached to the moving image data is high, a media data name can be created and held as in the first and second settings described above.

  By the above procedure, the information processing system is configured by the camera adapter device 100 and the recognition / search information engine PC 300, whereby the content list set in the camera adapter device 100 is held. At this time, the media player 400 transmits a “CDS: Browse request” to the camera adapter device 100 in order to receive information on the content list and format information of each media data (T5). Here, the information regarding the content list is information such as what kind of setting the content list is created, such as a list name. Specifically, the system control unit 411 generates a “CDS: Browse request” and transmits it to the camera adapter device 100 via the LAN I / F unit 401.

  The camera adapter device 100 receives a “CDS: Browse request” via the wireless LAN I / F 104. Then, the system control unit 101 transmits information such as the set content list name as a “CDS: Browse response” to the media player 400 via the wireless LAN I / F 104 (T6). For example, information of a list name such as “a still image or moving image scene including“ person-XX ”” or “a scene that is excited” is transmitted. In T1, since a request is made to create a list of scenes of still images or moving images that include “person-XX”, a “still image including“ person-XXX ” The information of the list name “Video Scene” is transmitted.

  The media player 400 receives information related to the list name of the content set via the LAN I / F unit 401. When the user selects the list name via the remote controller 413 or the operation unit 410, the system control unit 411 requests the camera adapter device 100 to transmit the content list. For example, when a content list of still images or moving images including “person-XX” is selected, the system control unit 411 sends a transmission request for the content list via the LAN I / F unit 401. It is transmitted as “CDS: Browse request” (T7).

  The camera adapter device 100 receives a “CDS: Browse request” via the wireless LAN I / F 104. Then, the requested content list is transmitted to the media player 400 as a “CDS: Browse response” (T8).

FIG. 5 is a diagram showing an example in which a content list is described in XML.
As shown in FIG. 5, the location of the media data is notified by a URL indicating the location. Upon receiving the content list, the media player 400 displays the media data content list on the television monitor 700. Here, when media data is selected by the user operating the remote controller 413 and the play button is pressed, an HTTP GET command is transmitted to the camera adapter device 100 (T9).

  The camera adapter apparatus 100 receives an HTTP GET command, and the system control unit 101 interprets that a Range-designated parameter is added based on the held information. Then, as a response, the media data stored in the recording medium of the camera 200 is transmitted to the media player 400 in the designated range (T10).

  According to the above procedure, a search result is created by the recognition / search information engine PC300. On the other hand, a search result may be created by connecting to the Internet 501 and performing a search that cannot be covered by the recognition / search information engine PC 300 on a web at a predetermined site of the Internet 501.

  As described above, according to the present embodiment, in order to create a user-oriented content list, the recognition / search information engine PC 300 creates metadata of media data including reproduction position information. Then, the metadata including the playback position information of the media data is notified to the camera adapter device 100, and a content list (playback list) is created based on the metadata. As a result, the user can obtain a content list including more desired content.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

100 camera adapter device, 300 recognition / search information engine PC

Claims (8)

Accepting means for accepting setting of content to be extracted from the content recorded in the recording means from the playback device;
When the received setting is a setting for extracting content including an image of a predetermined person or object, and when the received setting is a setting for extracting content including an excitement of sound, the recording is performed. The content recorded in the means is transmitted to the search device, and the received setting is recorded in the recording means if the setting associated with the metadata corresponding to the area included in the predetermined area is extracted. First transmission means for transmitting metadata associated with the content to the search device;
Content list indicating the location of a content corresponding to the search device the setting that issued extracted from the content that is transmitted to the retrieval device, and the metadata the retrieval device is extracted from the meta data transmitted to the retrieval device is associated with Holding means for holding a content list indicating the location of the content corresponding to the setting ,
An information processing apparatus comprising: a second transmission unit configured to transmit the list information to the reproduction apparatus in response to an acquisition request for list information indicating one or more content lists held in the holding unit. . The receiving unit includes a first setting relating to a scene to be extracted from moving image data recorded in the recording unit and a second setting relating to a scene to be extracted from moving image data recorded in the recording unit. Accepted from
The first transmission unit transmits the moving image data recorded in the recording unit, the content of the first setting, and the content of the second setting to the search device,
The holding means includes a first content list indicating a location of content of a scene searched by the search device according to the first setting from the moving image data transmitted to the search device, and the transmitted to the search device. A second content list indicating a location of content of a scene searched by the search device according to the second setting from moving image data;
The second transmission unit transmits first list information indicating the first content list and second list information indicating the second content list to the playback device in response to the acquisition request. The information processing apparatus according to claim 1, wherein: Said retaining means, content list including a URL indicating the location of a content corresponding to the search device the setting that issued extracted from the content that is transmitted to the retrieval device, and, the search device from the meta data transmitted to the retrieval device The information processing apparatus according to claim 1, further comprising: a content list including a URL associated with the extracted metadata and including a URL indicating a location of the content according to the setting .   2. The information processing according to claim 1, wherein the second transmission unit transmits the list information to the playback apparatus in response to the acquisition request that conforms to a Content Directly Service standard defined by UPnP. apparatus. An accepting step of accepting from the playback device the setting of the content to be extracted from the content recorded in the recording means;
When the received setting is a setting for extracting content including an image of a predetermined person or object, and when the received setting is a setting for extracting content including an excitement of sound, the recording is performed. The content recorded in the means is transmitted to the search device, and the received setting is recorded in the recording means if the setting associated with the metadata corresponding to the area included in the predetermined area is extracted. A first transmission step of transmitting the metadata associated with the content to the search device;
Content list indicating the location of a content corresponding to the search device the setting that issued extracted from the content that is transmitted to the retrieval device, and the metadata the retrieval device is extracted from the meta data transmitted to the retrieval device is associated with A holding step for holding a content list indicating the location of the content corresponding to the setting in the holding unit;
A second transmission step of transmitting the list information to the playback device in response to an acquisition request for list information indicating one or more content lists held in the holding unit. . In the accepting step, the first setting of the scene to be extracted from the moving image data recorded in the recording means and the second setting of the scene to be extracted from the moving image data recorded in the recording means are received from the playback device. Accept,
In the first transmission step, the moving image data recorded in the recording means, the content of the first setting, and the content of the second setting are transmitted to the search device,
In the holding step, a first content list indicating a location of content of a scene extracted by the search device according to the first setting from the moving image data transmitted to the search device, and the transmitted to the search device A second content list indicating a location of the content of the scene extracted by the search device according to the second setting from the video data is held in the holding unit;
In the second transmission step, first list information indicating the first content list and second list information indicating the second content list are transmitted to the playback device in response to the acquisition request. The information processing method according to claim 5 , wherein: On the computer,
An acceptance procedure for accepting, from the playback device, content settings to be extracted from the content recorded in the recording means;
When the received setting is a setting for extracting content including an image of a predetermined person or object, and when the received setting is a setting for extracting content including an excitement of sound, the recording is performed. The content recorded in the means is transmitted to the search device, and the received setting is recorded in the recording means if the setting associated with the metadata corresponding to the area included in the predetermined area is extracted. A first transmission procedure for transmitting metadata associated with the content to the search device;
Content list indicating the location of a content corresponding to the search device the setting that issued extracted from the content that is transmitted to the retrieval device, and the metadata the retrieval device is extracted from the meta data transmitted to the retrieval device is associated with Holding procedure for holding the content list indicating the location of the content corresponding to the setting in the holding unit;
A program for executing a second transmission procedure for transmitting the list information to the playback device in response to an acquisition request for list information indicating one or more content lists held in the holding unit. In the computer,
In the reception procedure, the first setting of the scene to be extracted from the moving image data recorded in the recording unit and the second setting of the scene to be extracted from the moving image data recorded in the recording unit are performed from the playback device. Accept,
In the first transmission procedure, the moving image data recorded in the recording means, the content of the first setting, and the content of the second setting are transmitted to the search device,
In the holding procedure, a first content list indicating a location of content of a scene extracted by the search device according to the first setting from the moving image data transmitted to the search device, and the transmitted to the search device A second content list indicating the location of the content of the scene extracted by the search device according to the second setting from the video data;
In the second transmission procedure, in response to the acquisition request, first list information indicating the first content list and second list information indicating the second content list are transmitted to the playback device. The program according to claim 7 for executing a process.

Images