JP2001312516A - Information processing system and method, and program storing medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To know definitely that an operation is added to a thrumbnail. SOLUTION: In the information processing apparatus and method, a process manager 151 detects an operation of users and specifies the display position of the thumbnail according to frequency of the operations detected per unit time, a content processing routine 152-1 generates the thumbnail corresponding to data and controls the display in order to display the thumbnail at a specified position.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an information processing apparatus and method, and a program storage medium, and more particularly to an information processing apparatus and method for displaying thumbnails corresponding to data, and a program storage medium.

[0002]

2. Description of the Related Art In recent years, in a personal computer or the like, a thumbnail corresponding to still image or moving image data is displayed, and a user is allowed to select still image or moving image data based on the thumbnail and to operate the data. Is being used.

[0003]

However, when a thumbnail is operated, the color of the thumbnail changes or only a sound is output, and the user may not be able to recognize whether or not the operation has been correctly input. Was.

The present invention has been made in view of such a situation, and an object of the present invention is to make it possible to reliably know that an operation has been performed on a thumbnail.

[0005]

An information processing apparatus according to claim 1 comprises a detecting means for detecting an operation of a user, a generating means for generating a thumbnail corresponding to data, and an operation for detecting the operation detected by the detecting means. The display device further comprises: a designation unit that designates a display position of a thumbnail according to a frequency in a unit time; and a display control unit that controls display so that a thumbnail is displayed at a position designated by the designation unit. I do.

[0006] The designating means can designate the position of the thumbnail display on a virtual spiral having a radius corresponding to the frequency of the operation per unit time.

According to a third aspect of the present invention, there is provided an information processing method comprising: a detecting step of detecting a user operation; a generating step of generating a thumbnail corresponding to data; and a unit time of the operation detected in the processing of the detecting step. The method includes a designation step of designating a display position of a thumbnail corresponding to a frequency, and a display control step of controlling display so that the thumbnail is displayed at a position designated by the processing of the designation step. .

According to a fourth aspect of the present invention, there is provided a program stored in a program storage medium, comprising: a detecting step of detecting a user operation;
A generation step of generating a thumbnail corresponding to the data; a specification step of specifying a display position of the thumbnail corresponding to a frequency of the operation detected in the processing of the detection step in a unit time; And a display control step of controlling the display so that the thumbnail is displayed at the set position.

[0009] The information processing apparatus according to claim 1, claim 3,
And a program storage medium according to claim 4, wherein an operation of the user is detected, a thumbnail corresponding to the data is generated, and a thumbnail corresponding to the frequency of the detected operation in a unit time is generated. The display position of the thumbnail is designated, and the display is controlled so that the thumbnail is displayed at the designated position.

[0010]

1 to 4 show the appearance of a notebook personal computer according to an embodiment of the present invention. The personal computer 1 basically includes a main body 2 and a display unit 3 which can be opened and closed with respect to the main body 2. FIG. 1 is an external perspective view showing a state where the display unit 3 is opened with respect to the main body 2. FIG.
Is a plan view of the main body 2, and FIG. 3 is an enlarged view of a jog dial 4 described later provided on the main body 2. FIG. 4 is a side view of the jog dial 4 provided on the main body 2.

The main body 2 includes a keyboard 5 operated when inputting various characters and symbols, and a touch pad 6 as a pointing device operated when moving a pointer (mouse cursor) displayed on the LCD 7. , And a power switch 8 are provided on the upper surface thereof. Jog dial 4, slot 9, IEEE1
The 394 port 101, the memory stick slot 115, and the like are provided on the side surface of the main body 2. In addition,
Instead of the touch pad 6, it is also possible to provide a stick-type pointing device.

An LCD (Liquid Crystal Display) 7 for displaying an image is provided in front of the display unit 3. A power lamp PL, a battery lamp BL, and a message lamp ML provided as needed are provided in an upper right portion of the display unit 3.
(Not shown) A lamp comprising other LEDs is provided. Further, a microphone 66 is provided above the display unit 3.

The power supply lamp PL, the battery lamp BL,
The message lamp ML and the like can be provided below the display unit 3.

Next, the jog dial 4 has, for example, a height between the keys A and B arranged on the right side of the keyboard 5 on the main body 2 in FIG. It is attached so that it becomes. The jog dial 4 performs a predetermined process (for example, a process of scrolling a screen) in response to a rotation operation indicated by an arrow a in FIG.
To execute a process corresponding to the moving operation indicated by the arrow b in the figure (for example, a process of deciding to select an icon).

The jog dial 4 may be arranged on the left side of the main body 2 or between the left and right sides of the display unit 3 provided with the LCD 7 or between the G key and the H key of the keyboard 5. The jog dial 4 may be arranged in the vertical direction (that is, such that the jog dial 4 rotates in either the Y key direction or the B key direction).

The jog dial 4 can be operated with the thumb while operating the touch pad 6 with the index finger.
It may be arranged at the center of the front surface of the main body 2, may be arranged horizontally along the upper edge or the lower edge of the touch pad 6, or may be arranged vertically between the right button and the left button of the touch pad 6. It may be arranged in the direction. Furthermore, the jog dial 4
The arrangement is not limited to the vertical direction and the horizontal direction, and may be arranged at a predetermined angle in an oblique direction that is easy to operate with each finger. In addition, the jog dial 4 can be arranged at a position operable with the thumb on the side of the mouse as a pointing device. As the jog dial, it is possible to use a rotary operation type electronic component with a push switch disclosed in Japanese Patent Application Laid-Open No. Hei 8-203387, filed by the applicant of the present invention.

Slot 9 is a PCMCIA (Personal Compute)
r A PC card, which is an expansion card based on the standard prescribed by the Memory Card International Association).

IEEE (Institute of Electrical and Elec)
The tronics engineer) 1394 port 101 has a structure based on the standard defined by IEEE1394, and a cable based on the standard defined by IEEE1394 is connected.

The memory stick slot 115 has a built-in semiconductor memory such as a flash memory, and is a memory card (trademark) 1 which is a memory card for storing data such as still images, moving images, sounds, and texts.
16 is mounted.

Next, the configuration of an embodiment of the personal computer 1 will be described with reference to FIG.

A central processing unit (CPU (Central Processi
ng Unit)) 51 is composed of, for example, a Pentium (trademark) processor manufactured by Intel Corporation and connected to the host bus 52. Host bus 52
Is connected to a bridge 53 (a so-called north bridge).
lerated Graphics Port) 50 and PCI (Peripher
al Component Interconnect / Interface) bus 56.

The bridge 53 is, for example, manufactured by Intel Corporation.
It is composed of an AGP Host Bridge Controller, such as 400BX, and has a CPU 51 and a RAM (Random-Access
Memory) 54 (so-called main memory) and the like. Further, the bridge 53 is connected to the AG
It controls data transmission with the video controller 57 via P50. The bridge 53 and a bridge (so-called south bridge (PCI-ISA Bridge)) 58
Thus, a so-called chipset is configured.

The bridge 53 is further connected to a cache memory 55. The cache memory 55
Compared with the RAM 54 such as an SRAM (Static RAM), the RAM 51 is configured by a memory that can execute a write or read operation at a higher speed, and caches (temporarily stores) a program or data used by the CPU 51.

The CPU 51 has a primary cache memory (a memory that can operate at a higher speed than the cache memory 55 and is controlled by the CPU 51 itself).

The RAM 54 is, for example, a DRAM (Dynami
c RAM) and stores a program executed by the CPU 51 or data necessary for the operation of the CPU 51. More specifically, for example, the RAM 54 stores the e-mail program 54A and the auto-pilot program 5
4B, a jog dial state monitoring program 54C, a jog dial driver 54D, an operating program (OS) 54E, a display program 54F, a reading program 54G, and other application programs 54H1 to 54Hn.

The display program 54F and the reading program 54G may be started when the memory stick 116 is inserted into the memory stick slot 115.

The e-mail program 54A is connected to the modem 7
5 through a communication line such as a telephone line 76,
This is a program for exchanging messages (so-called e-mail). The electronic mail program 54A has an incoming mail acquisition function. This incoming mail acquisition function checks whether mail addressed to the user has arrived in the mail box 79 with respect to the mail server 78 provided in the Internet service provider 77, and if there is mail addressed to the user, Execute the acquisition process.

The autopilot program 54B includes a plurality of processes (or programs) set in advance.
This is a program that is started and processed sequentially in a preset order.

The jog dial status monitoring program 54C
Sends a notification as to whether or not it supports jog dial 4,
Received from each application program described above,
When the jog dial 4 is supported, what can be performed by operating the jog dial 4 is displayed on the LCD 7.

The jog dial status monitoring program 54C
Detects an event of the jog dial 4 (an operation in which the jog dial 4 is rotated in a direction indicated by an arrow a in FIG. 3 or pressed in a direction indicated by an arrow b in FIG. 3), and
Execute the process corresponding to the detected event. The jog dial status monitoring program 54C has a list for receiving a notification from the application program. The jog dial driver 54D executes various functions in response to the operation of the jog dial 4.

The OS (Operating System) 54E is, for example, a so-called Windows (Windows) of Microsoft Corporation.
s) 95 (trademark) or Windows 98 (trademark),
Or Apple Computer's so-called Mac OS
A program for controlling basic operations of a computer, such as a trademark.

The display program 54F stores files (data such as moving images, still images, audio, text, etc. (hereinafter, also referred to as contents)) stored in the memory stick 116 mounted in the memory stick slot 115. The file corresponding to the thumbnail is displayed on the LCD 7. Display program 5
The 4F operates a file stored in the memory stick 116 based on the thumbnail displayed on the LCD 7 (copy, move, delete, etc.).

The reading program 67G reads a file stored in the memory stick mounted in the memory stake slot 115, and supplies the data stored in the read file to the display program 54F.

The video controller 57 is connected to the bridge 53 via the AGP 50, receives data (eg, image data or text data) supplied from the CPU 51 via the AGP 50 and the bridge 53, and converts the received data into data. The corresponding image data is generated, or the received data is stored in the built-in video memory as it is. The video controller 57 causes the LCD 7 of the display unit 3 to display an image corresponding to the image data stored in the video memory.

A sound controller 64 is connected to the PCI bus 56. Sound controller 64
Captures a signal corresponding to a voice from the microphone 66, generates data corresponding to the voice, and outputs the data to the RAM. Alternatively, the sound controller 64 drives the speaker 65 to cause the speaker 65 to output sound.

A modem 75 is connected to the PCI bus 56. The modem 75 transmits predetermined data to a communication network 80 such as the Internet or a mail server 78 via a public telephone line 76 and an Internet service provider 77, and receives predetermined data from the communication network 80 or the mail server 78. .

The PC card interface 111
The data supplied from the interface card 112 connected to the CI bus 56 and
Supply to the PU 51 or the RAM 54 and the CPU
The data supplied from the interface card 51
12 is output. The drive 113 includes a PC card interface 111 and an interface card 112.
Is connected to the PCI bus 56.

The drive 113 includes the mounted magnetic disk 121, optical disk 122, and magneto-optical disk 12.
3 or the data recorded in the semiconductor memory 124 is read, and the read data is supplied to the RAM 54 via the PC card interface 111, the interface card 112, and the PCI bus 56.

Memory Stick Interface 11
4 is a memory stick 116 connected to the PCI bus 56 and attached to the memory stick slot 115.
The data supplied from the CPU 51 or the RAM 54
And outputs the data supplied from the CPU 51 to the memory stick 116.

A bridge 58 is connected to the PCI bus 56.
(So-called South Bridge) is also connected. The bridge 58 is made of, for example, PIIX4E manufactured by Intel Corporation, and has an IDE (Integrated Drive Electrode).
nics) controller / configuration register 59, timer circuit 60, IDE interface 61,
And a USB interface 68 and the like.
The bridge 58 is a device connected to the IDE bus 62 or an ISA / EIO (Industry Standard Archit
ecture / Extended Input Output) bus 63 or I
It controls various types of I / O (Input / Output) such as control of devices connected via the / O interface 69.

The IDE controller / configuration register 59 has two IDs, a so-called primary IDE controller and a secondary IDE controller.
It is composed of an E controller, a configuration register and the like (both not shown).

The primary IDE controller has an ID
The HDD 67 is connected via the E bus 62. When a so-called IDE device such as a CD-ROM drive or HDD (not shown) is mounted on another IDE bus, the mounted IDE device is electrically connected to the secondary IDE controller.

The HDD 67 includes an electronic mail program 67A, an autopilot program 67B, a jog dial status monitoring program 67C, a jog dial driver 67D, an OS 67E, a display program 67F as an application program, and a reading program 6
7G, other plural application programs 67
H1 to 67Hn are recorded. E-mail program 67A, auto-pilot program 67B, jog dial status monitoring program 6 recorded on HDD 67
7C, the jog dial driver 67D, the OS 67E, the display program 67F, the reading program 67G, and the application programs 67H1 to 67Hn are, for example, RA in the process of booting up.
M54 is sequentially supplied and loaded.

The USB interface 68 transmits data to a connected device via the USB port 107 and receives data from the device.

The timer circuit 60 includes a display program 67F
Is supplied to the CPU 51 via the PCI bus 56 in response to the request. The display program 67F can know the elapsed time and the like based on the data indicating the current time supplied from the timer circuit 60.

The ISA / EIO bus 63 further includes an I
The / O interface 69 is connected. This I /
The O interface 69 is composed of an embedded controller, in which the ROM 70, RA
M71 and CPU72 are mutually connected.

The ROM 70 has an IEEE 1394 interface program 70A, an LED control program 70
B, touch pad input monitoring program 70C, key input monitoring program 70D, wake-up program 70
E and the jog dial state monitoring program 70F and the like are stored in advance.

The IEEE 1394 interface program 70A transmits and receives data (data stored in a packet) conforming to the standard defined by IEEE 1394 via the IEEE 1394 port 101. The LED control program 70B controls lighting of a power lamp PL, a battery lamp BL, a message lamp ML as required, or other lamps including LEDs. Touchpad input monitoring program 70C
Is a program for monitoring an input from the touch pad 6 corresponding to a user operation.

The key input monitoring program 70D is a program for monitoring inputs from the keyboard 5 or other key switches. Wake-up program 70E
Checks whether or not a preset time has been reached based on data indicating the current time supplied from the timer circuit 60 of the bridge 58. When the preset time has come, a predetermined process (or program ) Is a program for managing the power supply of each chip constituting the personal computer 1 in order to activate the above. The jog dial state monitoring program 70F determines whether or not the rotary encoder of the jog dial 4 has been rotated or not.
Is a program for constantly monitoring whether or not is pressed.

The ROM 70 further contains a BIOS (Basic
Input / Output System (basic input / output system)) 70G
Is written. The BIOS 70G controls data transfer (input / output) between an OS or an application program and peripheral devices (such as the touch pad 6, the keyboard 5, and the HDD 67).

The RAM 71 has registers for LED control, touch pad input status, key input status, or set time, and I / O for monitoring the jog dial status.
A register, an IEEE1394 I / F register, or the like is provided as the registers 71A to 71F. For example, when the jog dial 4 is pressed and the e-mail program 54A is started, a predetermined value is stored in the LED control register, and the lighting of the message lamp ML is controlled in accordance with the stored value. . The key input status register stores a predetermined operation key flag when the jog dial 4 is pressed. The set time register corresponds to the operation of the keyboard 5 or the like by the user,
A predetermined time is set.

The I / O interface 69
Are connected to the jog dial 4, the touch pad 6, the keyboard 5, and the IEEE 1 via a connector (not shown).
394 port 101, etc. are connected, jog dial 4,
A signal corresponding to an operation on the touchpad 6 or the keyboard 5 is output to the ISA / EIO bus 63. Also, the I / O interface 69 is an IEEE1
It controls the transmission and reception of data with the connected device via the 394 port 101. Further, a power lamp PL, a battery lamp BL, a message lamp ML, a power control circuit 73, and other LEDs are connected to the I / O interface 69.

The power supply control circuit 73 is connected to the built-in battery 74 or the AC power supply, supplies necessary power to each block, and performs control for charging the built-in battery 74 or a second battery of a peripheral device. . The I / O interface 69 monitors the power switch 8 operated when turning on or off the power.

Even when the power is off, the I / O interface 69 operates according to the IEEE standard by the internal power supply.
The 1394 interface program 70A to the jog dial status monitoring program 70F are executed. That is, the IEEE 1394 interface program 70
The A to jog dial status monitoring program 70F is always running.

Therefore, when the power switch 8 is turned off and the CPU 5
1 does not execute the OS 54E, the I / O interface 69 executes the jog dial state monitoring program 70F. For example, when the jog dial 4 is pressed in the power saving state or the power off state, the personal The computer 1 starts processing of predetermined software or a script file set in advance.

As described above, in the personal computer 1, since the jog dial 4 has a programmable power key (PPK) function, it is not necessary to provide a dedicated key.

FIG. 6 shows a display program 54F and a reading program 5 executed by the personal computer 1.
FIG. 4 is a diagram illustrating a configuration of 4G. Display program 54F
Is the processing manager 151, the content processing routine 1
Processing routines such as 52-1 to 152-N and icon processing routines 153-1 to 153-N are included.

The processing manager 151 controls the touch pad 6
Alternatively, a position at which a thumbnail corresponding to a file read from the memory stick 116 is displayed is calculated based on an input event or the like supplied from the OS 54E, and the calculated position is supplied to the content processing routines 152-1 to 152-N. The display position of the thumbnail supplied by the processing manager 151 to the content processing routines 152-1 to 152-N indicates the depth (indicating the virtual distance from the surface of the LCD 7, When the thumbnails overlap, which thumbnail is displayed and the size at which the thumbnail is displayed are determined).

The processing manager 151 controls the display cycle of the thumbnails of the content processing routines 152-1 to 151-N.

The processing manager 151 controls the touch pad 6
Alternatively, based on an input event or the like supplied from the OS 54E, a position at which an icon is displayed is calculated, and the calculated position is supplied to the icon processing routines 153-1 to 153-N. The processing manager 151 executes an icon processing routine 153-1.
153-N are controlled.

The processing manager 151 controls the touch pad 6
Alternatively, the content processing routines 152-1 to 152-N are performed based on an input event supplied from the OS 54E.
, The display state (display position of the thumbnail, display cycle, image color, etc.) is instructed.

The processing manager 151 controls the touch pad 6
In response to an input such as
The OS 54E requests the OS 54E to perform processing such as copying, deleting, or transferring the file corresponding to the thumbnail displayed by -1 to 152-N.

Content processing routines 152-1 to 152-1
In 52-N, a number corresponding to the number corresponding to the file read from the memory stick 116 is activated in response to a request from the reading program 54G.

For example, when the reading of the four files from the memory stick 116 by the reading program 54G is completed, the reading program 54G requests activation of the content processing routines 152-1 to 152-4. For example, when reading of eight files from the memory stick 116 by the reading program 54G is completed, the reading program 54G requests activation of the content processing routines 152-1 to 152-8.

As described above, the number of content processing routines 15 corresponding to the number of files that have been read from the memory stick 116 by the reading program 54G are completed.
2-1 to 152-N are activated. Actually, the display program 54F repeatedly executes one routine a predetermined number of times to execute the content processing routine.
The content processing routines 152-1 to 152-N appear to be operating.

The content processing routine 152-1 stores one thumbnail corresponding to one file read from the memory stick 116 into the processing manager 151.
Is displayed on the LCD 7 based on the instruction. The content processing routine 152-2 stores one thumbnail corresponding to one file read from the memory stick 116 on the LCD 7 based on an instruction of the processing manager 151.
To be displayed. Similarly, each of the content processing routines 152-3 to 152-N causes the LCD 7 to display one thumbnail corresponding to one file read from the memory stick 116 based on an instruction from the processing manager 151.

As described above, the content processing routine 15
Each of 2-3 to 152-N is a processing manager 1
51, each of which has one thumbnail
Display on CD7.

Icon processing routines 153-1 to 153-1
As for 3-N, the number corresponding to the number corresponding to the icon described later is activated.

The icon processing routine 153-1 displays one icon on the LCD 7 based on an instruction from the processing manager 151. Icon processing routine 153-
2 is another one based on the instruction of the processing manager 151.
One icon is displayed on the LCD 7. Similarly, each of the icon processing routines 153-3 to 153-N causes the LCD 7 to display one different icon based on an instruction from the processing manager 151.

As described above, the icon processing routine 153
-1 to 153-N are the processing manager 15
One icon is displayed on the LCD
7 is displayed.

When reading of one file from the memory stick 116 is completed, the reading program 54G executes the content processing routines 152-3 to 152-3.
2-N, and the data stored in the file is supplied to any of the activated content processing routines 152-3 to 152-N.

When reading a file from the communication network 80 such as the Internet, the reading program 54G activates one of the content processing routines 152-3 to 152-N and activates the activated content processing routine 152-N. The data stored in the file may be supplied to any of 3 to 152-N.

Hereinafter, the content processing routine 152-3 will be described.
When it is not necessary to individually discriminate among the content processing routines 152 to 152-N, they are simply referred to as a content processing routine 152. The content processing routines 152-3 to 152-N may be executed as different tasks that are executed in parallel. Hereinafter, the icon processing routine 15
When it is not necessary to distinguish 3-1 to 153-N individually, it is simply referred to as an icon processing routine 153.

Hereinafter, the screens displayed by the display program 54F on the LCD 7 in response to the operation on the personal computer 1 assumed as a normal operation will be sequentially described.

FIGS. 7 to 9 illustrate screens displayed on the LCD 7 when, for example, a memory stick 116 storing ten files is inserted into the memory stick slot 115 and the display program 54F is started. It is.

When one file is read from the memory stick 116, the reading program 54G
One content processing routine 152 is activated, and the display program 54F displays a thumbnail corresponding to the data stored in the file read.

FIG. 7 shows the state after the display program 54F is started.
Memory Stick 1 by reading program 54G
When the reading of three of the ten files from the file 16 is completed, the display program 54F
It is a figure showing the example of the screen displayed on D7.

The thumbnail 201-1 is displayed by the content processing routine 152-1 and is composed of an image corresponding to the data stored in the file read first from the memory stick 116 by the reading program 54G. The thumbnail 201-2 is displayed by the content processing routine 152-2, and includes an image corresponding to the data stored in the file read second by the reading program 54G from the memory stick 116. The thumbnail 201-3 is displayed by the content processing routine 152-3, and includes an image corresponding to data stored in a file read third by the reading program 54G from the memory stick 116.

The thumbnails 201-1 to 201-3 are
As described later, they are arranged on a virtual spiral. Hereinafter, when there is no need to individually distinguish the thumbnails 201-1 to 201-N, they are simply referred to as thumbnails 201.

The content processing routine 152 generates a thumbnail 201 according to the type of data supplied from the reading program 54G.

For example, the content processing routine 152
Generates the thumbnail 201 based on the first image of the moving image when the moving image data is supplied from the reading program 54G.

The content processing routine 152 is a TIFF
(Tag Image File Format) or GIF (Graphic Interc
When the data of a still image in a Hange Format is supplied, a thumbnail 201 is generated from the data of the still image. The content processing routine 152 is a JPEG (Joing Ph
When data of an otographic Experts Group) still image is supplied, the thumbnail data stored in the header is used.

The content processing routine 152 is based on the voice or text data when the voice or text data is supplied from the reading program 54G.
An image is generated and used as a thumbnail 201. A process in which the content processing routine 152 generates an image as the thumbnail 201 corresponding to audio data or text data will be described later.

At the bottom of the screen displayed by the display program 54F on the LCD 7, icons for instructing the arrangement of the thumbnails 201 are displayed. Icon 202-1
Is an icon for instructing the display program 54F to display the thumbnail 201 on a virtual straight line. The icon 202-2 is displayed on the display program 54F.
Are icons for instructing a display to arrange the thumbnails 201 on the circumference of a virtual perfect circle or ellipse. The icon 202-3 is an icon for instructing the display program 54F to display the thumbnails 201 arranged in a lattice. The icon 202-4 is an icon for instructing the display program 54F to display the thumbnail 201 in a virtual spiral.

Since the icon 202-4 is selected and arranged at the lower center of the screen, the display program 54F
The thumbnails 201-1 to 201-3 are arranged on a virtual spiral. Hereinafter, icons 202-1 to 202-4
When it is not necessary to distinguish the
Called.

The display program 54F processes the files corresponding to the thumbnails 201-1 to 201-3 by operating the jog dial 4, the keyboard 5, or the touch pad 6, for example, enlargement display, reproduction, display of attribute information, copy. When deletion, transfer, etc. are requested, processing is performed on the files corresponding to the thumbnails 201-1 to 201-3. For example, the processing manager 151
The OS 54E performs processing such as copy, delete, or transfer on files corresponding to the thumbnails 201-1 to 201-3 in response to input from the touch pad 6 or the like.
Request to.

FIG. 8 shows that after the display program 54F is activated,
Memory Stick 1 by reading program 54G
When reading of 7 files out of 10 files from 16 is completed, the display program 54F
It is a figure showing the example of the screen displayed on D7.

The thumbnail 201-4 is displayed by the content processing routine 152-4, and is composed of an image corresponding to the data stored in the fourth file read from the memory stick 116 by the reading program 54G. The thumbnail 201-5 is displayed by the content processing routine 152-5, and includes an image corresponding to data stored in a file read fifth from the memory stick 116 by the reading program 54G.

The thumbnail 201-6 is displayed by the content processing routine 152-6, and is composed of an image corresponding to the data stored in the sixth file read from the memory stick 116 by the reading program 54G. The thumbnail 201-7 is displayed by the content processing routine 152-7, and includes an image corresponding to the data stored in the file read seventh from the memory stick 116 by the reading program 54G.

The thumbnails 201-1 to 201-7 are
It is arranged on a virtual spiral.

The display program 54F operates on the file corresponding to the thumbnails 201-1 to 201-7 by operating the jog dial 4, the keyboard 5, or the touch pad 6, for example, enlargement display, reproduction, display and copy of attribute information. When deletion, transfer, or the like is requested, processing is performed on files corresponding to the thumbnails 201-1 to 201-7. For example, the processing manager 151
Performs processing such as copy, delete, or transfer on files corresponding to the thumbnails 201-1 to 201-7 in response to input from the touch pad 6 or the like.
Request to.

FIG. 9 shows that after the display program 54F is activated,
Memory Stick 1 by reading program 54G
When the reading of all files from 16 has been completed,
FIG. 9 is a diagram illustrating an example of a screen displayed on the LCD 7 by the display program 54F.

The thumbnail 201-8 is displayed by the content processing routine 152-8, and is composed of an image corresponding to the data stored in the file read eighth from the memory stick 116 by the reading program 54G. The thumbnail 201-9 is displayed by the content processing routine 152-9, and includes an image corresponding to the data stored in the ninth file read from the memory stick 116 by the reading program 54G. The thumbnail 201-10 is displayed by the content processing routine 152-10, and includes an image corresponding to data stored in a file read tenth from the memory stick 116 by the reading program 54G.

Thumbnails 201-1 to 201-10
Are arranged on a virtual spiral.

The display program 54F processes the files corresponding to the thumbnails 201-1 to 201-10 by operating the jog dial 4, the keyboard 5, or the touch pad 6, for example, enlargement display, reproduction, display and copy of attribute information. When deletion, transfer, or the like is requested, processing is performed on files corresponding to the thumbnails 201-1 to 201-10. For example, processing manager 1
The OS 51 performs processing such as copy, delete, or transfer on files corresponding to the thumbnails 201-1 to 201-10 in response to input from the touch pad 6 or the like.
Request 4E.

As described above, when the reading program 54G reads a file from the memory stick 116, the display program 54F sequentially displays the thumbnails 201 corresponding to the data stored in the read file. Can know the contents of the file stored in the memory stick 116 and the reading state of the file at that time.

When the reading program 54G reads a file from the memory stick 116, the display program 54F executes the requested process in response to a request for a process for the file read at that time.

Further, even if the reading of the file is slow, the display program 54F sequentially displays the thumbnails 201 corresponding to the data stored in the read file, so that the user can read the next thumbnail 201 based on the displayed thumbnail 201. Can be determined.

The thumbnail 20 in the state shown in FIG.
The processing that can be executed on the files corresponding to 1-1 to 201-3 is the thumbnail 20 in the state shown in FIG.
Executable processing for the files corresponding to 1-1 to 201-7 and the thumbnail 20 in the state shown in FIG.
This is the same as the processing that can be executed on the files corresponding to 1-1 to 201-10.

Next, the thumbnail 201 for displaying an image corresponding to audio or text data will be described. As shown on the left side of FIG. 10, conventionally, icons and the like corresponding to pre-recorded sounds have been displayed. In this case, even if a display corresponding to a plurality of audio data is displayed,
The same icon was only displayed for that number.

On the other hand, as shown on the right side of FIG. 10, the display program 54F generates an image corresponding to audio or text data itself and
Display as 01.

FIG. 11 shows the contents processing routine 152.
Is a thumbnail 2 displaying an image corresponding to audio data
FIG. 11 is a diagram illustrating a procedure for generating 01.

First, the content processing routine 152
Sets an area for displaying the thumbnail 201 in accordance with the size of the thumbnail 201 to be displayed. The content processing routine 152 divides the area displayed by the thumbnail 201 into a rectangular area composed of a predetermined number of pixels according to the size of audio data.

The content processing routine 152 extracts data of an arbitrary portion (for example, when audio data is viewed as a data string, data located at the center of the data string) from the audio data, and extracts the extracted data. Based on this, a pixel value of the pixel is generated. For example, the content processing routine 152 cuts out data from audio data in units of 8 bits and regards the data as RGB data.

In the example of FIG. 11, 0fh (hereinafter, a numerical value represented by a hexadecimal number) cut out from audio data is
(H is added at the end) is R data, 7eh is G data, and 57h is B data. Similarly, 0f
In the data following h, 7eh, and 57h, 12h is R data, 25h is G data, and 98h is B data.

When the audio data is encrypted or encoded, the content processing routine 152 generates RGB data from the encrypted or encoded audio data without performing processing such as decoding. I do.

In this manner, the content processing routine 152 generates the same number of pixel values as RGB data and the like as the number of divided areas of the thumbnail.

The content processing routine 152 sets RGB data in each of rectangular areas each having a predetermined number of pixels obtained by dividing the area to be displayed by the thumbnail 201. At this point, the thumbnail 201 is composed of images of different colors for each rectangle, as shown in the example of the image 1 in FIG.

The content processing routine 152 is composed of RGB
Blur processing (so-called blurring processing) is applied to the thumbnail 201 in which the data of (1) is set. By blurring the thumbnail 201 in which RGB data is set,
As shown in the example of the image 2 in FIG. 11, there is an effect that the displayed thumbnail 201 is easy to see.

Thumbnail 2 with RGB data set
The processing to be added to 01 is not limited to the blur processing, and may be any image processing such as embossing and contour extraction.

The content processing routine 152 further includes
Attribute data such as a title, an artist name, or a reproduction time included in the audio file is overwritten with a text at a predetermined position, as shown in an image 3 in FIG.

Since the content processing routine 152 overwrites attribute data such as title, artist name, or reproduction time included in the audio file with text, the user who has viewed the thumbnail 201 corresponding to the audio data Can know the contents of the audio data corresponding to the thumbnail 201 in more detail.

The image to be set as the thumbnail 201 may be generated based on the spectrum of audio data. For example, a color (for example, a color corresponding to the level of each frequency band)
-40dB corresponds to the 0-degree color in the color wheel, and 0dB corresponds to 3 in the color wheel.
(Corresponding to the color of 60 degrees) and set the thumbnail 20
An image corresponding to the elapsed time of the audio spectrum can be set in the entire thumbnail 201 by associating the vertical arrangement of 1 with the elapsed time of the audio.

As shown in FIG. 12, the content processing routine 152 divides the area for displaying the thumbnail 201 into a small number of rectangular areas when the audio data is small, and displays the thumbnail 201 when the audio data is large. Is divided into a number of rectangular areas.

In this way, the user of the personal computer 1 can predict the size of the audio data only by looking at the thumbnail 201 corresponding to the audio data.

As shown in FIG. 13, the content processing routine 152 executes the processing of the thumbnail 20 corresponding to the audio data.
The thumbnail 201 is generated based on the text data in the same procedure as the procedure for generating the thumbnail 201. In this case, the content processing routine 152 extracts a text at a predetermined point of the text included in the text data as text displayed on the content 201,
It may be displayed.

As described above, the display program 54F can generate the thumbnail 201 corresponding to audio data or text data.

The display program 54F is not limited to audio data or text data, but may include data not containing images, for example, HTML (Hypertext Markup Language).
The thumbnail 201 can be generated corresponding to data stored in a file, data for spreadsheet calculation, or an execution program (load module).

Next, the arrangement of the thumbnails 201 displayed by the display program 54F will be described.

Conventionally, when displaying thumbnails and information attached to the thumbnails, as shown in FIG. 14, it is common to arrange the thumbnails so as not to overlap with each other and to display the information attached to the thumbnails near the thumbnails. there were.

On the other hand, the personal computer 1
The display program 54F has three types of display modes in which the thumbnails 201 are superimposed and displayed in addition to a display method (hereinafter, referred to as a square view) in which the thumbnails 201 are arranged in a grid so as not to overlap.

In the first display mode, a virtual straight line or curve (open line) is defined, and the thumbnail 201 is arranged on the virtual straight line or curve (hereinafter, referred to as a line view). In the second display mode, a virtual perfect circle or ellipse (closed line) is defined, and the thumbnail 201 is arranged on the virtual perfect circle or ellipse (hereinafter, referred to as a loop view). In the third display mode,
A virtual spiral is defined, and the virtual spiral has a thumbnail 201.
(Hereinafter referred to as a spiral view).

First, the line view displayed when the icon 202-1 is clicked will be described.
As shown in FIG. 15, the display program 54F defines an axis 221-1 consisting of a straight line or a curve, and
1, thumbnails 201-1 to 201-3 are arranged. When the thumbnail 201-1 is selected and the thumbnail 201-1 and the thumbnail 201-2 overlap, the display program 54F displays the entire thumbnail 201-1 and displays the thumbnail 201-2 of the thumbnail 201-2.
Only the portion not overlapping with 1-1 is displayed.

When the thumbnail 201-1 is selected and the thumbnails 201-1 to 201-3 are arranged in order, when the thumbnail 201-2 and the thumbnail 201-3 overlap, the display program 54F displays the thumbnail 201-1.
Only the part of the thumbnail 201-1 that does not overlap with the thumbnail 201-1 is displayed, and only the part of the thumbnail 201-3 that does not overlap with the thumbnail 201-2 is displayed.

That is, the display program 54F displays the entirety of the selected thumbnail 201, and displays the thumbnails 20 away from the selected thumbnail 201.
From 1, the thumbnail 201 near the selected thumbnail 201 is preferentially displayed (so as to be arranged at a position closer to the user).

Information associated with the data corresponding to the thumbnail 201-1, for example, the text 211-1 indicating the file name, the creation date, the size of the image, etc. The text 211-1 is placed on the axis 221-2 at which the upper position coincides. Information attached to data corresponding to thumbnail 201-2,
For example, the text 211-2 indicating the file name or the like is arranged on the axis 221-2 at which the lower position of the thumbnail 201-2 coincides with the upper position of the text 211-2. Information accompanying the data corresponding to the thumbnail 201-3, for example, text 2 indicating a file name or the like
11-3 is arranged on the axis 221-2, for example, where the position below the thumbnail 201-3 and the position above the text 211-3 coincide.

The shaft 221-1 and the shaft 221-2
Is not displayed on the screen of the LCD 7. Hereinafter, the shaft 22
When it is not necessary to distinguish 1-1 and the shaft 221-2 individually, they are simply referred to as the shaft 221. Hereinafter, the text 211-
When it is not necessary to individually distinguish 1 to 211-3, they are simply referred to as text 211.

For example, when the horizontal direction of the screen is the x-axis and the horizontal direction of the screen is the y-axis, as shown in FIG.
1-1 is calculated by Expression (1), and the axis 221-2 is calculated by Expression (2).

X = sin (π / 2t) (y−c0) + c1 (1) x = −sin (π / 2t) (y−c0) + c1 (2) where x is the x axis The coordinates indicate the coordinates, and y indicates the coordinates on the y-axis. t is an elapsed time from a predetermined reference time (for example, a time corresponding to when display is started in the line view), and c0 and c1 indicate a center position of the selected thumbnail.

Θ shown in FIG. 16 corresponds to π / 2t in equation (1) or (2).

Therefore, for example, based on the positions of the shaft 221-1 and the shaft 221-2 shown in FIG.
When the display is started with the arrangement of the thumbnail 201 and the text 211 shown in FIG.
The position 21-2 moves smoothly toward the position shown in FIG. 17C, and further smoothly moves toward the position shown in FIG.

That is, the thumbnail 201 and the text 211 smoothly move from the arrangement shown in FIG. 17B to the arrangement shown in FIG. 17D in accordance with the movement of the axes 221-1 and 221-2. Move, and then Figure 17
It moves smoothly to the arrangement shown in (F).

When the positions of the shafts 221-1 and 221-2 reach the positions shown in FIG.
It moves smoothly toward the position shown in FIG. 17C, and further smoothly moves toward the position shown in FIG.

That is, the thumbnail 201 and the text 211 smoothly move from the arrangement shown in FIG. 17F to the arrangement shown in FIG. 17D in accordance with the movement of the axes 221-1 and 221-2. Move, and then Figure 17
It moves smoothly to the arrangement shown in (B), and moves smoothly as described above.

Since the selected thumbnail 201 is located at the center of the movement of the axis 221-1, the thumbnail 201 selected by the user does not move, and the thumbnails 201 located above and below the selected thumbnail 201 are not moved. Since the user moves, the user can quickly and reliably recognize the selected thumbnail 201.

Next, the loop view displayed when the icon 202-2 is clicked will be described.
As shown in FIG. 18, the display program 54F includes a perfect circle,
A thumbnail 241-1 to 201-5 is arranged based on the axis 241-1 by defining an axis 241-1 formed of an ellipse or a predetermined loop (including a polygon). Thumbnail 2
When 01-3 is selected, the thumbnail 201-3 is selected.
When the thumbnail 201-2 overlaps the thumbnail 201-2, the display program 54F displays the entire thumbnail 201-3, and displays only the portion of the thumbnail 201-2 that does not overlap with the thumbnail 201-3.

When the thumbnail 201-3 is selected and the thumbnails 201-1 to 201-5 are arranged in order, when the thumbnail 201-2 and the thumbnail 201-1 overlap, the display program 54F displays the thumbnail 201-1.
Only the portion of the thumbnail 201-1 that does not overlap with the thumbnail 201-3 is displayed, and only the portion of the thumbnail 201-1 that does not overlap with the thumbnail 201-2 is displayed. Display program 54F
Displays only the portion of the thumbnail 201-4 that does not overlap with the thumbnail 201-3, and displays only the portion of the thumbnail 201-5 that does not overlap with the thumbnail 201-4.

That is, the display program 54F displays the entire selected thumbnail 201, and displays the thumbnails 20 that are distant from the selected thumbnail 201.
From 1, the thumbnail 201 near the selected thumbnail 201 is preferentially displayed (so as to be arranged at a position closer to the user).

The display program 54F defines an axis 241-2 corresponding to the axis 241-1. Thumbnail 201-
For example, the text 211-1 corresponding to the text 211-1 corresponds to the position of the center of the right and left of the thumbnail 201-1 and the text 211-1.
1 are located on the axis 241-2 where the positions of the centers coincide. Text 211- corresponding to thumbnail 201-2
2 is the axis 241 where the center position of the left and right center of the thumbnail 201-2 matches the center position of the text 211-2.
2 are arranged. Similarly, the texts 211-3 to 211-5 corresponding to the thumbnails 201-3 to 201-5 respectively are the thumbnails 201-3 to 201-5.
01-5 shows the position of the center of the left and right, and text 2
Axis 2 in which the positions of the centers of 11-3 to 211-5 coincide.
41-2.

It should be noted that the shaft 241-1 and the shaft 241-2
Is not displayed on the screen of the LCD 7. Hereinafter, the shaft 24
When it is not necessary to individually distinguish 1-1 and axis 241-2, they are simply referred to as axis 241.

As shown in FIG. 19, the display program 54F includes, among the thumbnails 201 arranged on the axis 241-1 and the text 211 arranged on the axis 241-2,
The selected thumbnail 201 is displayed on the LCD 7 as a center.

FIG. 20 shows the shaft 241-1 and the shaft 241-
Axis 241 of display program 54F when 2 is a circle
It is a figure explaining the processing which calculates -1 and axis 241-2.

Assuming that the number of thumbnails 201 to be displayed is n, the radius r of the circle corresponding to the axis 241-1 and the axis 241-2 can be obtained by equation (3).

R = 64n / 2π (3) 64 included in the equation (3) is a constant corresponding to the interval between thumbnails.

Assuming that the coordinates of the center of the screen are (Xcent, Ycent), the coordinates of the center of the axis 241-1 (Xcent1, Ycent1)
Is represented by equation (4), and the coordinates (Xc
ent2, Ycent2) is represented by equation (5).

(Xcent1, Ycent1) = (Xcent, Ycent-r-64) (4) (Xcent1, Ycent1) = (Xcent, Ycent + r + 64) (5) The position of the i-th thumbnail 201 is represented by the formula ( 6).

(X1i, Y1i) = (Xcent1 + rsin (i * 2π / n), Ycent1 + rcos (i * 2π / n)) (6) The position of the i-th text 211 is obtained by Expression (7). Can be

(X2i, Y2i) = (Xcent2 + rsin (i * 2π / n), Ycent2-rcos (i * 2π / n)) (7) In the loop view, a display program corresponding to the operation of the jog dial 4 When 54F changes the arrangement of the thumbnail 201, the user can intuitively
There is an advantage that it is easy to grasp the movement of No. 1.

Next, the spiral view displayed when the icon 202-4 is clicked will be described. As shown in FIG. 21, the display program 54F defines a spiral axis 261 and, based on the axis 261, the thumbnails 201-1 to 201-3 and the text 211.
-1 to 221-3 are arranged. The axis 261 has a position in the depth direction with respect to the screen. Even if the thumbnails 201 have the same size, L
The size displayed on the CD 7 will be different.

The selected thumbnail 201 is displayed in a large size because it is located at the position where the distance from the screen is the shortest. The display program 54F displays the selected thumbnail 201 in a large size, and displays the non-selected thumbnail 201 smaller than the selected thumbnail 201.

Accordingly, the display program 54F displays a large number of thumbnails 201 that the user is paying attention to and displays small thumbnails 201 that the user is not paying attention to while displaying a large number of thumbnails 201. Used more efficiently.

Alternatively, for example, as shown in FIG. 22A, the display program 54F defines a shaft 261-1 and a shaft 261-2 formed of spirals having the same shaft, and bases the shaft 261-1 on the shaft 261-1. , The thumbnail 201 is placed on the axis 26
The text 211 may be arranged based on 1-2.

The coordinates (x, y, z) of the axis 261 formed by a spiral having a radius of r are given by equations (8), (9), and (1).
0).

X = rsin (t) + c0t (8) y = c1t (9) z = rcos (t) (10) where r is the radius of the spiral, and c0 and c1 are the gradients of the spiral. This is a constant to be determined, and t is an arbitrary value.

As shown in FIG. 23, the coordinates (xi, yi, zi) of the thumbnail 201 arranged on the axis 261 composed of a spiral having a radius of r are expressed by the equations (11), (12), and (12). It is determined by (13).

Xi = Xcent + rsin (i * 2π / 9)-(i * r / 20) (11) yi = Ycent + (i * r / 10) (12) zi = r-rcos (i * 2π / 9) (13) Here, Xcent and Ycent indicate the coordinates of the center of the screen. The z-axis is a coordinate axis that is perpendicular to the x-axis and the y-axis and that corresponds to the depth of the screen. 20 in Expression (11) and 10 in Expression (12) are predetermined constants.

Next, the square view displayed when the icon 202-3 is clicked will be described. As shown in FIG. 24 and FIG. 25, the display program 54F, for example, as the top row of the screen, the center positions in the vertical direction coincide with each other, and the interval between the center positions in the horizontal direction becomes a predetermined distance. Like 5 thumbnails 20
1-1 to 201-5 are arranged.

In the display program 54F, as the second column of the screen, the positions of the respective centers in the vertical direction coincide with each other.
5 so that the distance between the center positions in the horizontal direction is a predetermined distance.
One thumbnail 201-6 to 201-10 is arranged. In other words, the horizontal center position of the thumbnail 201-6 matches the horizontal center position of the thumbnail 201-1, and the horizontal center position of the thumbnail 201-7 is
The horizontal center position of the thumbnail 201-2 matches the horizontal center position of the thumbnail 201-8, and the horizontal center position of the thumbnail 201-8 matches the horizontal center position of the thumbnail 201-3.
The center position in the horizontal direction of 01-9 is the thumbnail 201-4.
Of the thumbnail 201-10.
Of the display program 54F so that the horizontal center position of the thumbnail 201-5 coincides with the horizontal center position of the thumbnail 201-5.
Shows five thumbnails 201-6 in the second column of the screen.
To 201-10.

The display program 54F arranges the thumbnails 201-11 to 201-20 by the same processing as the third and fourth columns of the screen.

The display program 54F can rearrange the thumbnails 201 in the line view, loop view, spiral view, or square view based on the creation date, shooting time, file name, image size, and the like. .

Next, the movement of the icon 202 when the icon 202 is clicked will be described. FIG.
FIG. 4 is a diagram illustrating an example of movement of an icon 202.

As shown on the right side of FIG. 26, for example, when icons 202-1 to 202-3 are arranged on the screen, when icon 202-1 is clicked, the shape or color of icon 202-1 is changed. The display program 54F changes the position of the icon 202-1 and the icon 202-2 so as to change the position of the icon 202-1 and the position of the icon 202-2.
Move 2-2.

That is, the processing manager 151 determines the position of the icon 202-1 and the icon 202-2 so that the icon 202-1 and the icon 202-2 move at a predetermined cycle when the touch pad 6 is clicked.
Is calculated.

The icon processing routine 153-1 is based on the position calculated by the processing manager 151.
02-1 is displayed so as to be moved to the center of the screen.
The icon processing routine 153-2 is a processing manager 1
Based on the position calculated by 51, the icon 202-2 is
Display to be moved to the lower left of the screen.

The movement of the icons 202-1 to 202-3 is not limited to a linear movement, and may move on a predetermined curve. The direction of movement of the icons 202-1 to 202-3 is not limited to being on the same plane as the screen to be displayed.
The depth direction may be included with respect to the screen.

When the thumbnail 201 is displayed by the loop view, as shown in FIG. 27A, the display program 54F places the icon 202-2 in the center of the screen in the left-right direction. When the icon 202-1 is clicked in the state shown in FIG. 27A, the display program 54F moves the icons 202-1 to 202-4 at a speed that can be visually confirmed by the user. FIG.
After the state shown in FIG. 27B, the display program 54F arranges the icon 202-1 at the center in the left-right direction of the screen as shown in FIG.

The display program 54F includes an icon 202
-2 through 202-4 are represented by icons 202-2.
To 202-4 based on the numerical values associated with each of them.

For example, 1 is associated with icon 202-1, 2 is associated with icon 202-2, 3 is associated with icon 202-3, and icon 202-
When 4 is associated with 4, the display program 54
F arranges icons 202-2 to 202-4 from the left side of the screen in ascending numerical order.
That is, the display program 54F displays the icon 202-
2 is arranged on the left side of the screen, the icon 202-3 is arranged on the right side of the icon 202-2, and the icon 202-4 is arranged on the right side of the icon 202-3.

As described above, the display program 54F moves the icon 202 and arranges the icon 202 corresponding to the display mode, for example, at the center of the screen, so that the user can operate the icon 202. That is, it is possible to surely know that, and quickly know the display mode of the thumbnail 201.

Next, the thumbnail 201 or the icon 2
Display of an afterimage associated with the movement of 02 will be described. The content processing routine 152 is, for example, 30 times per second,
The thumbnail 202 is drawn. As shown in FIG. 28, when moving the thumbnail 202, the content processing routine 152 displays an afterimage corresponding to the previous drawing on the screen.

If the display of the afterimage is not set, the content processing routine 152 erases the current screen,
A new thumbnail 202 is drawn.

As shown in the example of FIG. 29, when the display of the afterimage is set, when the thumbnail 202 is drawn,
The content processing routine 152 sets the brightness of the previously displayed screen to, for example, 80% and renders the screen. The content processing routine 152 renders the screen in which the brightness is set to 80% so as to overwrite the thumbnail 202.

Therefore, when the thumbnail 202 is moved, the content processing routine 152 draws the image with the brightness of the previously drawn screen lowered every time the drawing is performed, so that an afterimage is displayed. By performing such processing,
The display program 54F can display an afterimage with a smaller amount of calculation.

FIG. 30 is a diagram for explaining a change in the state corresponding to the display position of the thumbnail 201 or the icon 202 when the thumbnail 201 or the icon 202 is moved. For example, in FIG. 30, state A corresponds to a loop view, and state B corresponds to a square view.

In the state A corresponding to the loop view,
When the icon 202-3 is clicked, the processing manager 151 determines that the content processing routines 152-1 to 152-N draw thumbnails 201-1 to 201-2 next.
01-N is calculated and supplied to each of the content processing routines 152-1 through 152-N.

The processing manager 151 calculates the position of the thumbnail 201 based on the transition function shown in the graph of FIG. Assuming that the distance between the position of the thumbnail 201 in the state A and the position of the thumbnail 201 in the state B is 1, the transition function is based on the elapsed time t from the start of the transition.
The distance of the thumbnail 201 at the elapsed time t from the position of the thumbnail 201 in the state B is output.

That is, when the position of the thumbnail 201 in the state A is Bi and the position of the thumbnail 201 in the state A is Bi, the position Ci of the thumbnail 201 in the state A is calculated by the equation (14).

Ci = (Ai-Bi) d (ti) + Bi (14)

In the transition function, at a portion where the elapsed time t is close to 0, the distance d (t) rapidly decreases from 1 as the elapsed time t increases, and thereafter, the distance d (t) gradually decreases. Is defined to be 0. By defining the transition function in this way, the display program 54F can quickly move the thumbnail 201 when the movement of the thumbnail 201 is started.
Is moved, and the thumbnail 201 is slowly moved toward the destination.

By doing so, the display program 5
The 4F can quickly move the thumbnail 201 and eliminate a sense of discomfort associated with the movement of the thumbnail 201 by the user.

The transition function is not limited to that shown in FIG. 31. For example, in a portion where the elapsed time t is close to 0, the distance d (t) gradually decreases from 1 as the elapsed time t increases. After that, the distance d (t) may suddenly decrease to zero.

The processing manager 151 calculates the position of each of the thumbnails 201-1 to 201-N corresponding to the distance d (t) based on the transition function according to the elapsed time t, and executes the content processing routine. 152-1 to 152-N
Supply to each. Content processing routine 152
-1 to 152-N are thumbnails 201-
1 to 201-N are drawn.

In the state C1 corresponding to the elapsed time t1,
Each of the thumbnails 201-1 to 201-N is displayed at an intermediate position where it moves toward the position of the thumbnails 201-1 to 201-N in the state B. Elapsed time t1
State C corresponding to elapsed time t2 after a predetermined time has elapsed from
2, the thumbnails 201-1 to 201-N further include thumbnails 201-1 to 201-2 in the state B.
It is displayed at an intermediate position where it moves toward the position 01-N.

In the state C3 corresponding to the elapsed time t3 at which the predetermined time has elapsed from the elapsed time t2, the thumbnail 201
Each of -1 to 201-N is displayed at a position closer to the position of the thumbnails 201-1 to 201-N in the state B, in the middle of the movement.

FIG. 32 shows an example of the position of the thumbnail 201 in the state C1 and the position of the thumbnail 201 in the state C2.

During the transition from the state A to the state B, for example, when an input to the effect that a transition is made to the state D is input, the state A
From the state in the middle of transition from state to state B to state D.

For example, as shown in FIG. 33, when the icon 202-4 is clicked in the state C2, the state C2 is set as a new start state, and the state changes to the state D corresponding to the spiral view. The transition from the state C2 to the state D is performed in the same manner as the transition from the state A to the state B.
This is performed via 1 to state E2.

In the spiral view, when the jog dial 4, the keyboard 5, or the touch pad 6 is being operated, and when the jog dial 4, the keyboard 5, and the touch pad 6 are not being operated, the processing manager 151 sets in FIG. As shown in the thumbnail 2
01 is changed.

Further, in the spiral view, when the keyboard 5 or the like is continuously pressed (for example, the direction key is continuously pressed), the keyboard 5 or the like is set to one.
The processing manager 151 changes the position where the thumbnail 201 is displayed, when it is pressed only once and immediately released.

More specifically, when the jog dial 4 and the keyboard 5 are not operated, for example, as shown in FIG. 35, the processing manager 151 gives the content processing routine 152 a thumbnail on a spiral having a larger radius r. 201 is displayed.

The jog dial 4 is kept being rotated.
Alternatively, when the keyboard 5 is continuously pressed, the processing manager 151 causes the content processing routine 152 to display the thumbnail 201 on a spiral having a smaller radius r, as shown in FIG. 36, for example.

When the jog dial 4 is rotated by one click or the keyboard 5 is pressed once and released immediately, the processing manager 151 sends the content processing routine 152 to the intermediate part shown in FIG. 35 and FIG. The thumbnail 201 is displayed on a spiral having a radius r.

The user of the personal computer 1 can immediately determine whether or not the jog dial 4 or the keyboard 5 is being operated based on the display position of the thumbnail 201.

The display program 54F may reproduce a predetermined sound or display a predetermined image together with the change of the radius r of the spiral.

Further, when the jog dial 4 and the keyboard 5 are not operated, the processing manager 151
The thumbnail 201 may be displayed on a spiral having a smaller radius r, and when the jog dial 4 or the keyboard 5 is operated, the content processing routine 152 may display the thumbnail 201 on a spiral having a larger radius r. .

Next, selection of the thumbnail 201 and enlarged display will be described.

FIGS. 37 to 39 are diagrams for explaining selection and enlarged display of the thumbnail 201 in the line view. Thumbnail 2 displaying “M” shown in FIG. 37
When the thumbnail 201 displaying “H” is clicked while “01” is selected, the display program 54F displays the thumbnail 201 displaying “H” on the screen as shown in FIG. So that it is located in the center,
All the thumbnails 201 displayed on the screen are moved. The display program 54F shifts to a state in which the thumbnail 201 displaying “H” is selected.

When the thumbnail 201 displaying "H" shown in FIG. 38 is selected and the thumbnail 201 displaying "H" is clicked, the display program 54F displays the program shown in FIG. Thus, the image corresponding to the thumbnail 201 displaying “H” is displayed.

That is, when the data corresponding to the thumbnail 201 displaying “H” is a still image, the display program 54F displays the still image in its original size. When the data corresponding to the thumbnail 201 displaying “H” is a moving image, the display program 54F
Displays the moving image at its original size and reproduces the moving image. When the data corresponding to the thumbnail 201 displaying “H” is audio, the display program 54F
The thumbnail 201 is enlarged to a predetermined size and displayed, and the sound is reproduced.

When the image corresponding to the thumbnail 201 displaying “H” shown in FIG. 39 is clicked, the display program 54F changes the display state to “shown in FIG.
It returns to the state where the thumbnail 201 displaying “H” is selected.

FIGS. 40 to 42 are diagrams for explaining selection and enlarged display of the thumbnail 201 in the loop view. Thumbnail 2 displaying “M” shown in FIG. 40
When the thumbnail 201 displaying “Q” is clicked in a state where “01” is selected, the display program 54F displays the thumbnail 201 displaying “Q” on the screen as shown in FIG. All the thumbnails 20 displayed on the screen are located at the center in the left-right direction.
Move one. The display program 54F shifts to a state in which the thumbnail 201 displaying “Q” is selected.

When the thumbnail 201 displaying “Q” shown in FIG. 41 is selected and the thumbnail 201 displaying “Q” is clicked, the display program 54F displays the program shown in FIG. Thus, the image corresponding to the thumbnail 201 displaying “Q” is displayed.

That is, when the data corresponding to the thumbnail 201 displaying “Q” is a still image, the display program 54F displays the still image in its original size. When the data corresponding to the thumbnail 201 displaying “Q” is a moving image, the display program 54F
Displays the moving image at its original size and reproduces the moving image. When the data corresponding to the thumbnail 201 displaying “Q” is audio, the display program 54F
The thumbnail 201 is enlarged to a predetermined size and displayed, and the sound is reproduced.

When the image corresponding to the thumbnail 201 displaying "Q" shown in FIG. 42 is clicked, the display program 54F changes the display state to the state shown in FIG.
The thumbnail 201 displaying “Q” is returned to the selected state.

FIGS. 43 to 45 are diagrams illustrating the selection and enlargement of the thumbnail 201 in the spiral view. When the thumbnail 201 displaying “Z” shown in FIG. 43 is selected and the thumbnail 201 displaying “Z” is clicked, as shown in FIG. All the thumbnails 201 displayed on the screen are moved so that the thumbnail 201 displaying “Z” is located at the center of the screen. The display program 54F shifts to a state in which the thumbnail 201 displaying “Z” is selected.

When the thumbnail 201 displaying “Z” shown in FIG. 44 is selected and the thumbnail 201 displaying “Z” is clicked, the display program 54F displays the program shown in FIG. Thus, the image corresponding to the thumbnail 201 displaying “Z” is displayed.

That is, when the data corresponding to the thumbnail 201 displaying “Z” is a still image, the display program 54F displays the still image in its original size. When the data corresponding to the thumbnail 201 displaying “Z” is a moving image, the display program 54F
Displays the moving image at its original size and reproduces the moving image. When the data corresponding to the thumbnail 201 displaying “Z” is audio, the display program 54F
The thumbnail 201 is enlarged to a predetermined size and displayed, and the sound is reproduced.

When the image corresponding to the thumbnail 201 displaying “Z” shown in FIG. 45 is clicked, the display program 54F changes the display state to the state shown in FIG.
Return to the state where the thumbnail 201 displaying “Z” is selected.

FIGS. 46 to 48 are views for explaining selection and enlarged display of the thumbnail 201 in the square view. When the thumbnail 201 displaying “B” is clicked in a state where the thumbnail 201 displaying “M” shown in FIG. 46 is selected, the display program 54F, as shown in FIG. All the thumbnails 201 displayed on the screen are moved so that the thumbnail 201 displaying “B” is located at the center of the screen. The display program 54F shifts to a state in which the thumbnail 201 displaying “B” is selected.

When the thumbnail 201 displaying “B” shown in FIG. 47 is selected and the thumbnail 201 displaying “B” is clicked, the display program 54F is displayed as shown in FIG. Thus, the image corresponding to the thumbnail 201 displaying “B” is displayed.

That is, when the data corresponding to the thumbnail 201 displaying “B” is a still image, the display program 54F displays the still image in its original size. When the data corresponding to the thumbnail 201 displaying “B” is a moving image, the display program 54F
Displays the moving image at its original size and reproduces the moving image. When the data corresponding to the thumbnail 201 displaying “B” is audio, the display program 54F
The thumbnail 201 is enlarged to a predetermined size and displayed, and the sound is reproduced.

When the image corresponding to the thumbnail 201 displaying “B” shown in FIG. 48 is clicked, the display program 54F changes the display state to the state shown in FIG.
Return to the state where the thumbnail 201 displaying “B” is selected.

As described above, when the thumbnail 201 is clicked, the display program 54F selects the clicked thumbnail 201, displays it in an enlarged manner, or reproduces a moving image. It is possible to easily and quickly select and display or reproduce desired data.

Next, the state transition when the state shown in FIG. 38 changes to the state shown in FIG. 39, the state transition when the state shown in FIG. 41 changes to the state shown in FIG.
The state transition when the state changes from the state shown in FIG. 4 to the state shown in FIG. 45, or the state transition when the state changes from the state shown in FIG. 47 to the state shown in FIG. 48, and the state transition shown in FIG. State transition when changing to the state shown,
The state transition when the state shown in FIG. 42 changes to the state shown in FIG. 41, the state transition when the state shown in FIG. 45 changes to the state shown in FIG. 44, or the state shown in FIG. The state transition when the state changes to the indicated state will be described.

The state transition when the state shown in FIG. 38 changes to the state shown in FIG. 39, and the state shown in FIG.
When the state changes from the state shown in FIG. 44 to the state shown in FIG. 45, or when the state changes from the state shown in FIG. 47 to the state shown in FIG. The state transition corresponds to a request for displaying or reproducing a desired still image, moving image, or sound by the user. Since the operation of the thumbnail 201 or the like ultimately aims to display or reproduce a still image, a moving image, or a sound, this state transition can be said to be of great importance to the user as shown in FIG.

On the other hand, the state shown in FIG.
State transition when changing to the state shown in FIG. 8, state transition when changing from the state shown in FIG. 42 to the state shown in FIG. 41, and state when changing from the state shown in FIG. 45 to the state shown in FIG. From the state shown in FIG.
The state transition when changing to the state shown in
This is a transition to a transitional state for the purpose of ending the display or reproduction of the moving image or the sound or selecting another thumbnail 201. This state transition can be said to be of low importance to the user, as shown in FIG.

Therefore, as shown in FIG. 50, when a state transition that is important to the user is made, for example, when a desired still image, moving image, or sound is displayed or reproduced, a display program is executed. The display 54F changes the display relatively slowly at a speed at which the user can visually recognize the change in the display in order to ensure that the user recognizes the display or reproduction.

On the other hand, when making a state transition that is less important to the user, for example, the display of a desired still image, moving image, or sound is stopped, or the reproduction is stopped.
When the display is changed to the display selected by the thumbnail 201, the display program 54F quickly changes the display.

As described above, the display program 54F allows the user to reliably recognize important state transitions and quickly executes relatively insignificant state transitions. Therefore, the user can recognize the state transitions and quickly perform them. Conflicting requirements of response can be satisfied.

Next, the display of the selected thumbnail 201 will be described. As shown in FIG. 51, when the thumbnail 201 is selected, the display program 54F displays a frame 281 on the selected thumbnail 201. When another thumbnail 201 is selected, the display program 54F deletes the frame 281 from the unselected thumbnail 201.

[0221] The display program 54F changes the brightness, saturation, or hue of the frame 281 in accordance with the passage of time. FIG. 52 is a diagram illustrating an example of a change in brightness or saturation of frame 281 corresponding to the passage of time.

For example, the display program 54F changes the brightness or the saturation of the frame 281 which is 0% linearly to 100% in 0.5 seconds, and changes the brightness or the saturation of the frame 281 which is 100%. It is changed linearly to 0% in 0.5 seconds, and this change is repeated.

The processing for changing the brightness of the frame 281 requires a smaller amount of calculation than the processing for changing the saturation or hue.

FIG. 53 shows a frame 28 corresponding to the passage of time.
FIG. 6 is a diagram illustrating an example of a change of one hue.

For example, the display program 54F linearly changes the hue of the frame 281 corresponding to 0 degree of the hue circle in three seconds in one second.
Frame 2 that changes to 60 degrees and reaches 360 degrees on the hue circle
The hue of 81 is returned to 0 degrees, and this change is repeated.

By doing so, the display program 5
4F displays a thumbnail 201 having various brightness, color, or hue from a screen on which a thumbnail 201 is displayed.
The selected thumbnail 201 can be surely recognized. The cycle of the change in the brightness, saturation, or hue of the frame 281 is not limited to one second, but is, for example, 0.1 second to 10 seconds.
A period that can be recognized by a user on the order of seconds may be used.

FIG. 54 shows the selected thumbnail 20.
FIG. 5 is a diagram for explaining display of data attributes and the like corresponding to No. 1; When the thumbnail 201 is selected, the display program 54F displays a frame 281. When a predetermined time elapses without operating the touch pad 6 or the like, the display program 54F displays the frame 281.
The attributes such as the file name of the file in which the data corresponding to No. 1 is stored, the title of the data, the size of the data, and the reproduction time are displayed on the additional attribute display 291.

When the thumbnail 201 is not selected, the display program 54F displays the thumbnail 201
Is deleted, and the frame 281 and the additional attribute display 291 corresponding to are deleted.

For example, as shown in FIG. 55, when one second elapses after the thumbnail 201 is selected, the display program 54F displays attributes such as a file name, an icon indicating a still image or a moving image, data size, and date. Is displayed on the additional attribute display 291. In the example shown in FIG. 55, the additional attribute display 291 indicates that the other thumbnails 20 that have not been selected are displayed.
In order to allow the user to confirm 1, the frame and the background thereof are translucently displayed.

Next, the full-screen display mode for displaying the entire LCD 7 will be described. Display program 54F
Displays a thumbnail 201 or the like in a predetermined range of the display area of the screen of the LCD 7 when activated, as shown in FIG.

When a predetermined icon or a predetermined key of the keyboard 5 is operated, the display program 54F displays FIG.
As shown in the figure, the thumbnail 201 and the like are displayed on the entire display area of the screen of the LCD 7. When the display program 54F displays an image on the entire display area of the screen of the LCD 7, the personal computer 1 operates the jog dial 4, the touch pad 6, the keyboard 5, and the like except for the operation of a specific key combination. Then, an input is accepted as an operation on the display program 54F.

When the thumbnail 301 or the like is displayed in a predetermined range of the display area of the screen of the LCD 7, when the icon 301 shown in FIG. 58 is operated, the display program 54F
Indicates that a thumbnail 20 is displayed on the entire display area of the screen of the LCD 7.
1 or the like is displayed. When the thumbnail 301 or the like is displayed on the entire display area of the screen of the LCD 7, when the icon 301 shown in FIG. 58 is operated, the display program 54F is displayed.
Displays the thumbnail 201 and the like in a predetermined range of the display area of the screen of the LCD 7.

When the thumbnail 201 or the like is displayed in the entire display area of the screen of the LCD 7, clicking the icon 311 shown in FIG. 59 causes the display program 54F to
The thumbnail 2 is displayed in a predetermined range of the display area of the screen of the LCD 7.
01 and the like, and activates another application program corresponding to the icon 311.

As described above, the display program 54F can display the thumbnail 201 and the like on the entire display area of the screen of the LCD 7 when the operation of the icon 301 or the predetermined key of the keyboard 5 is operated. LCD7
When the thumbnail 201 or the like is displayed in the entire display area of the screen of, the display program 54F can directly start another application program in response to the operation of the icon 311. By displaying the thumbnail 201 or the like on the entire screen of the LCD 7, it is possible to prevent the user from erroneous operation such as operating another application program.

When another application program corresponding to the icon 311 is started, the user often wants to link the display program 54F with the other application program.
4F automatically displays the thumbnail 201 and the like in a predetermined range of the display area of the screen of the LCD 7. The user can operate the display program 54F and other application programs more efficiently.

Next, the processing of the display program 54F and the reading program 54G executed by the CPU 51 will be described.

FIG. 60 is a flowchart for explaining the content reading process of the display program 54F and the reading program 54G. In step S11, the reading program 54G reads the number of contents stored in the memory stick 116 via the memory stick interface 114.
The reading program 54G is the memory stick 11
Display program 5 to display the number of contents stored in
Supply to 4F.

In step S12, the reading program 54G reads the memory stick interface 1
The contents stored in the memory stick 116 are sequentially read via the memory 14, and the read contents are supplied to the display program 54F. The process of reading the content from the memory stick 116 by the reading program 54G is executed in parallel with the following process.

In step S13, the processing manager 151 of the display program 54F obtains the number of contents read by the reading program 54G based on the data supplied from the reading program 54G. In step S14, the processing manager 151 of the display program 54F specifies the first content read by the reading program 54G.

In step S15, the processing manager 151 of the display program 54F calculates a position at which the thumbnail 201 corresponding to the content is displayed. In step S16, the content processing routine 152 of the display program 54F generates a thumbnail 201 corresponding to the read content. In step S17, the content processing routine 152 of the display program 54F displays the thumbnail 201 at the position calculated by the processing manager 151. Content processing routine 1
52 indicates that the thumbnail 201 is not displayed when the position where the thumbnail 201 is displayed is outside the display area of the LCD 7.

[0241] In step S18, the display program 54F determines whether or not the thumbnails 201 corresponding to all the read contents have been generated, and determines that the thumbnails 201 corresponding to all the contents have not been generated. If it has, the process proceeds to step S19, and the processing manager 151 of the display program 54F specifies the next content read by the reading program 54G.

In step S20, the processing manager 151 of the display program 54F calculates the number of contents that the reading program 54G has finished reading, based on the data supplied from the reading program 54G.
Returning to step S15, the process of generating the thumbnail 201 is repeated.

If it is determined in step S18 that thumbnails 201 corresponding to all the contents for which reading has been completed have been generated, the process proceeds to step S21, where the display program 54F reads all the contents stored in the memory stick 116. If it is determined that all the contents stored in the memory stick 116 have not been read, the process returns to step S12, and the processing is repeated from reading the contents.

If it is determined in step S21 that all the contents stored on the memory stick 116 have been read, the thumbnail 2
01 has been generated and the predetermined thumbnail 201 has been generated, and the process ends.

As described above, the display program 54F and the reading program 54G correspond to the memory stick 11
6, the content is read out sequentially, and a thumbnail 201 is generated in correspondence with the read out content.
D7 can be displayed.

Next, the process of displaying audio data by the display program 54F will be described with reference to the flowchart in FIG. In step S31, the display program 54F divides the thumbnail 201 having a predetermined size into a predetermined number of areas corresponding to the size of the audio data. The display program 54F increases the number of divisions of the thumbnail 201 when the audio data is large, and decreases the number of divisions of the thumbnail 201 when the audio data is small.

[0247] In step S32, the display program 54F extracts, from the audio data, data of a predetermined length corresponding to the number of divisions (the number of areas) of the thumbnail 201. In step S33, the display program 54F
Converts the extracted data into RGB data (the same number of RGB data as the number of areas) by the process described with reference to FIG. In step S34, the display program 54F sets each data of RGB in each of the areas of the thumbnail 201 generated by the division.

[0248] In step S35, the display program 54F performs a blurring process (blur process) on the thumbnail 201. In step S36, the display program 54F overwrites a predetermined position of the thumbnail 201 with a text indicating an attribute corresponding to the audio data, and the process ends.

As described above, the display program 54F can generate the thumbnail 201 of audio data corresponding to the size of audio data. Display program 54
F generates a thumbnail 201 corresponding to data such as text by the same processing.

Next, the process of displaying a line view by the display program 54F will be described with reference to the flowchart in FIG. In step S51, the display program 54F determines the number of axes 221. For example,
The display program 54F sets the number of axes 221 to 1 when displaying only the thumbnail 201, and sets the number of axes 221 to 2 when displaying the thumbnail 201 and the text 211.
And

In step S52, the display program 54F calculates the axis 221 based on the equation (1) or (2).
Determine the orientation of In step S53, the display program 54F determines the display position of the thumbnail 201 based on the axis 221.

[0252] In step S54, the display program 54F determines whether or not to display the text 211 corresponding to the content.
If it is determined that 11 is to be displayed, the process proceeds to step S55, and the arrangement of the text 211 is determined based on the axis 221. In step S56, the display program 54F
Displays the text 211 at the position determined in the process of step S55, and proceeds to step S57.

When it is determined in step S54 that the text 211 corresponding to the content is not to be displayed,
Since the process of displaying the text 211 is not required, the processes of steps S55 and S56 are skipped,
The procedure proceeds to step S57.

[0254] In step S57, the display program 54F moves the position determined by the processing in step S53 to the position determined in step S53.
The thumbnail 201 is displayed, the process returns to step S52, and the display process is repeated.

As described above, the display program 54F
The thumbnail 201 and the text 211 are displayed based on the open axis 221 such as a straight line or a curve.

Next, the process of displaying a loop view by the display program 54F will be described with reference to the flowchart in FIG. In step S71, the display program 54F determines the number of axes 241. For example,
The display program 54F sets the number of axes 241 to 1 when displaying only the thumbnail 201, and sets the number of axes 241 to 2 when displaying the thumbnail 201 and the text 211.
And

[0257] In step S72, the display program 54F determines the shape of the axis 241. In step S73, the display program 54F determines the display position of the thumbnail 201 based on the axis 241 by, for example, Expression (6).

[0258] In step S74, the display program 54F determines whether or not to display the text 211 corresponding to the content.
If it is determined that 11 is to be displayed, the process proceeds to step S75, and the arrangement of the text 211 is determined based on the axis 241. In step S76, the display program 54F
Displays the text 211 at the position determined by the processing in step S75, and proceeds to step S77.

When it is determined in step S74 that the text 211 corresponding to the content is not to be displayed,
Since the process of displaying the text 211 is not required, the processes of steps S75 and S76 are skipped,
The procedure proceeds to step S77.

[0260] In step S77, the display program 54F moves the position determined by the processing in step S73 to the position determined by step S73.
The thumbnail 201 is displayed, the process returns to step S73, and the display process is repeated.

As described above, the display program 54F
The thumbnail 201 and the text 211 are displayed based on a closed axis 241 such as a circle or an ellipse.

Next, the process of displaying a spiral view by the display program 54F will be described with reference to the flowchart in FIG. In step S91, the display program 54F determines the number of axes 261. For example, when displaying only the thumbnail 201, the display program 54F sets the number of axes 261 to 1, and
When displaying 1 and the text 211, the number of axes 261 is set to 2.

In step S92, the display program 54F determines whether or not the selection of the thumbnail 201 has been input by operating the jog dial 4, the keyboard 5, or the touch pad 6, and the selection of the thumbnail 201 has been input. If it is determined that there is not, step S9
Proceed to 3 to set a spiral with a large radius r on the shaft 261 and proceed to step S95.

At step S92, the thumbnail 20
If it is determined that selection 1 has been input, the process proceeds to step S94, and the display program 54F sets a spiral with a smaller radius r on the axis 261 in accordance with the frequency of selection input per unit time. The process proceeds to step S95.

[0265] In step S95, the display program 54F calculates the thumbnail 201 based on the axis 261 by using, for example, Expressions (11), (12), and (13).
Determine the display position of.

In step S96, the display program 54F determines whether or not to display the text 211 corresponding to the content.
If it is determined that 11 is to be displayed, the process proceeds to step S97, and the arrangement of the text 211 is determined based on the axis 261. In step S98, the display program 54F
Displays the text 211 at the position determined in the process of step S97, and proceeds to step S99.

When it is determined in step S96 that the text 211 corresponding to the content is not to be displayed,
Since the process of displaying the text 211 is not necessary, the processes of steps S97 and S98 are skipped,
The procedure proceeds to step S99.

In step S99, the display program 54F moves the position determined by the processing in step S95 to
The thumbnail 201 is displayed, the process returns to step S92, and the display process is repeated.

As described above, the display program 54F displays the thumbnail 201 and the text 211 based on the spiral axis 261. If it is determined that the selection of the thumbnail 201 has been input, the display program 54F determines the thumbnail 201 based on the spiral axis 261 having a small radius r.
And the text 211 are displayed.

Next, the process of moving the icon 202 by the display program 54F will be described with reference to the flowchart in FIG. In step S111, the processing manager 151 of the display program 54F selects one of the icons 202 based on the input from the touch pad 6.
It is determined whether or not is clicked, and any icon 2
If it is determined that 02 has not been clicked, the process returns to step S111, and the determination process is repeated until one of the icons 202 is clicked.

If it is determined in step S111 that any of the icons 202 has been clicked, the flow advances to step S112, where the processing manager 151 of the display program 54F calculates the final display position of each icon 202. I do.

[0272] In step S113, the processing manager 151 of the display program 54F executes the processing in step S112.
The display positions of the respective icons 202 are calculated based on the final display positions of the respective icons 202 and the elapsed time from the click, which are calculated in the processing of (1).
In step S114, the icon processing routine 152 of the display program 54F displays the icon 202 at the display position calculated in the processing of step S113.

The icon 202 in step S114
Is executed at a cycle set by the processing manager 151. By appropriately selecting the processing cycle of the display of the icon 202, the icon 202 is displayed as if it is moving.

In step S115, the processing manager 151 of the display program 54F determines whether each icon 202 has been displayed at the final display position, and each icon 202 has been displayed at the final display position. If it is determined that there is no icon, the process returns to step S113, and the process of displaying the icon is repeated.

If it is determined in step S115 that each icon 202 has been displayed at the final display position, the process returns to step S111, and the processing is repeated from the processing of determining whether or not icon 202 has been clicked.

As described above, the display program 54F can display the icon 202 so as to move at a predetermined speed when the icon 202 is clicked.

Next, the process of displaying an afterimage by the display program 54F will be described with reference to the flowchart in FIG. In step S131, the display program 54F draws the already displayed image with a reduced brightness (for example, 80%).

[0278] In step S132, the display program 54F draws a new image by overwriting the image drawn in step S131, returns to step S131, and repeats the drawing process.

As described above, the display program 54F draws the image so that the brightness of the already drawn image gradually decreases.
Since the new image is overwritten, the afterimage can be easily displayed.

Next, the state transition processing by the display program 54F will be described with reference to the flowchart in FIG. In step S151, the display program 54F displays the current thumbnail 201 or icon 20.
The original state of transition, such as the display position of 2, is recorded. In step S152, the display program 54F determines the state of the transition destination such as the display position of the destination of the thumbnail 201 or the icon 202.

[0281] In step S153, the display program 54F obtains the importance of the transition. For example, the importance of the transition is predetermined for each transition, and the display program 54F
Is stored in In step S154, the display program 54F determines a transition function based on the importance of the transition. For example, the display program 54F selects a transition function that makes a state transition slowly when the importance of the transition is large, and selects a transition function that makes a state transition quickly when the importance of the transition is small.

In step S155, the display program 54F calculates the next state based on the transition function in accordance with the elapsed time. In step S156, the display program 54F shifts to the state calculated in the processing in step S155. For example, the display program 54F calculates the positions of the thumbnail 201 and the icon 202 corresponding to the elapsed time in Step S155, and adds the thumbnail 2 to the calculated position in Step S156.
01 and the icon 202 are displayed.

In step S157, the display program 54F determines whether or not to change the state of the transition destination based on the signals from the jog dial 4, the touch pad 6, or the keyboard 5, and determines whether or not to change the state of the transition destination. If it is determined that is not changed, the process proceeds to step S158.

If it is determined in step S157 that the state of the transition destination is to be changed, the flow advances to step S159 to set the current state to the original state of the transition. In step S160, the display program 54F determines the state of the transition destination, such as the display position of the destination of the thumbnail 201 or the icon 202.

[0285] In step S161, the display program 54F obtains the importance of the new transition. Step S
At 162, the display program 54F determines a transition function based on the importance of the new transition.

[0286] In step S158, the display program 54F compares the current state with the state of the transition destination, determines whether or not the state of the transition destination has been reached, and has reached the state of the transition destination. If it is determined that there is no state, the process returns to step S155, and the processing is repeated from the processing of calculating the next state.

If it is determined in step S158 that the state of the transition destination has been reached, the processing ends.

As described above, the display program 54F
Based on the transition function, the display state and the like are changed, and when a request is made during the transition, the state is changed to the requested state. Further, since the display program 54F selects the transition function based on the importance of the transition, the transition is performed relatively slowly so that the user can surely recognize the state transition in the transition having a high importance. In the case of a transition having a low degree of importance, the state is quickly shifted.

Next, the process of enlarged display by the display program 54F will be described with reference to the flowchart in FIG. In step S181, the display program 54F determines whether or not the thumbnail 201 has been clicked on the basis of the signal from the touch pad 6, and if it is determined that the thumbnail 201 has not been clicked, the process returns to step S181. Is repeated.

If it is determined in step S181 that the thumbnail 201 has been clicked, the flow advances to step S182, and the display program 54F determines whether the clicked thumbnail 201 is located at the center of the window.

If it is determined in step S182 that the clicked thumbnail 201 is not located at the center of the window, the process proceeds to step S183, where the display program 54F displays the clicked thumbnail 201 such that it is located at the center of the window. Is changed, the process returns to step S181, and the process is repeated.

If it is determined in step S182 that the clicked thumbnail 201 is located at the center of the window, the process proceeds to step S184, where the display program 54F enlarges and displays the clicked thumbnail 201 (when the thumbnail 201 is a still image). If it corresponds to data, it is displayed in its original size, if it corresponds to moving image data, a moving image is generated, and if it corresponds to audio data, audio is reproduced), the process returns to step S181, and the process is performed. repeat.

As described above, when the thumbnail 201 is clicked, the display program 54F displays the clicked thumbnail 201 at the center or enlarges the displayed thumbnail 201.
01 can be quickly known by simple operation.

Next, the process of displaying the frame 281 by the content processing routine 15 of the display program 54F will be described with reference to the flowchart of FIG. In step S201, the content processing routine 152
Determines whether the thumbnail 201 displayed by the user is selected, and determines whether the thumbnail 201 displayed by the user is selected.
If it is determined that 01 has not been selected, step S
Returning to 201, the determination process is repeated until the thumbnail 201 displayed by the user is selected.

If it is determined in step S201 that the thumbnail 201 displayed by the user is selected, the process proceeds to step S202, and the content processing routine 152 starts counting the elapsed time. The process of counting up the elapsed time is continued in the execution of the following process.

[0296] In step S203, the content processing routine 152 determines, for example, a brightness change function, for example, as shown in FIG. In step S204, the content processing routine 152 determines the frame 2 based on the elapsed time.
The lightness of 81 is calculated. In step S205, the content processing routine 152 displays the brightness frame 281 calculated in the processing in step S204.

In step S206, the content processing routine 152 determines that the thumbnail 2
It is determined whether or not 01 has been selected, and if it is determined that the thumbnail 201 displayed by the user has been selected, the process proceeds to step S204, and the process of displaying the frame 281 is repeated.

If it is determined in step S206 that the thumbnail 201 displayed by the user is not selected, the process proceeds to step S207, where the content processing routine 152 deletes the frame 281 and returns to step S201 to return to the frame 281. Is repeated.

As described above, the display program 54F can display the frame 281 in which the brightness is periodically changed on the selected thumbnail 201. The display program 54F performs a similar process to the frame 281 in which the saturation or hue is periodically changed for the selected thumbnail 201.
Can be displayed.

Next, the process of displaying the additional attribute display 291 by the content processing routine 15 of the display program 54F will be described with reference to the flowchart of FIG. In step S221, the display program 54F
Determines whether or not a display change has been input based on signals supplied from the jog dial 4, the touch pad 6 or the keyboard 5, respectively. If it is determined that the display change has not been input, Proceeding to S222, the content processing routine 152 determines whether or not the thumbnail 201 displayed by the user is selected.

If it is determined in step S222 that the thumbnail 201 displayed by the user is selected, the process proceeds to step S223, and the content processing routine 152 determines that the thumbnail 201 has been selected for a predetermined time (for example, (1 second) has elapsed.

[0302] If it is determined in step S223 that the predetermined time has elapsed, the process proceeds to step S224.
The content processing routine 152 displays an additional attribute display 291 including a text corresponding to the thumbnail 201 and having a translucent frame and background, returns to step S221, and repeats the processing.

[0303] If it is determined in step S221 that a change in display has been input, processing such as moving the thumbnail 201 has been executed, so the flow advances to step S225, and the content processing routine 152 determines The corresponding additional attribute display 291 is deleted, the process returns to step S221, and the process is repeated.

[0304] If it is determined in step S222 that the thumbnail 201 displayed by the user is not selected, the display of the additional attribute 291 does not need to be performed. Additional attribute display 2 corresponding to 201
91 is deleted, the process returns to step S221, and the process is repeated.

If it is determined in step S223 that the predetermined time has not elapsed, the flow advances to step S225, where the content processing routine 152
The additional attribute display 291 corresponding to 01 is deleted, the process returns to step S221, and the process is repeated.

As described above, the display program 54F displays the additional attribute display 291 corresponding to the selected thumbnail 201 after a predetermined time has elapsed after the thumbnail 201 has been selected. And the operation of the user can be prevented.

Since the frame and background of the additional attribute display 291 displayed by the display program 54F are translucent, the user
It is possible to confirm the thumbnail 201 and the like arranged below the additional attribute display 291 (the back side of the screen).

Next, the LC by the display program 54F
FIG. 71 shows a process of selecting the first display mode in which the thumbnail 201 and the like are displayed in a predetermined area on the display surface of D7 or the second display mode in which the thumbnail 201 and the like are displayed on the entire display surface of the LCD 7. This will be described with reference to a flowchart. In step S251, the display program 54F executes the first display mode (displays a thumbnail 2 in a predetermined area on the display surface of the LCD 7) to display a frame of the predetermined area.
01 etc.).

[0309] In step S252, the display program 54F determines whether or not another application program has been started. If it is determined that another application program has been started, the display program 54F sets the first display mode. Is returned, and the process returns to step S252 to repeat the determination process.

If it is determined in step S252 that another application program has not been started, the flow advances to step S253 to display the display program 54F.
Determines whether or not a change in the display mode has been input based on signals supplied from the jog dial 4, the touch pad 6, or the keyboard 5, respectively.

If it is determined in step S253 that the display mode has not been changed, the display mode does not need to be changed, and the process returns to step S252.
The determination process is repeated.

If it is determined in step S253 that a change of the display mode has been input, step S254 is performed.
Then, the display program 54F sets the second display mode for displaying the entire display screen of the LCD 7.

[0313] In step S255, the display program 54F determines whether or not another application program has been activated. If it is determined that another application program has not been activated, the display program 54F proceeds to step S25.
The process proceeds to step S6, where it is determined whether or not a change in the display mode has been input based on the signals supplied from the jog dial 4, the touch pad 6, or the keyboard 5, respectively.

If it is determined in step S256 that the change of the display mode has not been input, the display mode does not need to be changed, and the process returns to step S255.
The determination process is repeated.

If it is determined in step S256 that a change of the display mode has been input, step S251
The display program 54F sets the first display mode and repeats the processing.

[0316] If it is determined in step S255 that another application program has been started, the display mode is changed to the first display mode. Therefore, the flow returns to step S251, and the display program 54F sets the first display mode. repeat.

Thus, the display program 54F switches between the first display mode and the second display mode in response to the input, and switches to the first display mode when another application program is started. be able to.

The series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software can execute various functions by installing a computer built into dedicated hardware or installing various programs. It is installed from a program storage medium to a possible general-purpose personal computer or the like.

As shown in FIG. 5, a program storage medium for storing a program installed in a computer and made executable by the computer includes a magnetic disk 121 (including a floppy disk) and an optical disk 122 (CD-ROM ( Compact Disc-Read Only Memory),
DVD (including Digital Versatile Disc), magneto-optical disk 123 (including MD (Mini-Disc)), package media including semiconductor memory 124, or an RO in which programs are temporarily or permanently stored
M, the HDD 67 and the like. The storage of the program in the program storage medium can be performed by a router,
This is performed using a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting via an interface such as a modem 75.

[0320] In this specification, the steps of describing a program stored in a program storage medium may be performed not only in a time-series manner but also in a time-series manner in the order described. , And also includes processes executed in parallel or individually.

In the present specification, the system is
It represents the entire device composed of a plurality of devices.

[0322]

According to the information processing apparatus according to the first aspect, the information processing method according to the third aspect, and the program storage medium according to the fourth aspect, the operation of the user is detected, and the operation corresponding to the data is detected. A thumbnail to be generated is generated, and the display position of the thumbnail is designated according to the frequency of the detected operation in the unit time, and the display is controlled so that the thumbnail is displayed at the designated position. Thus, it is possible to reliably know that an operation has been performed on the thumbnail.

[Brief description of the drawings]

FIG. 1 is a perspective view showing an external appearance of a notebook personal computer 1 according to an embodiment of the present invention.

FIG. 2 is a plan view of the main body 2. FIG.

FIG. 3 is an enlarged view of the jog dial 4;

FIG. 4 is a side view of the personal computer 1.

FIG. 5 is a diagram showing a configuration of an embodiment of the personal computer 1.

FIG. 6 is a diagram illustrating a configuration of a display program 54F and a reading program 54G.

FIG. 7 is a diagram illustrating a screen displayed on the LCD 7.

FIG. 8 is a diagram illustrating a screen displayed on the LCD 7.

FIG. 9 is a diagram illustrating a screen displayed on the LCD 7.

FIG. 10 is a diagram illustrating thumbnails corresponding to audio data.

FIG. 11 is a diagram illustrating a procedure for generating a thumbnail for displaying an image corresponding to audio data.

FIG. 12 is a diagram illustrating an example of a thumbnail displaying an image corresponding to audio data.

FIG. 13 is a diagram illustrating an example of a thumbnail displaying an image corresponding to text data.

FIG. 14 is a diagram illustrating a conventional arrangement of thumbnails.

FIG. 15 is a diagram illustrating a line view.

FIG. 16 is a diagram illustrating a shaft 221-1 and a shaft 221-2.

FIG. 17 is a diagram illustrating a line view.

FIG. 18 is a diagram illustrating a loop view.

FIG. 19 is a diagram illustrating a loop view.

FIG. 20 is a diagram illustrating a shaft 241-1 and a shaft 241-2.

FIG. 21 is a diagram illustrating a spiral view.

FIG. 22 is a diagram illustrating a spiral view.

FIG. 23 is a diagram illustrating a shaft 261.

FIG. 24 is a diagram illustrating a square view.

FIG. 25 is a diagram illustrating a square view.

FIG. 26 is a diagram illustrating movement of an icon 202.

FIG. 27 is a diagram illustrating movement of an icon 202.

FIG. 28 is a diagram illustrating the afterimage processing.

FIG. 29 is a diagram illustrating the afterimage processing.

FIG. 30 is a diagram illustrating a state transition.

FIG. 31 is a diagram illustrating a transition function.

FIG. 32 is a diagram illustrating a state transition.

FIG. 33 is a diagram illustrating a state transition.

FIG. 34 is a diagram illustrating a process of changing the display position of the thumbnail 201.

FIG. 35 is a diagram showing an example of changing the display position of a thumbnail 201.

36 is a diagram illustrating an example of changing the display position of a thumbnail 201. FIG.

FIG. 37 is a diagram illustrating selection of a thumbnail 201.

38 is a diagram illustrating selection of a thumbnail 201. FIG.

FIG. 39 is a diagram illustrating an enlarged display.

40 is a diagram illustrating selection of a thumbnail 201. FIG.

FIG. 41 is a diagram illustrating selection of a thumbnail 201.

FIG. 42 is a diagram illustrating an enlarged display.

FIG. 43 is a diagram illustrating selection of a thumbnail 201.

FIG. 44 is a diagram illustrating selection of a thumbnail 201.

FIG. 45 is a diagram illustrating an enlarged display.

FIG. 46 is a diagram illustrating selection of a thumbnail 201.

FIG. 47 is a diagram illustrating selection of a thumbnail 201.

FIG. 48 is a diagram illustrating enlarged display.

FIG. 49 is a diagram for explaining importance.

FIG. 50 is a diagram illustrating an example of a process corresponding to importance.

FIG. 51 is a diagram illustrating display of a frame 281.

FIG. 52 is a diagram illustrating an example of a change in brightness or saturation of a frame 281 corresponding to the passage of time.

FIG. 53 is a diagram illustrating an example of a change in hue of a frame 281 corresponding to the passage of time.

FIG. 54 is a diagram illustrating a process of displaying an additional attribute display 291.

FIG. 55 is a diagram showing a display example of an additional attribute display 291.

FIG. 56 is a diagram showing a display example in which a thumbnail 201 or the like is displayed in all or a part of the screen of the LCD 7;

57 is a diagram illustrating a display example in which a thumbnail 201 and the like are displayed on the entire screen of the LCD 7. FIG.

FIG. 58 is a diagram illustrating an icon 301.

FIG. 59 is a diagram illustrating an icon 311.

FIG. 60 is a flowchart illustrating processing for reading content.

FIG. 61 is a flowchart illustrating a process of displaying audio data.

FIG. 62 is a flowchart illustrating a process of displaying a line view.

FIG. 63 is a flowchart illustrating a process of displaying a loop view.

FIG. 64 is a flowchart illustrating a process of displaying a spiral view.

FIG. 65 is a flowchart illustrating a process of moving an icon 202.

FIG. 66 is a flowchart illustrating a process of displaying an afterimage.

FIG. 67 is a flowchart illustrating a state transition process.

FIG. 68 is a flowchart illustrating a process of enlarged display.

FIG. 69 is a flowchart illustrating a process of displaying a frame 281.

FIG. 70 is a flowchart illustrating a process of displaying an attribute.

FIG. 71 is a flowchart illustrating a process of selecting a display mode.

[Explanation of symbols]

1 personal computer, 4 jog dial,
5 keyboard, 6 touchpad, 51 CP
U, 54 RAM, 54E OS, 54F display program, 54G reading program, 67
HDD, 80 communication network, 121 magnetic disk, 122 optical disk, 123 magneto-optical disk, 124 semiconductor memory, 114 memory stick interface, 115 memory stick slot, 116 memory stick, 151
Processing manager, 152-1 to 152-N content processing routine, 153-1 to 153-N icon processing routine, 201 thumbnail, 202
Icon, 211 text, 221-1 and 2
21-2 axes, 241-1 and 241-2 axes,
261 axis, 281 frame, 291 additional attribute display,
301 icons, 311 icons

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 H04N 5/91 NF term (Reference) 5B050 CA07 EA12 FA02 FA09 FA13 FA16 GA08 5B075 PP03 PQ02 PQ62 PQ72 PR00 PR08 5C052 AA17 AB04 AC08 CC11 DD02 DD04 DD06 EE02 EE03 EE08 GA03 GA08 GA09 GB06 GB07 GC03 GC04 GC05 GE08 5C053 FA14 FA27 GB11 GB36 HA29 JA07 JA16 KA04 KA24 LA06 LA11 LA15 5E501 AC15 AC37 BA05 CA14 DA14 EA13 FA

Claims (4)

[Claims] 1. A detecting means for detecting an operation of a user, a generating means for generating a thumbnail corresponding to data, and a display of the thumbnail corresponding to a frequency of an operation detected by the detecting means in a unit time. An information processing apparatus comprising: a designation unit that designates a position; and a display control unit that controls display so that the thumbnail is displayed at a position designated by the designation unit. 2. The display device according to claim 1, wherein the designation unit designates a display position of the thumbnail on a virtual spiral having a radius corresponding to a frequency of the operation in a unit time.
An information processing apparatus according to claim 1. A detecting step of detecting an operation of a user; a generating step of generating a thumbnail corresponding to data; and a thumbnail corresponding to a frequency of the operation detected in the processing of the detecting step in a unit time. And a display control step of controlling display so that the thumbnail is displayed at the position specified by the processing of the specifying step. 4. A detecting step of detecting a user operation, a generating step of generating a thumbnail corresponding to data, and the thumbnail corresponding to the frequency of the operation detected in the processing of the detecting step in a unit time. And a display control step of controlling display so that the thumbnail is displayed at the position specified by the processing of the specifying step. A program storage medium that stores programs.