CN109947373A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN109947373A CN109947373A CN201910246043.0A CN201910246043A CN109947373A CN 109947373 A CN109947373 A CN 109947373A CN 201910246043 A CN201910246043 A CN 201910246043A CN 109947373 A CN109947373 A CN 109947373A
- Authority
- CN
- China
- Prior art keywords
- data
- primary sources
- local
- processing method
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the application provides a data processing method and device. The data processing method comprises the following steps: determining first type data in the local data, wherein the first type data comprises cold data and/or accumulated data, and the accumulated data is data stored for more than a preset time; migrating the first type of data from the local storage to the cloud storage. According to the method and the device, the first type of data is uploaded to the cloud storage, so that the storage space of the local storage can be saved, the performance of the system can be improved, and the user experience is improved.
Description
Technical field
This application involves field of computer technology, in particular to a kind of data processing method and device.
Background technique
With the fast development of social informatization, such as internet+, mobile internet, human behavior all urging daily
A large amount of data are given birth to, human society has stepped into the mass data epoch.
However, mass data can make the storage resource relative deficiency of system, and then asking for system performance decline can be caused
Topic.
Summary of the invention
The embodiment of the present application is designed to provide a kind of data processing method and device, is existed in the prior art with improving
Mass data storage caused by system performance decline the problem of.
In view of this, in a first aspect, the embodiment of the present application provides a kind of data processing method, this method comprises: determining
Primary sources in local data, primary sources include cold data and/or accumulation data, and it is super for storage time to accumulate data
Cross the data of scheduled duration；Primary sources are migrated from local storage to cloud storage.
Therefore, by the way that primary sources are uploaded to cloud storage, so as to save the memory space of local storage, into
And the performance of system can be improved, improve user experience.
In one embodiment, the primary sources in local data are determined, comprising: according to metadata, determine local number
Primary sources in, metadata record have the attribute information of data.
Therefore, primary sources are quickly found from the data of local magnanimity by metadata.
In one embodiment, primary sources are cold data, and attribute information includes reading frequency or writing frequency, according to first number
According to determining the primary sources in local data, comprising: according to attribute information, determines the reading frequency of local data or write frequency,
Reading frequency is the reading number in preset time to local data, and writing frequency is to write number to local data in preset time；?
In the case where number is read less than default reading number, determine that local data is cold data；Or, writing number less than default writing number
In the case of, determine that local data is cold data.
Therefore, cold data is quickly determined from the data of local magnanimity by metadata.
In one embodiment, primary sources are accumulation data, and attribute information includes the creation time of data, determine this
Primary sources in ground data, comprising: according to attribute information, determine the creation time of local data；Creation time with work as
In the case that the interval time of preceding time is greater than preset time period, determine local data for accumulation data.
Therefore, the migration of the accumulation data can file the file of early stage creation, to save local storage space.
In one embodiment, attribute information includes migration mark, and migration mark is for indicating whether local data migrates
Into cloud storage, data processing method further include: after the completion of primary sources migration, the corresponding migration of primary sources is marked
Knowledge is set as the first value, and the first value indicates that primary sources are had moved to cloud storage.
Therefore, the data having moved in local data are recorded by migration mark, consequently facilitating to the number having moved
According to being managed.
In one embodiment, attribute information includes the routing information of the size and data of data in cloud storage, data
Processing method further include: after the completion of primary sources migration, delete primary sources in local storage, and by he first-class numbert
According to size and routing information record in the metadata.
Therefore, the state in local data is recorded by updating migration mark, consequently facilitating carrying out pipe to local data
Reason.
In one embodiment, data processing method further include: obtain the data access request of primary sources；According to member
Routing information of the primary sources of data record in cloud storage, by primary sources from the locally downloading storage of cloud storage
Device.
Therefore, data move back be for users it is transparent, only wait and moving back completions when triggering is moved back, thus reality
Transparent access is showed.
In one embodiment, attribute information includes mark of moving back, and whether mark of moving back for indicating primary sources
It is moved back to local storage, data processing method further include: after the completion of primary sources are moved back, primary sources are corresponding
Mark of moving back be set as second value, second value is for indicating that primary sources have been moved back to local storage.
Therefore, the transition state of primary sources is recorded by moving back mark, consequently facilitating to the he first-class numbert moved back
According to being managed.
In one embodiment, data processing method further include: according to attribute information, determine the he first-class numbert moved back
According to；The primary sources moved back are deleted in local storage, and by the corresponding mark of moving back of the primary sources moved back
It is set as third value, third value is for indicating that primary sources are not moved back to local storage.
Therefore, by clearing up the data moved back, to avoid occupying excessive be locally stored.
In one embodiment, metadata includes basic metadata and extended metadata, and basic metadata is to be stored in number
According to the metadata in library, extended metadata is the metadata being stored in the extended attribute of file.
Second aspect, this application provides a kind of data processing equipment, which comprises determining that module, for determining this
Primary sources in ground data, primary sources include cold data and/or accumulation data, and accumulating data for storage time is more than
The data of scheduled duration；Transferring module, for migrating primary sources from local storage to cloud storage.
Therefore, by the way that primary sources are uploaded to cloud storage, so as to save the memory space of local storage, into
And the performance of system can be improved, improve user experience.
The third aspect stores on computer readable storage medium this application provides a kind of computer readable storage medium
There is data processor, the data processing method such as any one of first aspect is realized when data processor is executed by processor
The step of.
Fourth aspect, the application provide a kind of electronic equipment, comprising: processor, memory and bus, memory are stored with
The executable machine readable instructions of processor pass through bus communication, machine when electronic equipment operation between processor and memory
The method of any optional implementation of first aspect or first aspect is executed when device readable instruction is executed by processor.
5th aspect, the application provides a kind of computer program product, when computer program product is run on computers,
So that computer executes the method in any possible implementation of first aspect or first aspect.
Above objects, features, and advantages to enable the embodiment of the present application to be realized are clearer and more comprehensible, be cited below particularly compared with
Good embodiment, and cooperate appended attached drawing, it is described in detail below.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application will make below to required in the embodiment of the present application
Attached drawing is briefly described, it should be understood that the following drawings illustrates only some embodiments of the application, therefore should not be seen
Work is the restriction to range, for those of ordinary skill in the art, without creative efforts, can be with
Other relevant attached drawings are obtained according to these attached drawings.
Fig. 1 is the operating mode schematic diagram of the data processing method and device of the embodiment of the present application；
Fig. 2 is the frame diagram of the processor of the embodiment of the present application；
Fig. 3 is the flow chart of the first embodiment of data processing method provided by the present application；
Fig. 4 is the flow chart of the second embodiment of data processing method provided by the present application；
Fig. 5 is the flow chart of the 3rd embodiment of data processing method provided by the present application；
Fig. 6 is the flow chart of the fourth embodiment of data processing method provided by the present application；
Fig. 7 is the flow chart of the 5th embodiment of data processing method provided by the present application；
Fig. 8 is the flow chart of the sixth embodiment of data processing method provided by the present application；
Fig. 9 is the flow chart of the 7th embodiment of data processing method provided by the present application；
Figure 10 is the flow chart of the 8th embodiment of data processing method provided by the present application；
Figure 11 is the flow chart of the 9th embodiment of data processing method provided by the present application；
Figure 12 is the block diagram of data processing equipment provided by the present application；
Figure 13 is the structural block diagram of the device of the embodiment of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application is described.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.Meanwhile the application's
In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
Show that the whole world formally entered ZB in 2010 according to the research report of internationally famous data survey company IDC
In (Zettabyte, damp byte, 1ZB are equivalent to the hard-disk capacity of the 1000000000 1TB) epoch, global metadata amount reaches within 2013
4.4ZB, it is contemplated that arrive the year two thousand twenty, global metadata total amount is up to 44ZB, and average annual growth rate is up to 40%.These data are all abundant
Show that human society has stepped into magnanimity big data era.
Currently, splitting data into two class of cold data and dsc data from the utilization rate of data and its visiting frequency.Wherein,
Dsc data refers to that the data for needing frequently to access and frequently call, cold data refer to the data for not accessing and never calling substantially, and
And cold data accounts for the 80%~85% of total amount of data, it is maximum data in data volume.
It should be understood that the dsc data is also referred to as alive data, accordingly, cold data can be described as inactive data, the application
This is not construed as limiting.
For above-mentioned dsc data, user can reduce the delay of system while ensure it the adjusting performance of system to best
It can be accessed by all users for proposing requirements for access.On the contrary, cold data means data mode and inactive, and with
The quantity of the passage of time, these cold datas is increasing, but still contains huge value in these cold datas, certain
Under conditions of be possible to frequently utilized again, so there is still a need for long-term preservations.
However, the mass data being locally stored will lead to the storage resource relative deficiency of system, and then cause system performance
Decline, the problems such as user experience is bad, therefore, are badly in need of a kind of data processing method and device at present.
Referring to Figure 1, Fig. 1 is the operating mode schematic diagram of the data processing method and device of the embodiment of the present application.Service
Device 120 sends to the second client 130 and instructs, so that the second client 130 is inquired in the local storage of the first client 110
Meet the data of primary sources condition, and query result is returned to server 120 by the second client 130.Server 120
It is investigated that asking as a result, determine the primary sources in the local storage of the first client 110, and by the sheet of the first client 110
Primary sources in ground memory are uploaded in cloud storage 140 by the second client 130.
Therefore, the application can be realized the use for allowing and operating the first client 110 by this operating mode shown in FIG. 1
Family without knowing it, the primary sources in the first client 110 is stored onto cloud storage 140, and needing to visit
When asking the primary sources uploaded, primary sources can also be downloaded in the first client 110 from cloud storage 140,
So as to realize transparent filing.
It should be understood that cloud storage 140 is also referred to as cloud storage system, cloud storage, network server etc., the application to this not
It limits.
It should be understood that the cloud storage 140 can also according to actual needs to carry out cloud storage concrete type setting.For example, cloud
Storage 140 can be blue-ray storage, for another example cloud storage 140 can be also Baidu's cloud disk, for another example cloud storage 140 can also be Huawei
Dropbox, the application do not limit this.
In addition, the cloud storage 140 can realize the storage of the primary sources such as cold data, cumulative data, it can externally be provided
Object or NAS (Network Attached Storage, network attached storage) storage service, and it supports S3
(S3Simple Storage Service, simple storage service) interface, CIFS (Common Internet File System,
Universal network file system) interface, NFS (Network File System, Network File System) interface etc., thus the second visitor
Family end 130 and the first client 110 can be communicated by above-mentioned interface with cloud storage 140.
In addition, primary sources include cold data and/or accumulation data, accumulation data are that storage time is more than scheduled duration
Data, for example, the cumulative data be in the first client 110 storage time be more than trimestral data.
It should be understood that the cumulative data is also referred to as historical data, delay data etc., the application is not limited this.
It should be understood that the primary sources can select the concrete type of data according to actual needs, for example, primary sources
It may also include the data of user's selection, the application is not construed as limiting this.
In addition, the transmission direction of the arrows show data flow in Fig. 1.For example, the first client 110 and server 120 it
Between four-headed arrow indicate both sides in either read-write another party data, for another example the second client 130 and service
Unidirectional arrow between device 120 indicates that the second client 130 can only data etc. in reading service device 120.
Although those skilled in the art can also basis it should be understood that the transmission direction of data flow has been specifically exemplified in Fig. 1
Actual demand is configured.For example, the data in the second client 130 can be read in server 120, for another example the second client
130 downloading data, the application can be not construed as limiting this from cloud storage 140.
It should be understood that server 120 can be network server, database server etc..In addition, the first client 110 can also
It is PC (personal computer, PC), tablet computer, smart phone, personal digital assistant (personal
Digital assistant, PDA), mobile unit, wearable device etc..In addition, the second client 130 can also be PC,
Tablet computer, smart phone etc..
In addition, server 120 includes access interface, so that server 120 can externally provide distribution by the access interface
Formula storage service, distributed storage service includes file storage and object storage, to realize dsc data store function.
In addition, server 120 further includes processor, which can send inquiry instruction to the second client 130, and connect
The query result of the second client 130 return is received, and according to query result, carries out Data Migration, the application does not limit this.
In addition, Fig. 2 is the frame diagram of the processor of the embodiment of the present application with continued reference to Fig. 2.The processor includes Web clothes
Business, parsing module, volume object, Peer object, log module and DB (Database, database) module.
Wherein, Web service can be used for issuing instructions or requests.For example, the Web service can be in the first client 110
In local curly hair send volume inquiry request, can also send volume configuring request to the local curly hair in the first client 110, it is also transmittable
Catalogue upload request, also transmittable document alignment request.
It should be understood that the volume in the first client 110 is also referred to as memory, the application is not construed as limiting this.
Although those skilled in the art can also root it should be understood that four kinds of requests of Web service have been specifically exemplified in Fig. 2
The request of Web service is specifically arranged according to actual demand, the application is not construed as limiting this.
Parsing module can be used for parsing information relevant to the local volume in the first client 110, for example, the parsing module
Cluster information (for example, configuration information of cluster) can be parsed, volume information (for example, configuration information of volume) can be also parsed.
Although those skilled in the art is also it should be understood that two kinds of parsing information of parsing module have been specifically exemplified in Fig. 2
The specific parsing information of parsing module can be configured according to actual needs, the application is not construed as limiting this.
Volume object can be used for managing the information of volume.For example, volume object may include the task schedule for realizing task schedule
Module may also include the file scan module for realizing file scan, may also include clear for realizing the file of file clean-up
Module is managed, may also include the file uploading module uploaded for realizing file, may also include for realizing the storage of multiple files
State machine module may also include the volume state monitoring module that can monitor volume information.
Although those skilled in the art can also basis it should be understood that six kinds of modules of volume object have been specifically exemplified in Fig. 2
Actual demand is configured the concrete type of the module of volume object, and the application is not construed as limiting this.
Peer object can be the server object in management cluster.For example, the Peer object may include for monitoring cluster
The cluster monitoring module of state.
Although those skilled in the art can also root it should be understood that a kind of module of Peer object has been specifically exemplified in Fig. 2
It is configured according to concrete type of the actual demand to the module of Peer object, the application is not construed as limiting this.
Log module can be used for record log.
DB module can be used for recording operation note, metadata etc..
Although those skilled in the art is also it should be understood that showing the various pieces of the composition frame of processor in Fig. 2
It can be configured according to actual needs, the application does not limit this.
With continued reference to Fig. 3, Fig. 3 is the flow chart of the first embodiment of data processing method provided by the present application.
The data processing method of the embodiment of the present application the following steps are included:
Step 301, the primary sources in local data are determined, primary sources include cold data and/or accumulation data,
Accumulating data is the data that storage time is more than scheduled duration.
It should be understood that the local data can be described as local file, local data sets etc..Corresponding, primary sources can also claim
For the first class file, first data set etc., the application is not construed as limiting this.
In this step, the second client 130 can obtain the inquiry instruction that server 120 issues, subsequent second client
According to inquiry instruction, the database into server 120 initiates inquiry request at end 130, to obtain query result, and inquiry is tied
Fruit feeds back to server 120.The server 120 determines in the first client 110 according to query result and meets primary sources
The data of condition.
It can also be that the first client 110 can obtain the inquiry instruction that server 120 issues, subsequent first client 110
The data for meeting primary sources condition of itself storage can be determined by the monitoring process of itself, and monitored results are sent
To server 120.The server 120 is determined in the first client 110 and meets primary sources condition according to monitored results
Data.
Step 302, primary sources are migrated from local storage to cloud storage 140.
In this step, which obtains the he first-class numbert stored in the first client 110 according to query result
According to information, wherein the information of primary sources may include size and/or storage location of data etc..Then, server 120
According to the information of primary sources, location information of the primary sources in cloud storage 140 is assigned, wherein location information includes
Storage location etc. of the address, primary sources of cloud storage 140 in cloud storage 140.Then, server 120 is according to upper rheme
Confidence breath, primary sources are migrated from local storage to cloud storage 140.
In addition, the transition process of primary sources can be the parallel upload of multiple primary sources, it can also be for according to order
Mode, successively multiple primary sources are uploaded, the application is not construed as limiting this.
In addition, in the transition process of primary sources, it, can be by primary sources in the biggish situation of primary sources
It is sliced, in order to realize fast transferring.
In addition, although the present embodiment specifically defines that server 120 executes the mode of step 301 and step 302, ability
The technical staff in domain can also be adjusted according to actual needs.For example, can be executed by the processor in server 120
Step 301 and step 302 are stated, the application does not limit this.
In this embodiment, by the way that primary sources are uploaded to cloud storage 140, so as to save local storage
Memory space, and then the performance of system can be improved, improve user experience.
With continued reference to Fig. 4, Fig. 4 is the flow chart of the second embodiment of data processing method provided by the present application.The application
Embodiment is similar to above-mentioned first embodiment, the difference is that:
In the data processing method of the embodiment of the present application, primary sources (the i.e. step 301) packet in local data is determined
It includes:
Step 3011, according to metadata, determine that the primary sources in local data, metadata record have the attribute of data
Information.
In this step, server 120 can determine first in the local data of the first client 110 according to metadata
Class data.
And in the case where the first client 110 and server 120 are linux system, metadata may include basis
Metadata and extended metadata, basic metadata are the metadata for the lane database being stored in server 120, extended metadata
For the metadata being stored in the extended attribute of file.
Basic metadata and extended metadata in order to facilitate understanding, are described below by specific embodiment.
1, extended metadata
Extended metadata may include such as the attribute information in the following table 1.
It should be understood that although the specific attribute information of extended metadata, those skilled in the art has been specifically exemplified in the following table 1
Member can also according to actual needs be configured the specific attribute information of extended metadata, and the application does not limit this.
In addition, the following table 2 is similar, it is subsequent to be not repeated to describe.
Table 1
2, basic metadata
In order to quickly scan matched primary sources, the application from the data of the magnanimity of local memory storage
Database can be added in server 120, database can be just like the attribute information in the following table 2.
Table 2
It should be understood that although the present embodiment specifically defines that in the first client 110 and server 120 be linux system
In the case where, metadata may include basic metadata and extended metadata, but those skilled in the art can also be according to practical need
It asks and guarantees that the system of the first client 110 and server 120 is applicable in be configured to the division of metadata, this Shen
It please not limit this.
Although it should be understood that include basic metadata and extended metadata embodiment defines metadata, this field
Technical staff can also come to carry out metadata related setting according to actual needs, for example, metadata can be only stored in server 120
In lane database, the application is not construed as limiting this.
In this embodiment, in the case where metadata record has the attribute information of data, by metadata come quickly
Primary sources are found from the data of local magnanimity.
With continued reference to Fig. 5, the flow chart of the 3rd embodiment of data processing method provided by the present application.The embodiment of the present application
It is similar to above-mentioned second embodiment, the difference is that:
In the data processing method of the embodiment of the present application, primary sources are cold data, attribute information include read frequency or
Frequency is write, according to metadata, determines that the primary sources (step 3011) in local data includes:
Step 501, it according to attribute information, determines the reading frequency of local data or writes frequency, reading frequency is in preset time
To the reading number of local data, writing frequency is to write number to local data in preset time.
It should be understood that the preset time is also referred to as rental period, period etc., the application is not limited this.
It should be understood that read frequency in addition to indicate preset time in the reading number of local data other than, can also indicate read data
Grade.And in the case where being provided with the grade for reading data, the threshold value of also settable each grade, for example, reading data time
Number is set as grade 1 less than 1,000 times, reads data times and is set as grade 2 between 1,000 times to 10,000 times, the application is to this
Without limitation.
Accordingly, write frequency in addition to indicate preset time in local data write number other than, can also indicate to write data
Grade, with read the setting rule of grade of data it is similar, details are not described herein.
In this step, the second client 130 can be according to the instruction of server 120, to inquire the use of local storage
Whether capacity reaches capacity threshold (such as 80%).If do not reached, next instruction is continued waiting for, if reached, can be led to
The attribute information in query metadata is crossed, to be determined for compliance with the data of primary sources condition, and can will include to meet first
The query result of the local data of class data qualification is sent to server 120.
In addition, server 120 can be according to query result and metadata, to be determined for compliance with the local of primary sources condition
The reading frequency of data writes frequency.
It should be understood that the server 120, which also itself can directly be inquired in the first client 110, meets primary sources condition
Data, the application do not limit this.
In addition, the rental period may be configured as a few minutes~dozens of minutes, can be configured according to actual needs, and the rental period
Use it is as follows:
1, file is accessed.If file does not have a rental period, a new rental period is created, and by the reading of local data in database
Frequency and write frequency clearing；
2, when reading and writing of files, in database the reading frequency of local data and write frequency field value can from increase, i.e., in real time
It updates the reading frequency of local data and writes frequency, while the local data corresponding rental period can be recalculated；
3, it when the corresponding rental period failure of local data, then by the corresponding reading frequency of local data in database and can write
FREQUENCY field is reset, and finally destroys the rental period.
Therefore, it can guarantee the reading frequency of local data in such a way that the rental period is set and to write frequency effective, avoid other
The invalid reading frequency of period writes the interference of frequency in vain, for example, can avoid the reading frequency to local data of yesterday and write
The interference of frequency.
Step 502, according to reading number and to write number, the primary sources in local data are determined.
In this step, it is default to confirm whether the reading number of local data is less than after query metadata for server 120
In the case where reading number, if being less than, determine that local data is cold data.Corresponding, which may also confirm that local data
Write number whether be less than it is default write number, if being less than, determine that local data is cold data.
It should be understood that default reading number and the default number for writing number can be identical, and it can not also be identical, the application does not limit this
It is fixed.
It should be understood that server 120 also after query metadata, can confirm whether the reading frequency of local data is in default
Reading data grade in, if it is not, determine local data be cold data.Corresponding, which may also confirm that out local
Data write whether frequency is in the preset grade for writing data, if it is not, determining that local data is cold data.
In this embodiment, cold data is quickly determined from the data of local magnanimity by metadata, and also full
The multi-zone supervision of the cold and hot data of foot.
With continued reference to Fig. 6, Fig. 6 is the flow chart of the fourth embodiment of data processing method provided by the present application.The application
Embodiment is similar to above-mentioned first embodiment, the difference is that:
In the data processing method of the embodiment of the present application, primary sources are accumulation data, and attribute information includes data
Creation time determines that the primary sources (step 301) in local data includes:
Step 601, according to attribute information, the creation time of local data is determined.
In this step, server 120 or the second client 130 can be by the data in local data and server 120
Library is matched, to determine the creation time of local data, so as to the creation time of quick obtaining local data.
Step 602, it in the case where the interval time of creation time and current time being greater than preset time period, determines local
Data are accumulation data.
In this step, server 120 can first determine the creation time of local data and the interval time of current time, with
Interval time is compared with preset time period afterwards, in the case where the interval time of current time being greater than preset time period,
Determine local data for accumulation data.
It should be understood that the preset time period can be specifically arranged according to actual needs, for example, the preset time period is three
A month, the application did not limited this.
It should be understood that the process of above-mentioned determining accumulation data can be determined parallel multiple local datas, it can also be according to secondary
The multiple local datas of ordered pair are determined one by one.
In this embodiment, the migration of the accumulation data can file the file of early stage creation, and sky is locally stored to save
Between.
With continued reference to Fig. 7, Fig. 7 is the flow chart of the 5th embodiment of data processing method provided by the present application.The application
Embodiment is similar to above-mentioned first embodiment, the difference is that:
In the data processing method of the embodiment of the present application, attribute information includes migration mark, and migration mark is for indicating this
Whether ground data migrate into cloud storage 140, data processing method further include:
Step 303, after the completion of primary sources migrate, first is set by the corresponding migration mark of primary sources
Value, the first value indicate that primary sources are had moved to cloud storage 140.
In this step, after the completion of primary sources migrate, server 120 can mark the corresponding migration of primary sources
Knowledge is updated, for example, after primary sources are moved back, the migration mark of primary sources can be marked as 1, in addition, this first
Value can be also specifically arranged according to actual needs, and the application does not limit this.
It should be understood that the renewal process of the migration mark of primary sources can be updated parallel for multiple primary sources,
Successively multiple primary sources can also be updated, the application is not construed as limiting this according to order.
In this embodiment, the data having moved in local data are recorded by migration mark, consequently facilitating to
The data of migration are managed.
With continued reference to Fig. 8, Fig. 8 is the flow chart of the sixth embodiment of data processing method provided by the present application.The application
Embodiment is similar to above-mentioned 5th embodiment, the difference is that:
In the data processing method of the embodiment of the present application, the size and data that attribute information includes data are in cloud storage 140
In routing information, data processing method further include:
Step 304, after the completion of primary sources migrate, primary sources are deleted in local storage, and by the first kind
Size and the routing information record of data are in the metadata.
In this step, after the completion of primary sources migrate, server 120 can be by the he first-class numbert in local storage
According to being truncated, which, which refers to, to delete the data in file, and the size of related data, path are believed
Breath, extended attribute etc. save.
It should be understood that the process of truncation can also can successively will for multiple primary sources are truncated parallel according to order
Multiple primary sources are truncated.
In this embodiment, the state in local data is recorded by updating migration mark, consequently facilitating to local number
According to being managed.
With continued reference to Fig. 9, Fig. 9 is the flow chart of the 7th embodiment of data processing method provided by the present application.The application
Embodiment is similar to above-mentioned first embodiment, the difference is that:
In the data processing method of the embodiment of the present application, the data processing method further include:
Step 901, the data access request of primary sources is obtained.
In this step, in the case where user's pre-read local data, server 120 can be according to the first client 110
The access of transmission directly and metadata, to judge whether the local data accessed in advance has migrated, if not migrating, directly
Local data is read, if having migrated, determines that the local data accessed in advance is primary sources.
Step 902, the routing information according to the primary sources of metadata record in cloud storage 140, by he first-class numbert
According to from the locally downloading memory of cloud storage 140.
In this step, in the case where determining local data is primary sources, server 120 can be remembered according to metadata
The store path of record, by the locally downloading memory of primary sources, to complete first in the unwitting situation of user
The downloading of class data, subsequent user can be accessed normally.
In this embodiment, data move back be for users it is transparent, only wait and having moved back when triggering is moved back
At to realize transparent access.
With continued reference to Figure 10, Figure 10 is the flow chart of the 8th embodiment of data processing method provided by the present application.This Shen
Please embodiment it is similar to above-mentioned 7th embodiment, the difference is that:
In the data processing method of the embodiment of the present application, attribute information includes moving back mark, and mark of moving back is for expression the
Whether a kind of data have moved back to local storage, the data processing method further include:
Step 903, after the completion of primary sources are moved back, second is set by the corresponding mark of moving back of primary sources
Value, second value is for indicating that primary sources have been moved back to local storage.
In this step, after the completion of primary sources are moved back, server 120 can be by the corresponding mark of moving back of primary sources
Knowledge is updated, for example, the mark of moving back of the primary sources being cleaned can be set after the primary sources moved back are cleaned
It is set to 1.In addition, the second value can be also specifically arranged according to actual needs, the application is not limited this.
It should be understood that the renewal process of the mark of moving back of primary sources can move back parallel for multiple primary sources,
Successively multiple primary sources can also be moved back, the application does not limit this according to order.
In this embodiment, the transition states of primary sources is recorded by moving back mark, consequently facilitating to moving back
Primary sources are managed.
With continued reference to Figure 11, Figure 11 is the flow chart of the 9th embodiment of data processing method provided by the present application.This Shen
Please embodiment it is similar to above-mentioned 8th embodiment, the difference is that:
In the data processing method of the embodiment of the present application, the data processing method further include:
Step 904, according to attribute information, the primary sources moved back are determined.
In this embodiment, server 120 can have been moved back by the mark of moving back of the metadata in database to determine
To the primary sources of local storage.
Step 905, the primary sources pair primary sources moved back deleted, and will be moved back in local storage
The mark of moving back answered is set as third value, and third value is for indicating that primary sources are not moved back to local storage.
It should be understood that the deletion process of the primary sources can be configured according to actual needs.For example, having read
After a kind of data, server 120 can send to the first client 110 and delete instruction, and the primary sources moved back are deleted.Again
For example, after having read primary sources, after primary sources can be stored in local storage for a period of time by server 120,
The primary sources moved back are deleted again.For another example the primary sources moved back become hot number after primary sources are moved back
According in this case, server 120 can delete the primary sources in cloud storage 140, and the application does not limit this
It is fixed.
In addition, the third value can be specifically arranged according to actual needs, for example, the primary sources moved back are cleaned
Afterwards, the mark of moving back of the primary sources being cleaned can be reset as 0, and the application does not limit this.
In this embodiment, by clearing up the data moved back, to avoid occupying excessive be locally stored.
It should be understood that above-mentioned data processing method is merely exemplary, those skilled in the art can be with according to above-mentioned method
Carry out various modifications.
2, Figure 12 shows data processing equipment provided by the embodiments of the present application referring to Figure 1, it should be appreciated that the data processing
Device is corresponding to Figure 11 embodiment of the method with above-mentioned Fig. 1, is able to carry out each step that above method embodiment is related to, the data
The specific function of processing unit may refer to it is described above, it is appropriate herein to omit detailed description to avoid repeating.At data
Managing device includes that at least one can be stored in memory in the form of software or firmware (firmware) or be solidificated at data
Manage the software function module in the operating system (operating system, OS) of device.Specifically, the data processing equipment packet
It includes: determining module 1201, for determining that the primary sources in local data, primary sources include cold data and/or accumulation
Data, accumulation data are the data that storage time is more than scheduled duration；Transferring module 1202, for by primary sources from local
Memory migration is to cloud storage 140.
In addition, determining module 1201 is also used to determine the primary sources in local data, metadata note according to metadata
Record has the attribute information of data.
In addition, primary sources are cold data, determining module 1201 is also used to determine local data according to attribute information
It reads frequency or writes frequency, reading frequency is the reading number in preset time to local data, and writing frequency is in preset time to local
Data write number；Determining module 1201 is also used to determine that local data is in the case where reading number less than default reading number
Cold data；Determining module 1201 be also used to write number be less than it is default write number in the case where, determine that local data is cold data.
In addition, primary sources are accumulation data, attribute information includes the creation time of data, and determining module 1201 is also used
According to attribute information, the creation time of local data is determined；Determining module 1201 is also used in creation time and current time
Interval time be greater than preset time period in the case where, determine local data for accumulation data.
In addition, attribute information includes migration mark, migration mark is for indicating whether local data migrates to cloud storage 140
In, setup module (not shown) is used for after the completion of primary sources migration, by the corresponding migration mark setting of primary sources
For the first value, the first value indicates that primary sources are had moved to cloud storage 140.
In addition, attribute information includes the routing information of the size and data of data in cloud storage 140, setup module is also used
In after the completion of primary sources migrate, primary sources are deleted in local storage, and by the size of primary sources and road
Diameter information records in the metadata.
In addition, obtaining the data access request that module (not shown) is used to obtain primary sources；Download module (does not show
Out) for the routing information according to the primary sources of metadata record in cloud storage 140, by primary sources from cloud storage
140 locally downloading memories.
In addition, attribute information includes mark of moving back, mark of moving back is for indicating whether primary sources have moved back to this
Ground memory, setup module are also used to after the completion of primary sources are moved back, by the corresponding mark setting of moving back of primary sources
For second value, second value is for indicating that primary sources have been moved back to local storage.
In addition, determining module 1201 is also used to determine the primary sources moved back according to attribute information；Setup module is also
For the primary sources moved back to be deleted in local storage, and by the corresponding mark of moving back of the primary sources moved back
It is set as third value, third value is for indicating that primary sources are not moved back to local storage.
In addition, metadata includes basic metadata and extended metadata, basic metadata is the member of storage in the database
Data, extended metadata are the metadata being stored in the extended attribute of file.
The application also provides a kind of device, and Figure 13 is the structural block diagram of the device 1300 in the embodiment of the present application, such as Figure 13
It is shown.Device 1300 may include processor 1310, communication interface 1320, memory 1330 and at least one communication bus
1340.Wherein, communication bus 1340 is for realizing the direct connection communication of these components.Wherein, equipment in the embodiment of the present application
Communication interface 1320 be used to carry out the communication of signaling or data with other node devices.Processor 1310 can be a kind of integrated
Circuit chip, the processing capacity with signal.Above-mentioned processor 1310 can be general processor, including central processing unit
(Central Processing Unit, abbreviation CPU), network processing unit (Network Processor, abbreviation NP) etc.；May be used also
Be digital signal processor (DSP), specific integrated circuit (ASIC), ready-made programmable gate array (FPGA) or other can compile
Journey logical device, discrete gate or transistor logic, discrete hardware components.It may be implemented or execute the embodiment of the present application
In disclosed each method, step and logic diagram.General processor can be microprocessor or the processor 1310 can also
To be any conventional processor etc..
Memory 1330 may be, but not limited to, random access memory (Random Access Memory, RAM), only
It reads memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only
Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM),
Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc..
Computer-readable instruction fetch is stored in memory 1330, when the computer-readable instruction fetch is executed by the processor 1310
When, device 1300 can execute each step that above-mentioned Fig. 1 is related to Figure 11 embodiment of the method.
Device 1300 can also include storage control, input-output unit, audio unit, display unit.
The memory 1330, storage control, processor 1310, Peripheral Interface, input-output unit, audio unit,
Each element of display unit is directly or indirectly electrically connected between each other, to realize the transmission or interaction of data.For example, these yuan
Part can be realized by one or more communication bus 1340 be electrically connected between each other.The processor 1310 is for executing storage
The executable module stored in device 1330, such as software function module or computer program that data processing equipment includes.Also,
Data processing equipment is for executing following methods: determining the primary sources in local data；Primary sources are deposited from local
Reservoir is migrated to cloud storage.
Input-output unit is used to be supplied to user input data and realizes user and the server (or local terminal)
Interaction.The input-output unit may be, but not limited to, mouse and keyboard etc..
Audio unit provides a user audio interface, may include one or more microphones, one or more loudspeaking
Device and voicefrequency circuit.
Display unit provided between the electronic equipment and user an interactive interface (such as user interface) or
It is referred to for display image data to user.In the present embodiment, the display unit can be liquid crystal display or touch-control is aobvious
Show device.It can be the capacitance type touch control screen or resistance type touch control screen of support single-point and multi-point touch operation if touch control display
Deng.Single-point and multi-point touch operation is supported to refer to that touch control display can sense one or more positions on the touch control display
The touch control operation setting place while generating, and the touch control operation that this is sensed transfers to processor to be calculated and handled.Display is single
Member can execute the composograph that the step of Fig. 1 to Figure 11 is shown obtains with video-stream processor 1310, can also show region to be checked
In route whether there is hidden danger judging result.
Input-output unit is used to be supplied to the interaction that user input data realizes user and processing terminal.The input is defeated
Unit may be, but not limited to, out, mouse and keyboard etc..
It is appreciated that structure shown in Figure 13 is only to illustrate, described device 1300 may also include more than shown in Figure 13
Perhaps less component or with the configuration different from shown in Figure 13.Each component shown in Figure 13 can be using hardware, soft
Part or combinations thereof is realized.
The application also provides a kind of computer readable storage medium, is stored with data processing on computer readable storage medium
Program executes method described in embodiment of the method when data processor is run by processor.
The application also provides a kind of computer program product to be made when the computer program product is run on computers
It obtains computer and executes method described in embodiment of the method.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description
Specific work process, no longer can excessively be repeated herein with reference to the corresponding process in preceding method.
It should be noted that all the embodiments in this specification are described in a progressive manner, each embodiment weight
Point explanation is the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other.
For device class embodiment, since it is basically similar to the method embodiment, so being described relatively simple, related place ginseng
See the part explanation of embodiment of the method.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through it
Its mode is realized.The apparatus embodiments described above are merely exemplary, for example, the flow chart and block diagram in attached drawing are aobvious
The device of multiple embodiments according to the application, architectural framework in the cards, the function of method and computer program product are shown
It can and operate.In this regard, each box in flowchart or block diagram can represent one of a module, section or code
Point, a part of the module, section or code includes one or more for implementing the specified logical function executable
Instruction.It should also be noted that function marked in the box can also be attached to be different from some implementations as replacement
The sequence marked in figure occurs.For example, two continuous boxes can actually be basically executed in parallel, they sometimes may be used
To execute in the opposite order, this depends on the function involved.It is also noted that each of block diagram and or flow chart
The combination of box in box and block diagram and or flow chart can be based on the defined function of execution or the dedicated of movement
The system of hardware is realized, or can be realized using a combination of dedicated hardware and computer instructions.
In addition, each functional module in each embodiment of the application can integrate one independent portion of formation together
Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module
It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps.
And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
The foregoing is merely preferred embodiment of the present application, are not intended to limit this application, for the skill of this field
For art personnel, various changes and changes are possible in this application.Within the spirit and principles of this application, made any to repair
Change, equivalent replacement, improvement etc., should be included within the scope of protection of this application.It should also be noted that similar label and letter exist
Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing
It is further defined and explained.
The above, the only specific embodiment of the application, but the protection scope of the application is not limited thereto, it is any
Those familiar with the art within the technical scope of the present application, can easily think of the change or the replacement, and should all contain
Lid is within the scope of protection of this application.Therefore, the protection scope of the application shall be subject to the protection scope of the claim.
Claims (10)
1. a kind of data processing method characterized by comprising
Determine that the primary sources in local data, the primary sources include cold data and/or accumulation data, the accumulation
Data are the data that storage time is more than scheduled duration；
The primary sources are migrated from local storage to cloud storage.
2. data processing method according to claim 1, which is characterized in that the he first-class numbert in the determining local data
According to, comprising:
According to metadata, determine that the primary sources in local data, the metadata record have the attribute information of data.
3. data processing method according to claim 2, which is characterized in that the primary sources are the cold data,
The attribute information includes reading frequency or writing frequency, described according to metadata, determines the primary sources in local data,
Include:
It according to the attribute information, determines the reading frequency of the local data or writes frequency, the reading frequency is in preset time
To the reading number of the local data, the frequency of writing is to write number to the local data in the preset time；
In the case where the reading number is less than default reading number, determine that the local data is the cold data；Or,
It is described write number be less than it is default write number in the case where, determine that the local data is the cold data.
4. data processing method according to claim 2, which is characterized in that the primary sources are the cumulative number
According to the attribute information includes the creation time of data, the primary sources in the determining local data, comprising:
According to the attribute information, the creation time of the local data is determined；
In the case where the interval time of the creation time and current time being greater than preset time period, the local data is determined
For the accumulation data.
5. data processing method according to claim 2, which is characterized in that the attribute information includes migration mark, institute
It states migration to identify for indicating whether the local data migrates into the cloud storage, the data processing method further include:
After the completion of primary sources migration, the first value, institute are set by the corresponding migration mark of the primary sources
Stating the first value indicates that the primary sources are had moved to the cloud storage.
6. data processing method according to claim 2, which is characterized in that the attribute information include data size and
Routing information of the data in the cloud storage, the data processing method further include:
After the completion of primary sources migration, the primary sources are deleted in the local storage, and by described the
The size of a kind of data and the routing information are recorded in the metadata.
7. data processing method according to claim 6, which is characterized in that the data processing method further include:
Obtain the data access request of the primary sources；
According to routing information of the primary sources of the metadata record in cloud storage, by the primary sources from
The cloud storage downloads to the local storage.
8. data processing method according to claim 7, which is characterized in that the attribute information includes mark of moving back, institute
Mark of moving back is stated for indicating whether the primary sources have moved back to the local storage, the data processing method
Further include:
After the completion of the primary sources are moved back, second value is set by the corresponding mark of moving back of the primary sources, institute
Second value is stated for indicating that the primary sources have been moved back to the local storage.
9. data processing method according to claim 8, which is characterized in that the data processing method further include:
According to the attribute information, the primary sources moved back are determined；
The primary sources moved back are deleted in the local storage, and the primary sources moved back are corresponding
Mark of moving back is set as third value, and the third value is for indicating that the primary sources are not moved back to the local storage.
10. a kind of data processing equipment characterized by comprising
Determining module, for determining that the primary sources in local data, the primary sources include cold data and/or accumulation
Data, the accumulation data are the data that storage time is more than scheduled duration；
Transferring module, for migrating the primary sources from local storage to cloud storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910246043.0A CN109947373B (en) | 2019-03-28 | 2019-03-28 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910246043.0A CN109947373B (en) | 2019-03-28 | 2019-03-28 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109947373A true CN109947373A (en) | 2019-06-28 |
| CN109947373B CN109947373B (en) | 2022-05-13 |
Family
ID=67012850
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910246043.0A Active CN109947373B (en) | 2019-03-28 | 2019-03-28 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109947373B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111125062A (en) * | 2019-12-20 | 2020-05-08 | 中国银行股份有限公司 | Historical data migration method and device and historical data query method and device |
| CN112540733A (en) * | 2020-12-23 | 2021-03-23 | 华录光存储研究院（大连）有限公司 | Data management method and device, electronic equipment and storage medium |
| CN112650453A (en) * | 2020-12-31 | 2021-04-13 | 北京千方科技股份有限公司 | Method and system for storing and inquiring traffic data |
| CN112835967A (en) * | 2019-11-25 | 2021-05-25 | 浙江宇视科技有限公司 | Data processing method, device, equipment and medium based on distributed storage system |
| CN112883026A (en) * | 2021-01-28 | 2021-06-01 | 青岛海尔科技有限公司 | Data processing method and device |
| CN113407118A (en) * | 2021-06-24 | 2021-09-17 | 九江职业技术学院 | Data storage device |
| WO2024187922A1 (en) * | 2023-03-16 | 2024-09-19 | 华为云计算技术有限公司 | Data storage method, apparatus and computing device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078906A (en) * | 2012-12-26 | 2013-05-01 | 爱迪科特(北京)科技有限公司 | Document transparent moving method |
| US20150095671A1 (en) * | 2013-09-27 | 2015-04-02 | International Business Machines Corporation | Method and apparatus for managing power of a storage system |
| CN104731794A (en) * | 2013-12-19 | 2015-06-24 | 北京华易互动科技有限公司 | Cold-hot data fragmenting, mining and storing method |
| CN106202070A (en) * | 2015-04-29 | 2016-12-07 | 中国电信股份有限公司 | File storage processing method and system |
| US20170352038A1 (en) * | 2016-06-02 | 2017-12-07 | Facebook, Inc. | Cold storage for legal hold data |
| CN107728938A (en) * | 2017-09-18 | 2018-02-23 | 暨南大学 | A kind of cold data Placement Strategy based on frequency association under low energy consumption cluster environment |
| CN107784108A (en) * | 2017-10-31 | 2018-03-09 | 郑州云海信息技术有限公司 | A kind of data storage and management method, device and equipment |
| CN107809535A (en) * | 2017-10-30 | 2018-03-16 | 努比亚技术有限公司 | A kind of information processing method, mobile terminal and computer-readable storage medium |
| CN108268211A (en) * | 2017-01-03 | 2018-07-10 | 中国移动通信有限公司研究院 | A kind of data processing method and device |
| CN111095188A (en) * | 2017-09-14 | 2020-05-01 | 国际商业机器公司 | Dynamic data relocation using cloud-based modules |
-
2019
- 2019-03-28 CN CN201910246043.0A patent/CN109947373B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078906A (en) * | 2012-12-26 | 2013-05-01 | 爱迪科特(北京)科技有限公司 | Document transparent moving method |
| US20150095671A1 (en) * | 2013-09-27 | 2015-04-02 | International Business Machines Corporation | Method and apparatus for managing power of a storage system |
| CN104731794A (en) * | 2013-12-19 | 2015-06-24 | 北京华易互动科技有限公司 | Cold-hot data fragmenting, mining and storing method |
| CN106202070A (en) * | 2015-04-29 | 2016-12-07 | 中国电信股份有限公司 | File storage processing method and system |
| US20170352038A1 (en) * | 2016-06-02 | 2017-12-07 | Facebook, Inc. | Cold storage for legal hold data |
| CN108268211A (en) * | 2017-01-03 | 2018-07-10 | 中国移动通信有限公司研究院 | A kind of data processing method and device |
| CN111095188A (en) * | 2017-09-14 | 2020-05-01 | 国际商业机器公司 | Dynamic data relocation using cloud-based modules |
| CN107728938A (en) * | 2017-09-18 | 2018-02-23 | 暨南大学 | A kind of cold data Placement Strategy based on frequency association under low energy consumption cluster environment |
| CN107809535A (en) * | 2017-10-30 | 2018-03-16 | 努比亚技术有限公司 | A kind of information processing method, mobile terminal and computer-readable storage medium |
| CN107784108A (en) * | 2017-10-31 | 2018-03-09 | 郑州云海信息技术有限公司 | A kind of data storage and management method, device and equipment |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112835967A (en) * | 2019-11-25 | 2021-05-25 | 浙江宇视科技有限公司 | Data processing method, device, equipment and medium based on distributed storage system |
| CN112835967B (en) * | 2019-11-25 | 2023-07-21 | 浙江宇视科技有限公司 | Data processing method, device, equipment and medium based on distributed storage system |
| CN111125062A (en) * | 2019-12-20 | 2020-05-08 | 中国银行股份有限公司 | Historical data migration method and device and historical data query method and device |
| CN111125062B (en) * | 2019-12-20 | 2023-10-20 | 中国银行股份有限公司 | Historical data migration method and device, and historical data query method and device |
| CN112540733A (en) * | 2020-12-23 | 2021-03-23 | 华录光存储研究院（大连）有限公司 | Data management method and device, electronic equipment and storage medium |
| CN112650453A (en) * | 2020-12-31 | 2021-04-13 | 北京千方科技股份有限公司 | Method and system for storing and inquiring traffic data |
| CN112650453B (en) * | 2020-12-31 | 2024-05-14 | 北京千方科技股份有限公司 | Method and system for storing and inquiring traffic data |
| CN112883026A (en) * | 2021-01-28 | 2021-06-01 | 青岛海尔科技有限公司 | Data processing method and device |
| CN113407118A (en) * | 2021-06-24 | 2021-09-17 | 九江职业技术学院 | Data storage device |
| WO2024187922A1 (en) * | 2023-03-16 | 2024-09-19 | 华为云计算技术有限公司 | Data storage method, apparatus and computing device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109947373B (en) | 2022-05-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109947373A (en) | Data processing method and device | |
| US11734125B2 (en) | Tiered cloud storage for different availability and performance requirements | |
| US20220283992A1 (en) | Prioritizing content item synchronization based on sharing | |
| JP5514903B2 (en) | File level hierarchical storage management system, method, and apparatus | |
| US8495331B2 (en) | Storage apparatus and storage management method for storing entries in management tables | |
| US10484456B2 (en) | Sharing a content item | |
| US9703500B2 (en) | Reducing power consumption by migration of data within a tiered storage system | |
| US20230229637A1 (en) | Intelligent file system with transparent storage tiering | |
| CN109947668B (en) | Method and device for storing data | |
| Lai et al. | Towards a framework for large-scale multimedia data storage and processing on Hadoop platform | |
| KR101373461B1 (en) | Terminal and method for using cloud sevices | |
| CN103597440A (en) | Method for creating clone file, and file system adopting the same | |
| AU2014287633B2 (en) | Virtual database rewind | |
| CN105981033B (en) | Placement Strategy is distributed into set of segments | |
| CN109804359A (en) | For the system and method by write back data to storage equipment | |
| US20150046394A1 (en) | Storage system, storage control device, and storage medium storing control program | |
| CN109684270A (en) | Database filing method, apparatus, system, equipment and readable storage medium storing program for executing | |
| WO2023010948A1 (en) | Cloud desktop data migration method, service node, management node, server, electronic device, and computer-readable storage medium | |
| US9063909B2 (en) | Isolating data storage mirroring operations | |
| JP7431490B2 (en) | Data migration in hierarchical storage management systems | |
| CN103152377B (en) | A kind of data access method towards ftp service | |
| Alatorre et al. | Intelligent information lifecycle management in virtualized storage environments | |
| US10203874B1 (en) | Managing time scheduled data placement in data storage systems | |
| US11693580B2 (en) | Method to provide recommendations for cloud storage providers and storage classes based on backup server's usage patterns for lowering overall cloud costs | |
| US11954076B2 (en) | Hierarchical storage management system, hierarchical storage control apparatus, hierarchical storage management method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |