CN102591864B - Data updating method and device in comparison system - Google Patents
Data updating method and device in comparison system Download PDFInfo
- Publication number
- CN102591864B CN102591864B CN201110001856.7A CN201110001856A CN102591864B CN 102591864 B CN102591864 B CN 102591864B CN 201110001856 A CN201110001856 A CN 201110001856A CN 102591864 B CN102591864 B CN 102591864B
- Authority
- CN
- China
- Prior art keywords
- data
- information
- item
- characteristic
- renewal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data updating method in a comparison system, which comprises the steps of: creating an internal memory cache region in a physical internal memory, and loading updated data and information items thereof in the internal memory cache region; and looking up a corresponding current index in a local disk according to the information items, and performing an updating operation. In order to realize the data updating method in comparison system, the invention also provides a data updating device in comparison system, which comprises a creating unit used for creating the internal memory cache region in the physical internal memory; a loading unit used for loading the updated data and the information items thereof in the internal memory cache region; a searching unit used for looking up the corresponding current index in the local disk according to the information items; and an updating unit used for performing the updating operation. The data updating method in comparison system and the data updating device in comparison system have the advantages of avoiding large scale data updating delay, and comparing the updated data in real time so as to obtain a more accurate comparison result.
Description
Technical field
The present invention relates to Compare System, particularly relate to the data-updating method in Compare System and device.
Background technology
Along with the progress of technology, the needs of society, Compare System is applied widely gradually in every profession and trade field.Because Compare System is mainly based on the support of data, therefore current Compare System mostly is extensive Compare System or even ultra-large Compare System, as the face characteristic Compare System in face recognition system, the fingerprint characteristic Compare System in system of fingerprints.The data of described Compare System store in a database usually, and memory space generally can reach 1,000,000 even tens million of, more than one hundred million, and the size of every bar data is generally between several KB to tens of KB, and the data total amount therefore in Compare System generally can reach several GB to hundreds of GB.
For improving the precision of comparison result, in described database, constantly can add new data, and also likely data with existing is modified, the renewal rewards theory such as deletion.If the data of magnanimity like this carry out renewal rewards theory simultaneously, not only can impact comparison operation, lower the precision of comparison result, but also the time of renewal can be extended, cause and upgrade delay.
Application number is the application for a patent for invention of 200710096870.3, discloses a kind of method of Data Update, is applied to the synchronized update that client and server store data.But the delay how avoiding large-scale data to upgrade, enables the data after renewal participate in comparison in time, obtaining comparison result more accurately becomes one of those skilled in the art's problem demanding prompt solution.
Summary of the invention
The problem that the present invention solves is to provide data-updating method in a kind of Compare System and device, and the delay upgraded to avoid large-scale data, enables the data after renewal participate in comparison in time, acquisition comparison result more accurately.
The invention provides the data-updating method in a kind of Compare System for solving the problem, comprising:
In physical memory, create internal memory cache region, the data of renewal and item of information thereof are loaded in described internal memory cache region;
In local disk, search corresponding current index according to described item of information, carry out renewal rewards theory.
Optionally, the data of described renewal are characteristic newly-increased in database, then described renewal rewards theory is the data in described internal memory cache region and item of information thereof are loaded in described local disk to become characteristic, and re-creates current index.
Optionally, the data of described renewal are amended characteristic in described local disk, then described renewal rewards theory is the former characteristic data in described internal memory cache region substituted in described local disk.
Optionally, the data of described renewal are characteristic to be deleted in described local disk, then described renewal rewards theory is delete characteristic to be deleted and item of information thereof in described local disk, and re-creates current index.
Optionally, described current index creates according to following step:
The item of information of data is converted to numeric type information data;
According to described numeric type information data, described data are sorted;
The concordance list creating the data after corresponding sequence is current index.
Optionally, re-create current index described in comprise:
The item of information of described newly-increased characteristic is converted to numeric type information data;
Described numeric type information data is inserted in current index.
Optionally, re-create current index described in comprise:
The item of information of described characteristic to be deleted is converted to numeric type information data;
In described current index, search key assignments corresponding to described numeric type information data, and delete described key assignments corresponding in current index.
Optionally, described renewal rewards theory timing is carried out once.
Optionally, the quantity of described more new data reaches predetermined value, carries out once described renewal rewards theory.
Optionally, described data-updating method is also included in described local disk and creates disk buffering district, and the data of renewal and item of information thereof are loaded in described disk buffering district, the data in described disk buffering district are identical with the data in described internal memory cache region.
Optionally, described local disk is the hard disk of comparison server, and described physical memory is the internal memory of described comparison server.
Optionally, described data are face characteristic or fingerprint characteristic data, and the item of information of described data comprises sex, age and region.
For solving the problem, present invention also offers the data update apparatus in a kind of Compare System, comprising:
Creating unit, in order to create internal memory cache region in physical memory;
Loading unit, in order to be loaded in described internal memory cache region by the data of renewal and item of information thereof;
Search unit, in order to search corresponding current index in local disk according to described item of information;
Updating block, in order to carry out renewal rewards theory.
Optionally, the data of described renewal are characteristic newly-increased in database, then the data in described internal memory cache region and item of information thereof are loaded in described local disk by described updating block becomes characteristic.
Optionally, the data of described renewal are amended characteristic in described local disk, then the data in described internal memory cache region are substituted the former characteristic in described local disk by described updating block.
Optionally, the data of described renewal are characteristic to be deleted in described local disk, then described updating block deletes characteristic to be deleted in described local disk and item of information thereof.
Optionally, described data update apparatus also comprises:
Converting unit, in order to be converted to numeric type information data by the item of information of data;
Sequencing unit, in order to sort to described data according to described numeric type information data;
Operating unit is current index in order to create the concordance list of the data after corresponding sequence.
Optionally, the data of described renewal are characteristic newly-increased in database, then:
Described converting unit, also in order to the item of information of described newly-increased characteristic is converted to numeric type information data;
Described operating unit, also in order to described numeric type information data to be inserted in current index.
Optionally, the data of described renewal are characteristic to be deleted in described local disk, then:
Described converting unit, also in order to the item of information of described characteristic to be deleted is converted to numeric type information data;
Described operating unit, also in order to search key assignments corresponding to described numeric type information data in described current index, and deletes described key assignments corresponding in current index.
Optionally, described data update apparatus also comprises control unit, carries out once described renewal rewards theory in order to control the timing of described updating block.
Optionally, described data update apparatus also comprises control unit, in order to when the quantity of described more new data reaches predetermined value, controls described updating block and carries out once described renewal rewards theory.
Optionally, described data update apparatus is also included in described local disk and creates disk buffering district, the data of renewal and item of information thereof are loaded in described disk buffering district by described loading unit, and the data in described disk buffering district are identical with the data in described internal memory cache region.
Optionally, described local disk is the hard disk of comparison server, and described physical memory is the internal memory of described comparison server.
Optionally, described data are face characteristic or fingerprint characteristic data, and the item of information of described data comprises sex, age and region.
Compared with prior art, the present invention has the following advantages:
In physical memory, create internal memory cache region, the data of renewal and item of information thereof are loaded in described internal memory cache region, this can accelerate the speed reading described data, shortens comparison time.In local disk, search corresponding current index according to described item of information, carry out renewal rewards theory, this not only can conservation and renewal data not be destroyed, and facilitates the renewal of data.
To dissimilar more new data, take different renewal rewards theory: newly-increased data, take plug-type renewal rewards theory; Amended data, take the renewal rewards theory of substituted; Data to be deleted, take the renewal rewards theory of erasure.So not only can complete renewal rewards theory rapidly, and the integrality of former data can not be destroyed.
Create the method for described current index generally: described item of information is converted to numeric type information data; According to described numeric type information data, described data are sorted; The concordance list creating the data after corresponding sequence is current index.Short according to the time that the current index of said method foundation not only creates, and sequence is shown in described current cable ejectment, easy-to-look-up data.
In order to shorten the time of renewal rewards theory and improve the speed of more new data, for different more new datas, the mode re-creating current index is slightly different.Newly-increased data take following mode: the item of information of described data is converted to numeric type information data, described numeric type information data are inserted in former current index.This mode only needs reconstruction part current cable to draw can create new current index, saves the time.Data acquisition to be deleted is with the following methods: the item of information of described data is converted to numeric type information data; In described former current index, search key assignments corresponding to described numeric type information data, and delete described key assignments corresponding in former current index.This mode is also that locally revising current index forms new current index, saves time, reduces the wasting of resources.
Described renewal rewards theory timing is carried out once, or the quantity of described more new data reaches a certain predetermined value, carries out once.This not only can prevent data from blocking, and avoids real-time update data influence comparison result, and improves the utilization rate in physical memory space, prevent data redundancy.
For protected data safety, create disk buffering district in described local disk, the data of renewal and item of information thereof are loaded in described disk buffering district, the data in described disk buffering district are identical with the data in described internal memory cache region.Which ensure that the backup of more new data, prevent loss of data, cause the consequence being difficult to recover.
Described local disk is the hard disk of comparison server, and described physical memory is the internal memory of described comparison server.This can facilitate Compare System to control, and data storing is in contrast server hard disc, and Compare System can direct management data, does not need to carry out data conversion.Described physical memory is the internal memory of described comparison server, and Compare System directly reads the data in internal memory, shortens comparison time, raises the efficiency.
Described Compare System is generally portrait Compare System or fingerprint comparison system, and therefore described characteristic is face characteristic or fingerprint characteristic data, and the item of information of described characteristic comprises sex, age and region.
Present invention also offers the data update apparatus in a kind of Compare System, achieve the data-updating method in above-mentioned Compare System.By described data update apparatus, avoid the delay that large-scale data upgrades, enable the data after renewal participate in comparison in time, obtain comparison result more accurately.
Accompanying drawing explanation
Fig. 1 is the flow chart of a kind of embodiment of data-updating method provided by the invention;
Fig. 2 is the flow chart of a kind of embodiment setting up index in data-updating method provided by the invention;
Fig. 3 is the structural representation of a kind of embodiment of data update apparatus provided by the invention.
Detailed description of the invention
The invention provides the data-updating method in a kind of Compare System and device thereof, reach the delay avoiding large-scale data to upgrade, enable the data after renewal participate in comparison in time, obtain comparison result more accurately.
For enabling above-mentioned purpose of the present invention, feature and advantage more become apparent, and are described in detail the specific embodiment of the present invention below in conjunction with accompanying drawing.
Set forth detail in the following description so that fully understand the present invention.But the present invention can be different from alternate manner described here to implement with multiple, those skilled in the art can when without prejudice to doing similar popularization when intension of the present invention.Therefore the present invention is not by the restriction of following public detailed description of the invention.
Because Compare System needs the support based on mass data, just can better complete comparison task, reach higher comparison result.Therefore current Compare System mostly is extensive Compare System or even ultra-large Compare System.The memory data output of described Compare System generally can reach 1,000,000 even tens million of, more than one hundred million, and the size of every bar data is generally between several KB to tens of KB, and the data total amount therefore in Compare System generally can reach several GB to hundreds of GB.
In order to improve the precision of comparison result, in Compare System, the renewal frequency of data is very fast, if the data of renewal can not be participated in comparison in time, easily occurs the situation that comparison result is inaccurate.The invention provides the data-updating method in a kind of Compare System in view of the foregoing, Fig. 1 is the flow chart of a kind of embodiment of data-updating method provided by the invention, below in conjunction with such as Fig. 1 detailed description.
Step S101, creates internal memory cache region in physical memory, the data of renewal and item of information thereof is loaded in described internal memory cache region.
Step S102, searches corresponding current index according to described item of information, carries out renewal rewards theory in local disk.
Because Compare System is mostly arranged on the equipment such as mainframe computer or data processor, obtain data by hardware such as central processing units, complete comparison request.Therefore this sentences the face recognition system be arranged on computer is example, illustrates the method for Data Update in the present embodiment, but is not limited to the description of following citing content, can do adaptability revision.
Compare System is generally arranged on a certain outside master server, and such as performance is preferably on mainframe computer.Described master server is connected with one or more comparison server again, realizes parallel work-flow and completes comparison request.Comparison server is mostly computer from the above, and described local disk refers generally to the hard disk of comparison server, and described physical memory is generally the internal memory of described comparison server.
Because in Compare System, data volume is huge, real-time update data can clash with comparison request, are easy to like this cause harmful effect to comparison result.If the interior unification of section sometime that operates in of Data Update is carried out, then easily cause and upgrade delay, that is, first more new data is compared again, and these needs, through after a while, just can be reflected in comparison result.In step S101, the data of renewal are put into buffer area and then improves above-mentioned situation.
Buffer area is the buffering area of exchanges data, when a certain hardware of computer will read data, first can search the data of needs from buffer area, if have found, directly perform, the words that can not find then are looked for from internal memory, if can not find in internal memory, enter in hard disk or other storage mediums and find.That is, by the data storing of renewal in buffer area, computer first can read the more new data of buffer area, to read in internal memory other data again, so not only comparison time can not be incured loss through delay, and the data upgraded also can participate in comparison process timely, can not cause comparison error.It can thus be appreciated that, data in buffer area are read at first, in step S101, in internal memory, create data and item of information thereof that buffer area deposits renewal, significantly can improve the reading speed of data, shorten comparison time, improve comparison efficiency, and due to upgrade data can participate in comparison in time, can not comparison result be affected, improve the precision of comparison result on the contrary.
For ensureing the information security of the mass data in Compare System, prevent Missing data, described data are generally stored in external data base, and the data occurred in following content for convenience of description unless otherwise indicated, are characteristic.For improving the utilization rate of data, reduce data redundancy, the data generally stored in database are characteristic.For face characteristic Compare System, described characteristic generally refers to face characteristic data, the shape of the face such as such as shape of face, ocular form, lip.Described characteristic can also comprise other obvious distinguishing characteristics, such as, whether have the information such as position of mole, mole.
Described characteristic stores in a database, and storage of usually classifying, that is, is summarized as a class by the described characteristic with same characteristics, and using the item of information of above-mentioned same characteristics as described characteristic, jointly stored in database.In general, described item of information is the field name in database, and can be sex, age, region etc., described region be often referred to the regional information such as birthplace, residence.Compare System generally all has corresponding comparison condition, and described comparison condition is arranged with described item of information is mostly corresponding, and that is, described comparison condition is substantially identical with described item of information, and comparison condition described herein is sex, age, region etc.
Different Compare Systems, described characteristic, described item of information, described comparison condition are generally not quite similar, and for fingerprint comparison system, described characteristic is fingerprint characteristic data, such as Finger print.Because fingerprint comparison system and face characteristic Compare System are all with artificial object of reference, so the described item of information in fingerprint comparison system, described comparison condition can be the information such as sex, age, region.Only illustrate, for different Compare Systems, the function with reference to Compare System determines above-mentioned characteristic, item of information and comparison condition herein.
Characteristic in described database is loaded in local disk usually.Such one side ensures that described database and described local disk can backup each other data, prevent loss of data, if described database or described local disk break down, cause shortage of data, can mutually make up; On the other hand, the safety of protected data, prevents described characteristic to be tampered.
When described local disk loads described characteristic, usually can load the item of information of described characteristic in the lump, and index storage can be created according to described item of information.Described characteristic is loaded together with described item of information, prevents shortage of data on the one hand, conveniently make index on the other hand.Described characteristic and described item of information, according to certain organizational form, be generally man-to-man mapping relations, be combined into one or more file, be loaded in described local disk.According to combine as upper type have as described in the file of item of information, form current index according to the content of described item of information.
The data upgraded in step S101 and item of information thereof are loaded in described internal memory cache region, in step s 102, search corresponding current index, carry out renewal rewards theory by described item of information in local disk.From the above, the current index of answering in local disk sets up according to the item of information of data, therefore by the item of information of data in described internal memory cache region, not only can find corresponding described current index easily, save time, improve speed, be convenient to the operation of Data Update, and item of information is symmetrical, reduce the situation of searching error in data, reduce the occurrence probability of error.
Described renewal rewards theory is generally divided into increase new data, Update Table, deletes data three kinds, according to the type of more new data, carries out different operations.
If the data of described renewal are characteristic newly-increased in database, then described renewal rewards theory is the data in described internal memory cache region and item of information thereof are loaded in described local disk to become characteristic, and re-creates current index.
If the data of described renewal are amended characteristic in described local disk, then described renewal rewards theory is the former characteristic data in described internal memory cache region substituted in described local disk.
If the data of described renewal are characteristic to be deleted in described local disk, then described renewal rewards theory is delete characteristic to be deleted and item of information thereof in described local disk, and re-creates current index.
Above-mentioned renewal rewards theory all carries out in comparison server, that is carries out in local disk.In comparing process, sometimes data are carried out to the amendment of three kinds of forms as above, tamper described characteristic, can impact follow-up comparison, therefore in described database, initial data needs to file, and described characteristic is loaded in described local disk, if distort, with the initial data comparison in described database, the correctness of data can be ensured.
Because data are changed, therefore index also can do accommodation, and Fig. 2 is the flow chart of a kind of embodiment setting up index in data-updating method provided by the invention, describes detailed process in detail below in conjunction with Fig. 2.
Step S1, is converted to numeric type information data by the item of information of data;
Step S2, sorts to described data according to described numeric type information data;
Step S3, the concordance list creating the data after corresponding sequence is current index.
As everyone knows, the data speed of computer reading numerical values type is the fastest, when therefore creating current index according to the item of information of described data, described item of information is converted to numeric type information data.In addition, the data sorting of numeric type is the simplest, therefore sorts to characteristic according to described numeric type information data, creates the concordance list of the characteristic after corresponding sequence, can the speed of raising Data import by a relatively large margin.Described numeric type is generally integer, unsigned int or enumeration type, and numeric type is preferred version, also can be the data of computer-readable other types.
The visioning procedure of above-mentioned concordance list is applicable to most index creation, and that is, the index creation mode shown in Fig. 2 is not only applicable to upgrade in data procedures, also for other data load process, is a kind of use index creation mode comparatively widely.Because the item of information of more new data is little on the impact of concordance list, therefore in order to increase work efficiency, shorten the time creating index, can also can take different establishment modes according to different update modes.
If the data of described renewal are characteristic newly-increased in database, then the item of information of described data is converted to numeric type information data; Described numeric type information data is inserted in former current index.Generally, newly-increased characteristic has corresponding index information in described local disk, therefore finds corresponding information data, after the item of information of newly-increased characteristic is changed data type, insert former current index and just can form new index, and can not impact other data.
If the data of described renewal are characteristic to be deleted in described local disk, then the item of information of described data is converted to numeric type information data; In described former current index, search key assignments corresponding to described numeric type information data, and delete described key assignments corresponding in former current index.Owing to deleting the characteristic in described local disk, its item of information can be deleted in the lump, other data are not affected, in described former current index, therefore searches the information that the item of information of this characteristic is corresponding, and delete described information creating index corresponding in former current index.
If the data of described renewal are amended characteristic in described local disk, owing to being only make an amendment the characteristic in described local disk, do not affect its item of information, so generally the change of index can not be affected.If the characteristic revised in described local disk relates to the amendment of its item of information, new index can be created according to the flow process shown in Fig. 2, also can create according to the mode of newly-increased characteristic establishment index, can also be created by the mode of deleting.The mode of above-mentioned establishment index, can carry out adaptability revision as required, be not limited to foregoing description content in actual design.
Comparison server can be started shooting running under normal circumstances for a long time, and therefore the situation of power down or fault likely can occur.If there is above-mentioned situation; data in internal memory often can be lost; for preventing loss of data; also in described local disk, create disk buffering district; the data of renewal and item of information thereof are loaded in described disk buffering district, the data in described disk buffering district are identical with the data in described internal memory cache region.Even if comparison server power failure like this or break down, can also ensure there is Backup Data in hard disk, guarantee data security.
Because large-scale Data Update can bring time delay, therefore described renewal rewards theory timing is carried out once, or the quantity of described more new data reaches predetermined value, carries out once described renewal rewards theory.General 24 hours of update time, described predetermined range is generally 10,000 to 100,000.Above-mentioned update time and predetermined value can be changed as required, do not limit by foregoing.
For realizing the data-updating method in described Compare System, present invention also offers the data update apparatus in a kind of Compare System.Fig. 3 is the structural representation of a kind of embodiment of data update apparatus provided by the invention, comprising:
Creating unit A1, in order to create internal memory cache region in physical memory;
Loading unit A2, in order to be loaded in described internal memory cache region by the data of renewal and item of information thereof;
Search unit A3, in order to search corresponding current index in local disk according to described item of information;
Updating block A4, in order to carry out renewal rewards theory.
Described updating block A4 timing, or the quantity of described more new data reaches predetermined value, carries out once described renewal rewards theory.Described predetermined range is generally at 1 ten thousand to ten ten thousand, and described update cycle and described predetermined value can be set in advance in described updating block A4, also can manually arrange at any time as required, not by the restriction of foregoing.
Wherein creating unit A1, loading unit A2, search unit A3, updating block A4 connects successively.Because the function and efficacy of often kind of Compare System is not quite similar, therefore the above-mentioned treating apparatus enumerated is a kind of embodiment, can do adaptability revision, such as, increase timing unit according to different Compare Systems, signal processing unit, and the quantity of device is also unrestricted.
Data import is mainly entered described local disk by loading unit A2, and therefore loading unit A2 can also be connected with described local disk A100, and general loading unit A2 is connected with described local disk A100 by Serial Port Line, also can adopt other mode.Search unit A3 mainly searches corresponding current index according to described item of information in local disk A100; Updating block A4 mainly carries out renewal rewards theory in described local disk A100, and therefore described local disk A100 is also connected with search unit A3, updating block A4 respectively.In a computer, between disk and internal memory, there is data communication, therefore also there is annexation between described local disk A100 and physical memory A200.Described physical memory A200 is also connected with described creating unit A1, described updating block A4 respectively.
In addition, characteristic described in the present embodiment regular or quantitative is loaded in described local domain A100, therefore described data update apparatus also comprises control unit (not indicating in figure), be connected with updating block A4, carry out a renewal rewards theory in order to updating block A4 described in timing controlled; Or, in order to when the quantity of more new data reaches predetermined value, control described updating block A4 and carry out a renewal rewards theory.
When timing loads data, timing unit (not indicating in figure) can also be increased, in order to timing, full 24 hours of cumulative time, send load signal or message to described control unit, then control updating block A4 by described control unit and carry out a renewal rewards theory; During quantitative loading data, metering units (not indicating in figure) can also be increased, in order to calculate the quantity of more new data, when reaching predetermined value, send load signal or message to described control unit, then carry out a renewal rewards theory by described control unit controlled loading unit A2.Described predetermined range is generally at 1 ten thousand to ten ten thousand, and this number can be changed and can not affect loading effect.
In the process of Data import and Data Update, big city relates to the step creating index, and therefore said apparatus also comprises:
Converting unit (not indicating in figure), in order to be converted to numeric type information data by the item of information of data;
Sequencing unit (not indicating in figure), in order to sort to described data according to described numeric type information data;
Operating unit (not indicating in figure) is current index in order to create the concordance list of the data after corresponding sequence.
Generally connect in turn between said units, because function needs also to connect according to other modes.From foregoing teachings, said units creates index based on the item of information of data, and described data are not limited to the data of renewal, also can be initial data or other data.Said units has versatility, is not limited to specific data type, is also not limited to specific environment for use, also can in order to create index in common data load process.
Because described local disk regularly or quantitatively carries out a renewal rewards theory, therefore each data upgraded likely are not quite similar.Due to each more new data, all can re-create described concordance list, the process therefore creating index is dynamic.That is, each described current index upgrading data creation not necessarily can be identical.If data are simple, change is little, may create one-level index in addition; If data are complicated, contain much information, then likely create multiple index, and each index progression created is also not necessarily identical.The form of described characteristic can be adapted to like this, different indexes is set, facilitate follow-up storage and arrangement, and comparison work.
Converting unit, the data type of the item of information of translation data, sequencing unit, sorts to described data, operating unit, and the concordance list of the data after corresponding sequence is current index.Much more no longer the method for above-mentioned establishment index is identical with flow chart in Fig. 2, to repeat herein.Due to different types of data, the mode creating index is slightly different, therefore above-mentioned converting unit, sequencing unit, and operating unit can increase and decrease as required, such as, remove sequencing unit, retains converting unit and operating unit.
When the data of described renewal are characteristic newly-increased in database, then: described converting unit, also in order to the item of information of described newly-increased characteristic is converted to numeric type information data; Described operating unit, also in order to described numeric type information data to be inserted in current index.
When the data of described renewal are characteristic to be deleted in described local disk, then: described converting unit, also in order to the item of information of described data to be deleted is converted to numeric type information data; Described operating unit, also in order to search key assignments corresponding to described numeric type information data in described current index, and deletes described key assignments corresponding in current index.
As shown in the above, described converting unit is responsible for the conversion of data type, and described operating unit carries out update or deletion action, can do accommodation when specific design.So not only can improve the step of index creation, save time, and reduce equipment consume, cost-saving.
The work of above-mentioned converting unit, sequencing unit and operating unit also can be completed by described loading unit, namely described loading unit is when carrying out data loading operations, also can carry out the operation creating index, and load data at every turn, corresponding index creation operation can be carried out according to data type.When more new data, then can notify that described loading unit re-creates current index by described updating block.
The annexation of said apparatus is not by the restriction of citing content, general by connection between device, possibility wireless connections sometimes, or controlled by network remote, and signal controls.The value volume and range of product of described device, also not by the restriction of foregoing, according to actual conditions, can be arranged flexibly.
Although the present invention with specific embodiment openly as above; but it is not for limiting the present invention; any those skilled in the art without departing from the spirit and scope of the present invention; the Method and Technology content of above-mentioned announcement can be utilized to make possible variation and amendment to technical solution of the present invention; therefore; every content not departing from technical solution of the present invention; the any simple modification done above embodiment according to technical spirit of the present invention, equivalent variations and modification, all belong to the protection domain of technical solution of the present invention.
Claims (24)
1. the data-updating method in Compare System, is characterized in that, comprising:
Internal memory cache region is created in physical memory;
When described Compare System exists the data upgraded, perform the following step:
Data according to upgrading set up item of information, and wherein, described item of information is corresponding with the comparison condition of described Compare System;
The data of renewal and item of information thereof are loaded in described internal memory cache region;
When carrying out renewal rewards theory, perform the following step:
In local disk, search corresponding current index according to described item of information, carry out the renewal rewards theory of local disk, wherein, described current index is set up according to the content of item of information.
2. data-updating method as claimed in claim 1, it is characterized in that, the data of described renewal are characteristic newly-increased in database, then described renewal rewards theory is the data in described internal memory cache region and item of information thereof are loaded in described local disk to become characteristic, and re-creates current index.
3. data-updating method as claimed in claim 1, it is characterized in that, the data of described renewal are amended characteristic in described local disk, then described renewal rewards theory is the former characteristic data in described internal memory cache region substituted in described local disk.
4. data-updating method as claimed in claim 1, it is characterized in that, the data of described renewal are characteristic to be deleted in described local disk, then described renewal rewards theory is delete characteristic to be deleted and item of information thereof in described local disk, and re-creates current index.
5. the data-updating method as described in any one of claim 1-4, is characterized in that, described current index creates according to following step:
The item of information of data is converted to numeric type information data;
According to described numeric type information data, described data are sorted;
The concordance list creating the data after corresponding sequence is current index.
6. data-updating method as claimed in claim 2, is characterized in that, described in re-create current index and comprise:
The item of information of described newly-increased characteristic is converted to numeric type information data;
Described numeric type information data is inserted in current index.
7. data-updating method as claimed in claim 4, is characterized in that, described in re-create current index and comprise:
The item of information of described characteristic to be deleted is converted to numeric type information data;
In described current index, search key assignments corresponding to described numeric type information data, and delete described key assignments corresponding in current index.
8. the data-updating method as described in any one of claim 1-4, is characterized in that, described renewal rewards theory timing is carried out once.
9. the data-updating method as described in any one of claim 1-4, is characterized in that, the quantity of described more new data reaches predetermined value, carries out once described renewal rewards theory.
10. data-updating method as claimed in claim 1, it is characterized in that, also be included in described local disk and create disk buffering district, the data of renewal and item of information thereof are loaded in described disk buffering district, the data in described disk buffering district are identical with the data in described internal memory cache region.
11. data-updating methods as claimed in claim 1, it is characterized in that, described local disk is the hard disk of comparison server, and described physical memory is the internal memory of described comparison server.
12. data-updating methods as claimed in claim 1, it is characterized in that, described data are face characteristic or fingerprint characteristic data, and the item of information of described data comprises sex, age and region.
Data update apparatus in 13. 1 kinds of Compare Systems, is characterized in that, comprising:
Creating unit, in order to create internal memory cache region in physical memory;
Loading unit, in order to when described Compare System exists the data upgraded, the data according to upgrading set up item of information, the data of renewal and item of information thereof are loaded in described internal memory cache region, wherein, described item of information is corresponding with the comparison condition of described Compare System;
Search unit, in order to when carrying out renewal rewards theory, in local disk, search corresponding current index according to described item of information, wherein, described current index is set up according to the content of item of information;
Updating block, in order to when carrying out renewal rewards theory, carries out the renewal rewards theory of local disk.
14. data update apparatus as claimed in claim 13, it is characterized in that, the data of described renewal are characteristic newly-increased in database, then the data in described internal memory cache region and item of information thereof are loaded in described local disk by described updating block becomes characteristic.
15. data update apparatus as claimed in claim 13, it is characterized in that, the data of described renewal are amended characteristic in described local disk, then the data in described internal memory cache region are substituted the former characteristic in described local disk by described updating block.
16. data update apparatus as claimed in claim 13, is characterized in that, the data of described renewal are characteristic to be deleted in described local disk, then described updating block deletes characteristic to be deleted in described local disk and item of information thereof.
17. data update apparatus as described in any one of claim 13-16, is characterized in that, also comprise:
Converting unit, in order to be converted to numeric type information data by the item of information of data;
Sequencing unit, in order to sort to described data according to described numeric type information data;
Operating unit is current index in order to create the concordance list of the data after corresponding sequence.
18. data update apparatus as claimed in claim 17, is characterized in that, the data of described renewal are characteristic newly-increased in database, then:
Described converting unit, also in order to the item of information of described newly-increased characteristic is converted to numeric type information data;
Described operating unit, also in order to described numeric type information data to be inserted in current index.
19. data update apparatus as claimed in claim 17, is characterized in that, the data of described renewal are characteristic to be deleted in described local disk, then:
Described converting unit, also in order to the item of information of described characteristic to be deleted is converted to numeric type information data;
Described operating unit, also in order to search key assignments corresponding to described numeric type information data in described current index, and deletes described key assignments corresponding in current index.
20. data update apparatus as described in any one of claim 13-16, is characterized in that, also comprise control unit, carry out once described renewal rewards theory in order to control the timing of described updating block.
21. data update apparatus as described in any one of claim 13-16, is characterized in that, also comprise control unit, in order to when the quantity of described more new data reaches predetermined value, control described updating block and carry out once described renewal rewards theory.
22. data update apparatus as claimed in claim 13, it is characterized in that, also be included in described local disk and create disk buffering district, the data of renewal and item of information thereof are loaded in described disk buffering district by described loading unit, and the data in described disk buffering district are identical with the data in described internal memory cache region.
23. data update apparatus as claimed in claim 13, it is characterized in that, described local disk is the hard disk of comparison server, and described physical memory is the internal memory of described comparison server.
24. data update apparatus as claimed in claim 13, it is characterized in that, described data are face characteristic or fingerprint characteristic data, and the item of information of described data comprises sex, age and region.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110001856.7A CN102591864B (en) | 2011-01-06 | 2011-01-06 | Data updating method and device in comparison system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110001856.7A CN102591864B (en) | 2011-01-06 | 2011-01-06 | Data updating method and device in comparison system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102591864A CN102591864A (en) | 2012-07-18 |
| CN102591864B true CN102591864B (en) | 2015-03-25 |
Family
ID=46480533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110001856.7A Expired - Fee Related CN102591864B (en) | 2011-01-06 | 2011-01-06 | Data updating method and device in comparison system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102591864B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104008067B (en) * | 2013-02-21 | 2017-05-31 | 联动优势科技有限公司 | A kind of method and device of data storage |
| CN104978344B (en) * | 2014-04-09 | 2018-11-20 | 华为技术有限公司 | A kind of data operating method and device |
| CN104021161B (en) * | 2014-05-27 | 2018-06-15 | 华为技术有限公司 | A kind of clustering storage method and device |
| CN106570036B (en) * | 2015-10-13 | 2019-11-12 | 北京国双科技有限公司 | Data adding method and device based on HBase database |
| CN106021301B (en) * | 2016-05-05 | 2020-02-04 | 北京思特奇信息技术股份有限公司 | Data comparison system and method for different file formats |
| CN108205543A (en) * | 2016-12-16 | 2018-06-26 | 北京酷我科技有限公司 | A kind of song information storage method and system |
| WO2018205151A1 (en) * | 2017-05-09 | 2018-11-15 | 华为技术有限公司 | Data updating method and storage device |
| CN110109954B (en) * | 2018-01-22 | 2023-05-26 | 腾讯科技（深圳）有限公司 | Data processing method, system, electronic device and storage medium |
| CN108647269A (en) * | 2018-04-28 | 2018-10-12 | 郑州云海信息技术有限公司 | A method of management storage device data variation |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101110088A (en) * | 2007-04-17 | 2008-01-23 | 南京中兴软创科技有限责任公司 | Database access interface method based on caching technology |
| CN101350030A (en) * | 2007-07-20 | 2009-01-21 | 株式会社东芝 | Method and apparatus for caching data |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7328153B2 (en) * | 2001-07-20 | 2008-02-05 | Gracenote, Inc. | Automatic identification of sound recordings |
-
2011
- 2011-01-06 CN CN201110001856.7A patent/CN102591864B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101110088A (en) * | 2007-04-17 | 2008-01-23 | 南京中兴软创科技有限责任公司 | Database access interface method based on caching technology |
| CN101350030A (en) * | 2007-07-20 | 2009-01-21 | 株式会社东芝 | Method and apparatus for caching data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102591864A (en) | 2012-07-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102591864B (en) | Data updating method and device in comparison system | |
| CN102629247B (en) | Method, device and system for data processing | |
| US8108446B1 (en) | Methods and systems for managing deduplicated data using unilateral referencing | |
| US11099771B2 (en) | System and method for early removal of tombstone records in database | |
| CN111339103B (en) | Data exchange method and system based on full-quantity fragmentation and incremental log analysis | |
| US10572508B2 (en) | Consistent query execution in hybrid DBMS | |
| CN104281533B (en) | A kind of method and device of data storage | |
| KR20170054299A (en) | Reference block aggregating into a reference set for deduplication in memory management | |
| CN104239377A (en) | Platform-crossing data retrieval method and device | |
| US20140258315A9 (en) | Method And Process For Enabling Distributing Cache Data Sources For Query Processing And Distributed Disk Caching Of Large Data And Analysis Requests | |
| CN107003935A (en) | Optimize database duplicate removal | |
| CN103902623A (en) | Method and system for accessing files on a storage system | |
| CN110659259B (en) | Database migration method, server and computer storage medium | |
| CN111949710A (en) | Data storage method, device, server and storage medium | |
| CN104462389A (en) | Method for implementing distributed file systems on basis of hierarchical storage | |
| CN102591855A (en) | Data identification method and data identification system | |
| CN110737680A (en) | Cache data management method and device, storage medium and electronic equipment | |
| US11726970B2 (en) | Incremental transfer of database segments | |
| CN105808449A (en) | Virtual storage image version management method and system for virtual machine | |
| CN106021593A (en) | Replication processing method in takeover process of first database and second database | |
| CN106021566A (en) | Method, device and system for improving concurrent processing capacity of single database | |
| EP3264291A1 (en) | Data block processing method and device | |
| US20200311029A1 (en) | Key value store using generation markers | |
| US9213759B2 (en) | System, apparatus, and method for executing a query including boolean and conditional expressions | |
| US9646016B2 (en) | Methods circuits apparatuses systems and associated computer executable code for data deduplication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150325 Termination date: 20200106 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |