CN114138753A - Method and device for regulating and controlling data processing pressure and computer readable storage medium - Google Patents
Method and device for regulating and controlling data processing pressure and computer readable storage medium Download PDFInfo
- Publication number
- CN114138753A CN114138753A CN202111495324.3A CN202111495324A CN114138753A CN 114138753 A CN114138753 A CN 114138753A CN 202111495324 A CN202111495324 A CN 202111495324A CN 114138753 A CN114138753 A CN 114138753A
- Authority
- CN
- China
- Prior art keywords
- data
- preset
- statistical
- database
- processing pressure
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 76
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000001276 controlling effect Effects 0.000 title claims abstract description 32
- 230000001105 regulatory effect Effects 0.000 title claims abstract description 32
- 238000003860 storage Methods 0.000 title claims abstract description 30
- 238000007405 data analysis Methods 0.000 claims abstract description 29
- 238000012544 monitoring process Methods 0.000 claims description 5
- 238000004519 manufacturing process Methods 0.000 abstract description 21
- 230000004044 response Effects 0.000 abstract description 10
- 238000012360 testing method Methods 0.000 description 23
- 238000004891 communication Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000009825 accumulation Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000005111 flow chemistry technique Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/24549—Run-time optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Probability & Statistics with Applications (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a device for regulating and controlling data processing pressure and a computer readable storage medium, wherein the method for regulating and controlling the data processing pressure comprises the following steps: when an operation station finishes operation, uploading station operation data of the operation station to a database and a preset cache queue; the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data; when the data statistical module starts to analyze data, starting a preset timer; and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database. By implementing the invention, the data processing times of the server are greatly reduced, the data operation processing pressure of the server is effectively reduced, the waiting time of data processing tasks is obviously reduced, the probability of deadlock is reduced, and the production abnormity caused by overtime response of the database is avoided.
Description
Technical Field
The invention relates to the technical field of computer data processing, in particular to a method and a device for regulating and controlling data processing pressure and a computer readable storage medium.
Background
Along with the diversification of products, the automation and the informatization construction of factory production, data acquisition points and statistical points are more and more. The existing production test tool operates in a mode that after the production operation execution test data is uploaded and recorded, other various informationized auxiliary data statistics are executed, and then the test is finished.
However, due to the increasingly increasing informatization auxiliary data statistics such as capacity statistics, straight-through rate statistics, test failure rate statistics, equipment utilization rate statistics, etc., the operation mode of the production test tool can bring huge pressure to the data processing of the production server, and the condition that the response delay is generated due to the fact that the instantaneous data processing pressure of the database is too large often occurs, so that the production line test fails, the production efficiency is affected, and great loss is caused.
Disclosure of Invention
The invention mainly aims to provide a method and a device for regulating and controlling data processing pressure and a computer readable storage medium, and aims to solve the technical problem that the production line test failure is caused and the production efficiency is influenced because the data processing pressure is too high at the moment of the occurrence of a database and response delay is generated.
In order to achieve the above object, the present invention provides a method for regulating data processing pressure, comprising the steps of:
when an operation station finishes operation, uploading station operation data of the operation station to a database and a preset cache queue;
the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data;
when the data statistical module starts to analyze data, starting a preset timer;
and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database.
Optionally, the step of starting the preset timer includes:
monitoring whether the timing duration of the preset timer reaches a preset duration or not;
when the timing duration of the preset timer does not reach the preset duration, controlling the data statistics module to store the statistical data into a preset storage space;
executing the step of controlling the data statistics module to perform data analysis on the station operation data in the preset cache queue to obtain statistical data;
and storing the obtained statistical data into the preset storage space until the timing duration of the preset timer reaches the preset duration.
Optionally, the step of uploading the statistical data within a preset time period to the database includes:
and controlling the data statistics module to upload the statistical data in the preset storage space in a preset time length to the database.
Optionally, the step of uploading the statistical data within the preset time period to the database includes:
after all the statistical data are uploaded, resetting the preset timer, and executing the step that the control data statistical module carries out data analysis on the station operation data in the preset cache queue to obtain statistical data;
and until the data in the preset buffer queue is analyzed.
Optionally, the step of performing data analysis on the station operation data in the preset buffer queue by the control data statistics module to obtain statistical data includes:
and starting a plurality of preset threads to respectively control a plurality of different data statistical modules to perform data analysis on the station operating data in the preset cache queue to obtain a plurality of different statistical data.
Optionally, the preset timer includes a plurality of preset timers respectively corresponding to the plurality of different data statistics modules, and the preset duration includes a plurality of preset durations.
Optionally, the step of uploading the workstation operation data to a database includes:
and generating an adding instruction and an updating instruction according to the station operation data, and sending the adding instruction and the updating instruction to a database so as to enable the database to add or update corresponding data.
Optionally, the step of uploading the statistical data within the preset time period to the database further includes:
and generating a query instruction, an adding instruction and an updating instruction according to the statistical data, and sending the adding instruction and the updating instruction to a database so that the database queries, adds or updates corresponding data.
In addition, in order to achieve the above object, the present invention further provides a data processing pressure regulating device, including: the system comprises a memory, a processor and a data processing pressure regulating program which is stored on the memory and can run on the processor, wherein the data processing pressure regulating program realizes the steps of the data processing pressure regulating method when being executed by the processor.
In addition, to achieve the above object, the present invention further provides a computer readable storage medium, on which a data processing pressure regulating program is stored, which when executed by a processor implements the steps of the data processing pressure regulating method as described above.
The invention provides a method and a device for regulating and controlling data processing pressure and a computer readable storage medium, wherein in the method for regulating and controlling the data processing pressure, when an operation station finishes operation, station operation data of the operation station is uploaded to a database and a preset cache queue; the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data; when the data statistical module starts to analyze data, starting a preset timer; and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database. According to the invention, by controlling the interaction times of the data statistical module and the database, the data processing times of the server are greatly reduced, the data operation processing pressure of the server is effectively reduced, the waiting time of a data processing task is obviously reduced, the probability of deadlock is reduced, and the production abnormity caused by overtime response of the database is avoided.
Drawings
Fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating a first embodiment of a method for regulating data processing pressure according to the present invention;
FIG. 3 is a diagram illustrating a data flow process for a defect in the prior art;
FIG. 4 is a schematic diagram of data flow processing of the method for regulating data processing pressure according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: a method for regulating and controlling data processing pressure comprises the following steps:
when an operation station finishes operation, uploading station operation data of the operation station to a database and a preset cache queue;
the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data;
when the data statistical module starts to analyze data, starting a preset timer;
and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database.
The existing production test tool operates in a mode that after the production operation execution test data is uploaded and recorded, other various informationized auxiliary data statistics are executed, and then the test is finished. However, due to the increasingly increased informatization auxiliary data statistics such as productivity statistics, first pass rate statistics, test failure rate statistics, equipment utilization rate statistics and the like, the operation mode of the production test tool increases the operation station time, increases the instantaneous data processing pressure of the server database, brings huge pressure to the data processing of the production server, often causes the condition that the response delay is generated due to the excessive instantaneous data processing pressure of the database, causes the production line test failure, affects the production efficiency and causes great loss.
The invention provides a method for regulating and controlling data processing pressure, which is characterized in that when an operation station finishes operation, station operation data of the operation station is uploaded to a database and a preset cache queue; the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data; when the data statistical module starts to analyze data, starting a preset timer; and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database. According to the invention, by controlling the interaction times of the data statistical module and the database, the data processing times of the server are greatly reduced, the data operation processing pressure of the server is effectively reduced, the waiting time of a data processing task is obviously reduced, the probability of deadlock is reduced, and the production abnormity caused by overtime response of the database is avoided.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be a PC, or a terminal device with a software running function, such as a tablet computer, a portable computer and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the mobile terminal is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer and tapping) and the like for recognizing the attitude of the mobile terminal; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include an operating system, a network communication module, a user interface module, and a regulation program of data processing pressure therein.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a regulation program of the data processing pressure stored in the memory 1005, and perform the following operations:
when an operation station finishes operation, uploading station operation data of the operation station to a database and a preset cache queue;
the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data;
when the data statistical module starts to analyze data, starting a preset timer;
and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database.
Further, the processor 1001 may call a regulation program of the data processing pressure stored in the memory 1005, and also perform the following operations:
monitoring whether the timing duration of the preset timer reaches a preset duration or not;
when the timing duration of the preset timer does not reach the preset duration, controlling the data statistics module to store the statistical data into a preset storage space;
executing the step of controlling the data statistics module to perform data analysis on the station operation data in the preset cache queue to obtain statistical data;
and storing the obtained statistical data into the preset storage space until the timing duration of the preset timer reaches the preset duration.
Further, the processor 1001 may call a regulation program of the data processing pressure stored in the memory 1005, and also perform the following operations:
the step of uploading the statistical data within a preset time period to the database comprises:
and controlling the data statistics module to upload the statistical data in the preset storage space in a preset time length to the database.
Further, the processor 1001 may call a regulation program of the data processing pressure stored in the memory 1005, and also perform the following operations:
after all the statistical data are uploaded, resetting the preset timer, and executing the step that the control data statistical module carries out data analysis on the station operation data in the preset cache queue to obtain statistical data;
and until the data in the preset buffer queue is analyzed.
Further, the processor 1001 may call a regulation program of the data processing pressure stored in the memory 1005, and also perform the following operations:
the step of the control data statistical module performing data analysis on the station operation data in the preset cache queue to obtain statistical data comprises the following steps:
and starting a plurality of preset threads to respectively control a plurality of different data statistical modules to perform data analysis on the station operating data in the preset cache queue to obtain a plurality of different statistical data.
Further, the preset timer comprises a plurality of preset timers respectively corresponding to the plurality of different data statistics modules, and the preset duration comprises a plurality of preset durations.
Further, the processor 1001 may call a regulation program of the data processing pressure stored in the memory 1005, and also perform the following operations:
the step of uploading the station operation data to a database comprises:
and generating an adding instruction and an updating instruction according to the station operation data, and sending the adding instruction and the updating instruction to a database so as to enable the database to add or update corresponding data.
Further, the processor 1001 may call a regulation program of the data processing pressure stored in the memory 1005, and also perform the following operations:
the step of uploading the statistical data within a preset time period to the database further comprises:
and generating a query instruction, an adding instruction and an updating instruction according to the statistical data, and sending the adding instruction and the updating instruction to a database so that the database queries, adds or updates corresponding data.
Referring to fig. 2, a first embodiment of the present invention provides a method for regulating data processing pressure, where the method for regulating data processing pressure includes:
step S10, when the operation station finishes the operation, the station operation data of the operation station is uploaded to a database and a preset buffer queue;
in this embodiment, the execution main body is a PC, the PC includes an MES (manufacturing execution system) service program, and data statistics is performed by the MES service program.
It should be noted that the work station may be an automatic or informatization work station in engineering production, and the work station operation data is some operation data, such as total product amount, good product amount, defective product amount, station equipment parameters, and the like, generated by the work station and collected by the service program. Referring to fig. 3 and 4, it can be known that the database is a server-side warehouse that organizes, stores, and manages data according to a data structure, and the preset buffer queue is the server buffer queue in fig. 4.
In this embodiment, the step of uploading the workstation operation data to the database in step S10 includes:
and generating an adding instruction and an updating instruction according to the station operation data, and sending the adding instruction and the updating instruction to a database so as to enable the database to add or update corresponding data.
As can be seen from fig. 3 and 4, after the program starts to run, the uploading of the data record of the job worker makes two data processing requests Insert (i.e., the add instruction) and Update (i.e., the Update instruction) to the database each time, so that the database adds or updates the corresponding data.
Step S20, controlling a data statistical module to perform data analysis on the station operation data in the preset buffer queue to obtain statistical data;
in this embodiment, step S20 includes:
and starting a plurality of preset threads to respectively control a plurality of different data statistical modules to perform data analysis on the station operating data in the preset cache queue to obtain a plurality of different statistical data.
It should be noted that, in this embodiment, a plurality of data statistics modules may be included, and a plurality of threads may be correspondingly enabled to perform data accumulation statistics (i.e., data analysis) on the plurality of data statistics modules, referring to fig. 4, the plurality of data statistics modules include a yield statistics module, a through-rate data statistics module, a bad test statistics module, a test device statistics module, and other statistics modules, where different statistics data are obtained by performing accumulation statistics on the different data statistics modules, and each module enables one thread to perform statistics on data in the cache queue.
Step S30, when the data statistical module starts to analyze the data, a preset timer is started;
in this embodiment, step S30 includes the following steps:
monitoring whether the timing duration of the preset timer reaches a preset duration or not;
when the timing duration of the preset timer does not reach the preset duration, controlling the data statistics module to store the statistical data into a preset storage space;
and continuing to execute the step S20, and storing the obtained statistical data in the preset storage space until the timing duration of the preset timer reaches a preset duration.
It should be noted that the preset timer may be a timer, refer to fig. 4, and is configured to set a time interval for a plurality of data statistics modules in the graph, or may be a plurality of preset timers, which respectively correspond to the plurality of different data statistics modules, and respectively set a time interval for one or more specific data statistics modules, where the preset duration may be a fixed interval and is configured to set a cache data storage time, for example, after 5 minutes, the cache data is updated to the database once, or may be a plurality of preset durations and is configured flexibly according to a user's requirement, for example, when a user is anxious to obtain the output statistics data, the corresponding time interval may be shortened, and other data statistics modules do not change.
It can be understood that, when the timing duration of the timer does not reach 5 minutes, the above steps of analyzing the data and accumulating the statistical data to the cache (i.e. the preset storage space) are repeated until an operation of updating the cache data to the database is performed after 5 minutes.
And step S40, when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database.
In step S40, the step of uploading the statistical data within a preset duration to the database includes:
and controlling the data statistics module to upload the statistical data in the preset storage space in a preset time length to the database.
Further comprising:
and generating a query instruction, an adding instruction and an updating instruction according to the statistical data, and sending the adding instruction and the updating instruction to a database so that the database queries, adds or updates corresponding data.
As can be seen from fig. 3 and 4, each time the data statistics module uploads data, it makes three data processing requests Query (i.e., the Query instruction), Insert (i.e., the add instruction), and Update (i.e., the Update instruction) to the database, so that the database queries, adds, or updates the corresponding data.
The obvious difference can be seen by comparing fig. 3 with fig. 4, in fig. 3, after the job site data record is uploaded, the output statistics, the first pass rate statistics, the bad test statistics, the test equipment statistics and other statistics are executed, and the statistical data is directly sent to the database, so that the instantaneous data processing pressure of the server database is increased; as can be seen from fig. 4, in this embodiment, when the job station completes the test and uploads the data, the data statistics module does not immediately send the statistical data obtained according to the job station operation data to the database as in fig. 3, but waits for the MES service to enable the thread control to perform cumulative statistics on the data in the queue, that is, the output statistics is accumulated in the cache, the first throughput data is accumulated in the cache, the bad test statistics is accumulated in the cache, the test equipment statistics is accumulated in the cache, and other statistics are accumulated in the cache. And then when the set time interval is reached, updating and inserting the accumulated statistical data into the database, otherwise, continuing to perform the steps of data statistics and accumulation, and obviously reducing the times of database data processing.
Step S40 is followed by:
after all the statistical data are uploaded, resetting the preset timer, and executing the step that the control data statistical module carries out data analysis on the station operation data in the preset cache queue to obtain statistical data;
and until the data in the preset buffer queue is analyzed.
It can be understood that, in order to ensure that data update can be performed every 5 minutes, the timer needs to be reset every time data is uploaded to the database, so that the time for next data update is still controllable, and the problem of excessive database operation processing pressure possibly caused by the transmission mode in fig. 3 is avoided.
Comparing fig. 3 with fig. 4, 10000 times of test data uploading to a server for calculation are executed according to 5 minutes, the data response times of the scheme with defects in fig. 3 is 10000 × 2+10000 × 3 × n times, and the data response times of the scheme is only 10000 × 2+3 × n times, wherein 2 represents two request instructions uploaded by the operation worker bit data records, 3 represents three request instructions uploaded by each data statistical module, and n is the number of the data statistical modules. The scheme provided by the embodiment obviously reduces the instant response times of the database greatly, and the reduction ratio is larger along with the more test line bodies and test stations and the more data types needing to be counted.
The various request instructions in this embodiment are not limited to 2 or 3, and are not limited to query, add, update, and other instructions, and may also be configured with required data processing instructions according to the needs of users or administrators.
The embodiment provides a method for regulating and controlling data processing pressure, and when an operation station finishes operation, station operation data of the operation station is uploaded to a database and a preset cache queue; the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data; when the data statistical module starts to analyze data, starting a preset timer; and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database. According to the invention, by controlling the interaction times of the data statistical module and the database, the data processing times of the server are greatly reduced, the data operation processing pressure of the server is effectively reduced, the waiting time of a data processing task is obviously reduced, the probability of deadlock is reduced, and the production abnormity caused by overtime response of the database is avoided.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a data processing pressure regulation and control program is stored on the computer-readable storage medium, and when executed by a processor, the data processing pressure regulation and control program implements the following operations:
when an operation station finishes operation, uploading station operation data of the operation station to a database and a preset cache queue;
the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data;
when the data statistical module starts to analyze data, starting a preset timer;
and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database.
Further, the regulation program of the data processing pressure is executed by the processor to realize the following operations:
monitoring whether the timing duration of the preset timer reaches a preset duration or not;
when the timing duration of the preset timer does not reach the preset duration, controlling the data statistics module to store the statistical data into a preset storage space;
executing the step of controlling the data statistics module to perform data analysis on the station operation data in the preset cache queue to obtain statistical data;
and storing the obtained statistical data into the preset storage space until the timing duration of the preset timer reaches the preset duration.
Further, the regulation program of the data processing pressure is executed by the processor to realize the following operations:
the step of uploading the statistical data within a preset time period to the database comprises:
and controlling the data statistics module to upload the statistical data in the preset storage space in a preset time length to the database.
Further, the regulation program of the data processing pressure is executed by the processor to realize the following operations:
after all the statistical data are uploaded, resetting the preset timer, and executing the step that the control data statistical module carries out data analysis on the station operation data in the preset cache queue to obtain statistical data;
and until the data in the preset buffer queue is analyzed.
Further, the regulation program of the data processing pressure is executed by the processor to realize the following operations:
the step of the control data statistical module performing data analysis on the station operation data in the preset cache queue to obtain statistical data comprises the following steps:
and starting a plurality of preset threads to respectively control a plurality of different data statistical modules to perform data analysis on the station operating data in the preset cache queue to obtain a plurality of different statistical data.
Further, the preset timer comprises a plurality of preset timers respectively corresponding to the plurality of different data statistics modules, and the preset duration comprises a plurality of preset durations.
Further, the regulation program of the data processing pressure is executed by the processor to realize the following operations:
the step of uploading the station operation data to a database comprises:
and generating an adding instruction and an updating instruction according to the station operation data, and sending the adding instruction and the updating instruction to a database so as to enable the database to add or update corresponding data.
Further, the regulation program of the data processing pressure is executed by the processor to realize the following operations:
the step of uploading the statistical data within a preset time period to the database further comprises:
and generating a query instruction, an adding instruction and an updating instruction according to the statistical data, and sending the adding instruction and the updating instruction to a database so that the database queries, adds or updates corresponding data.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method for regulating and controlling data processing pressure is characterized by comprising the following steps:
when an operation station finishes operation, uploading station operation data of the operation station to a database and a preset cache queue;
the control data statistical module performs data analysis on the station operation data in the preset cache queue to obtain statistical data;
when the data statistical module starts to analyze data, starting a preset timer;
and when the timing duration of the preset timer reaches a preset duration, uploading the statistical data in the preset duration to the database.
2. A method of regulating data processing pressure as recited in claim 1 wherein said step of starting a preset timer is followed by the steps of:
monitoring whether the timing duration of the preset timer reaches a preset duration or not;
when the timing duration of the preset timer does not reach the preset duration, controlling the data statistics module to store the statistical data into a preset storage space;
executing the step of controlling the data statistics module to perform data analysis on the station operation data in the preset cache queue to obtain statistical data;
and storing the obtained statistical data into the preset storage space until the timing duration of the preset timer reaches the preset duration.
3. A method of regulating data processing pressure according to claim 2, wherein the step of uploading the statistical data over a predetermined period of time to the database comprises:
and controlling the data statistics module to upload the statistical data in the preset storage space in a preset time length to the database.
4. A method of regulating data processing pressure according to claim 3, wherein said step of uploading said statistical data over a predetermined period of time to said database is followed by the steps of:
after all the statistical data are uploaded, resetting the preset timer, and executing the step that the control data statistical module carries out data analysis on the station operation data in the preset cache queue to obtain statistical data;
and until the data in the preset buffer queue is analyzed.
5. A method of regulating and controlling data processing pressure as claimed in claim 4, wherein the step of the control data statistics module performing data analysis on the station operating data in the preset buffer queue to obtain statistical data comprises:
and starting a plurality of preset threads to respectively control a plurality of different data statistical modules to perform data analysis on the station operating data in the preset cache queue to obtain a plurality of different statistical data.
6. A method as claimed in claim 5, wherein the predetermined timer comprises a plurality of predetermined timers respectively corresponding to the plurality of different data statistics modules, and the predetermined period comprises a plurality of predetermined periods.
7. A method of regulating data processing pressure according to any of claims 1-6, wherein the step of uploading the workstation operational data to a database comprises:
and generating an adding instruction and an updating instruction according to the station operation data, and sending the adding instruction and the updating instruction to a database so as to enable the database to add or update corresponding data.
8. A method of regulating data processing pressure according to any of claims 1-6, wherein the step of uploading the statistical data over a preset period of time to the database further comprises:
and generating a query instruction, an adding instruction and an updating instruction according to the statistical data, and sending the adding instruction and the updating instruction to a database so that the database queries, adds or updates corresponding data.
9. A data processing pressure regulating and controlling apparatus, comprising: memory, a processor and a data processing pressure regulating program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the data processing pressure regulating method according to any one of claims 1 to 8.
10. A computer-readable storage medium, wherein a data processing pressure regulation program is stored on the computer-readable storage medium, and when executed by a processor, the data processing pressure regulation program implements the steps of the data processing pressure regulation method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111495324.3A CN114138753A (en) | 2021-12-07 | 2021-12-07 | Method and device for regulating and controlling data processing pressure and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111495324.3A CN114138753A (en) | 2021-12-07 | 2021-12-07 | Method and device for regulating and controlling data processing pressure and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114138753A true CN114138753A (en) | 2022-03-04 |
Family
ID=80385348
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111495324.3A Pending CN114138753A (en) | 2021-12-07 | 2021-12-07 | Method and device for regulating and controlling data processing pressure and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114138753A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107370806A (en) * | 2017-07-12 | 2017-11-21 | 北京京东尚科信息技术有限公司 | HTTP conditional codes monitoring method, device, storage medium and electronic equipment |
| CN109144862A (en) * | 2018-08-10 | 2019-01-04 | 深圳市小牛在线互联网信息咨询有限公司 | Statistical method, device, computer equipment and the storage medium of test data |
| CN111984628A (en) * | 2020-08-28 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Database statistical information acquisition method, device, medium and electronic equipment |
| CN113672476A (en) * | 2021-10-25 | 2021-11-19 | 煜象科技(杭州)有限公司 | Method for counting running time of multiple terminal software |
-
2021
- 2021-12-07 CN CN202111495324.3A patent/CN114138753A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107370806A (en) * | 2017-07-12 | 2017-11-21 | 北京京东尚科信息技术有限公司 | HTTP conditional codes monitoring method, device, storage medium and electronic equipment |
| CN109144862A (en) * | 2018-08-10 | 2019-01-04 | 深圳市小牛在线互联网信息咨询有限公司 | Statistical method, device, computer equipment and the storage medium of test data |
| CN111984628A (en) * | 2020-08-28 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Database statistical information acquisition method, device, medium and electronic equipment |
| CN113672476A (en) * | 2021-10-25 | 2021-11-19 | 煜象科技(杭州)有限公司 | Method for counting running time of multiple terminal software |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107688530B (en) | Software testing method and device | |
| CN107678907B (en) | Database service logic monitoring method, system and storage medium | |
| US9092270B2 (en) | Method of SOA performance tuning | |
| CN112272239A (en) | Edge calculation method and device, intelligent terminal and computer readable storage medium | |
| CN109002295B (en) | Static code scanning method, system, server and storage medium | |
| US10088836B2 (en) | Methods, systems, and apparatus for resource allocation in a manufacturing environment | |
| CN113485918B (en) | Test method, test device, electronic equipment and storage medium | |
| EP3690583B1 (en) | Trace data acquisition system, trace data acquisition method, and program | |
| US20170205788A1 (en) | Client and server in supervisory control and data acquisition system | |
| CN109857528B (en) | Data migration speed adjusting method and device, storage medium and mobile terminal | |
| CN108255735B (en) | Associated environment testing method, electronic device and computer readable storage medium | |
| CN105045246A (en) | CIM system and control method, and production informatization system | |
| CN114138753A (en) | Method and device for regulating and controlling data processing pressure and computer readable storage medium | |
| EP3996345A1 (en) | Method for configuring priority level, cloud platform, system, computing device, and medium | |
| CN111339196B (en) | Data processing method and system based on block chain and computer readable storage medium | |
| JP2023519774A (en) | Automated test method, apparatus, electronic device, storage medium, and program | |
| CN115129574A (en) | Code testing method and device | |
| CN109586994B (en) | Aging test monitoring method and system for server of whole cabinet | |
| CN115657625B (en) | Monitoring method, program product, system, device and readable storage medium | |
| US20240273132A1 (en) | Data retrieval prediction method, apparatus, electronic device, and readable medium | |
| CN113507721B (en) | Network state monitoring method, device, system and storage medium | |
| CN116259374A (en) | Information processing method, system, storage device and electronic device | |
| CN115757010A (en) | Application abnormal data acquisition method, query method, device, equipment and medium | |
| CN113836045A (en) | Logic generation method and device for interface automation assertion and storage medium | |
| CN111381849B (en) | Software updating method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |