CN114035861A - Cluster configuration method and device, electronic equipment and computer readable medium - Google Patents
Cluster configuration method and device, electronic equipment and computer readable medium Download PDFInfo
- Publication number
- CN114035861A CN114035861A CN202111307620.6A CN202111307620A CN114035861A CN 114035861 A CN114035861 A CN 114035861A CN 202111307620 A CN202111307620 A CN 202111307620A CN 114035861 A CN114035861 A CN 114035861A
- Authority
- CN
- China
- Prior art keywords
- cluster
- configuration
- target
- recommendation result
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000012544 monitoring process Methods 0.000 claims abstract description 59
- 230000004044 response Effects 0.000 claims abstract description 39
- 238000012986 modification Methods 0.000 claims abstract description 25
- 230000004048 modification Effects 0.000 claims abstract description 25
- 230000002159 abnormal effect Effects 0.000 claims abstract description 20
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012790 confirmation Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 238000000605 extraction Methods 0.000 claims description 4
- 230000000737 periodic effect Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 230000001960 triggered effect Effects 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 229910052734 helium Inorganic materials 0.000 description 2
- 239000001307 helium Substances 0.000 description 2
- SWQJXJOGLNCZEY-UHFFFAOYSA-N helium atom Chemical compound [He] SWQJXJOGLNCZEY-UHFFFAOYSA-N 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
- G06F9/4451—User profiles; Roaming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the disclosure discloses a cluster configuration method and device, electronic equipment and a computer readable medium. One embodiment of the method comprises: in response to determining that the configuration task corresponding to the target cluster component meets a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task; extracting a configuration recommendation operator from the cluster configuration information; generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meeting a preset abnormal condition, wherein the target cluster component is deployed in the target cluster. The embodiment can realize automatic and dynamic modification of the resource configuration of the cluster.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of computers, in particular to a cluster configuration method, a cluster configuration device, electronic equipment and a computer readable medium.
Background
With the development of big data and AI technologies, big data platforms built on a cloud Service as a Service (IaaS Infrastructure as a Service) layer are successively introduced, and the big data platforms can deploy multiple cluster components. At present, when resource configuration is performed on a cluster component of a big data cluster, the following methods are generally adopted: the configuration of each cluster node of the big data cluster is kept consistent, or the configuration is carried out through operation and maintenance means or tools, for example, the configuration information is completely issued to the big data cluster by adopting the methods such as allowed and the like, and the cluster component is operated to restart to take effect.
However, when the resource allocation is performed in the above manner, the following technical problems often occur: the operation and maintenance personnel are required to manually operate, the configuration cannot be automatically modified, the optimization of the configuration depends on the expert experience, and the configuration cannot be dynamically adjusted at any time.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
Some embodiments of the present disclosure propose a cluster configuration method, apparatus, electronic device and computer readable medium to solve the technical problems mentioned in the background section above.
In a first aspect, some embodiments of the present disclosure provide a cluster configuration method, including: in response to determining that a configuration task corresponding to a target cluster component meets a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task; extracting a configuration recommendation operator from the cluster configuration information; generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meeting a preset abnormal condition, wherein the target cluster component is deployed in the target cluster.
Optionally, the sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes: sending the cluster configuration recommendation result to associated display equipment; and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to receiving the confirmation sending information record corresponding to the cluster configuration recommendation result.
Optionally, the method further comprises: and determining the configuration result as a target configuration result in response to receiving a cancel sending information record corresponding to the cluster configuration recommendation result or the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result do not satisfy the preset abnormal condition.
Optionally, the monitoring information is acquired according to the cluster configuration information; and the generating of the cluster configuration recommendation result includes: and inputting the monitoring information into the configuration recommendation operator to obtain a cluster configuration recommendation result.
Optionally, the obtaining, in response to determining that the configuration task corresponding to the target cluster component satisfies the preset trigger condition, the monitoring information corresponding to the target cluster component and the cluster configuration information corresponding to the configuration task includes: and in response to determining that the current time meets a preset period trigger condition included in the preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.
Optionally, the sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes storing the cluster configuration recommendation result to a target database.
Optionally, the sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes: and sending the configuration modification priority information and the cluster configuration recommendation result to each cluster node.
In a second aspect, some embodiments of the present disclosure provide a cluster configuration apparatus, including: the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to respond to the fact that a configuration task corresponding to a target cluster component meets a preset trigger condition, and acquire monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task; an extraction unit configured to extract a configuration recommendation operator from the cluster configuration information; the generating unit is configured to generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; and the sending unit is configured to respond to that the cluster configuration recommendation result and a configuration result of a target cluster corresponding to the configuration recommendation result meet a preset abnormal condition, and send the cluster configuration recommendation result to each cluster node corresponding to the target cluster, wherein the target cluster component is deployed in the target cluster.
Optionally, the sending unit of the apparatus is further configured to send the cluster configuration recommendation result to an associated display device; and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to receiving the confirmation sending information record corresponding to the cluster configuration recommendation result.
Optionally, the apparatus further comprises: and the determining unit is configured to determine the configuration result as a target configuration result in response to receiving a cancel sending information record corresponding to the cluster configuration recommendation result or the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result do not meet the preset abnormal condition.
Optionally, the monitoring information is collected according to the cluster configuration information. The generation unit is further configured to: and inputting the monitoring information into the configuration recommendation operator to obtain a cluster configuration recommendation result.
Optionally, the obtaining unit is further configured to: and in response to determining that the current time meets a preset period trigger condition included in the preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.
Optionally, the sending unit includes: and the storage unit is configured to store the cluster configuration recommendation result to a target database.
Optionally, the cluster configuration information includes configuration modification priority information. The sending unit is further configured to: and sending the configuration modification priority information and the cluster configuration recommendation result to each cluster node.
In a third aspect, some embodiments of the present disclosure provide an electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon, which when executed by one or more processors, cause the one or more processors to implement the method described in any of the implementations of the first aspect.
In a fourth aspect, some embodiments of the present disclosure provide a computer readable medium on which a computer program is stored, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect.
The above embodiments of the present disclosure have the following advantages: by the cluster configuration method of some embodiments of the disclosure, the resource configuration of the cluster can be automatically and dynamically modified. Specifically, the reason why the resource configuration of the cluster cannot be automatically and dynamically modified is that: the operation and maintenance personnel are required to manually operate, the configuration cannot be automatically modified, the optimization of the configuration depends on the expert experience, and the configuration cannot be dynamically adjusted at any time. Based on this, in the cluster configuration method according to some embodiments of the present disclosure, first, in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task are obtained. Therefore, the monitoring information of the cluster component (i.e., the target cluster component) corresponding to the currently triggered configuration task and the cluster configuration information of the currently triggered configuration task can be automatically acquired through the trigger condition corresponding to the configuration task. And then, extracting a configuration recommendation operator from the cluster configuration information. And then, generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator. Therefore, the cluster configuration recommendation result can be automatically generated through the configuration recommendation operator and the monitoring information included in the cluster configuration information. And finally, responding to the fact that the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meet preset abnormal conditions, and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster. And the target cluster component is deployed in the target cluster. Therefore, when the automatically generated cluster configuration recommendation result is different from the current configuration result of the target cluster, the cluster configuration recommendation result can be automatically pushed to each cluster node of the target cluster, so that each cluster node can carry out configuration modification according to the cluster configuration recommendation result. And because the recommendation result of the cluster configuration can be automatically generated and pushed, the resource configuration of the cluster can be automatically and dynamically modified.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.
FIG. 1 is a schematic diagram of one application scenario of a cluster configuration method in accordance with some embodiments of the present disclosure;
fig. 2 is a flow diagram of some embodiments of a cluster configuration method according to the present disclosure;
FIG. 3 is a flow diagram of further embodiments of a cluster configuration method according to the present disclosure;
FIG. 4 is a flow diagram of still further embodiments of a cluster configuration method according to the present disclosure;
fig. 5 is a schematic structural diagram of some embodiments of a cluster configuration apparatus according to the present disclosure;
FIG. 6 is a schematic structural diagram of an electronic device suitable for use in implementing some embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings. The embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Fig. 1 is a schematic diagram of one application scenario of a cluster configuration method according to some embodiments of the present disclosure.
In the application scenario of fig. 1, first, in response to determining that a configuration task 102 corresponding to a target cluster component satisfies a preset trigger condition, the computing device 101 may obtain monitoring information 103 corresponding to the target cluster component and cluster configuration information 104 corresponding to the configuration task 102. Computing device 101 may then extract configuration recommendation operator 105 from cluster configuration information 104 as described above. Thereafter, the computing device 101 may generate a cluster configuration recommendation 106 based on the monitoring information 103 and the configuration recommendation operator 105. Finally, in response to that the cluster configuration recommendation result 106 and the configuration result 107 of the target cluster corresponding to the configuration recommendation result 106 satisfy a preset abnormal condition, the computing device 101 may send the cluster configuration recommendation result 106 to each cluster node 108 corresponding to the target cluster. And the target cluster component is deployed in the target cluster.
The computing device 101 may be hardware or software. When the computing device is hardware, it may be implemented as a distributed cluster composed of multiple servers or terminal devices, or may be implemented as a single server or a single terminal device. When the computing device is embodied as software, it may be installed in the hardware devices enumerated above. It may be implemented, for example, as multiple software or software modules to provide distributed services, or as a single software or software module. And is not particularly limited herein.
It should be understood that the number of computing devices in FIG. 1 is merely illustrative. There may be any number of computing devices, as implementation needs dictate.
With continued reference to fig. 2, a flow 200 of some embodiments of a cluster configuration method according to the present disclosure is shown. The cluster configuration method comprises the following steps:
In some embodiments, an executing entity (e.g., the computing device 101 shown in fig. 1) of the cluster configuration method may, in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, acquire, from a target database, monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task through a wired connection manner or a wireless connection manner. The preset trigger condition may be "a trigger instruction for detecting the configuration task". The triggering instruction may be an instruction generated by a user manually triggering the configuration task. The configuration task may be a task for performing cluster configuration on the target cluster component. For example, the configuration task may be a timing task for performing cluster configuration on the target cluster component. The target cluster component may be a cluster component corresponding to the configuration task. The cluster component may be a big data component. For example, the target cluster component may be, but is not limited to, one of the following: hadoop component, hbase component, and elastic search component. The target database may be a database storing cluster configuration information of each cluster component and monitoring information of each cluster component, which are submitted by a user. The monitoring information may be related information for real-time monitoring of the operation of the target cluster component, and may include but is not limited to: basic information, component business information. The basic information may be related information of the device during operation, and may include but is not limited to: memory occupancy rate, CPU occupancy rate. The component service information may be related service information corresponding to the cluster component, and may include but is not limited to: query rate per second, read speed, JVM maximum memory, JVM minimum memory. The cluster configuration information may be related information included in the configuration task and used for configuring the target cluster component, and may include but is not limited to: the name of the cluster component, the configuration parameter corresponding to the name of the cluster component, the configuration recommendation operator and the execution period. The cluster configuration information may further include an identifier indicating whether the corresponding configuration task is retriable. The execution cycle may be a cycle for triggering a configuration task. The configuration parameter may include, but is not limited to, one of the following: JVM memory, concurrency number, file block size, and number of Kaffer card partitions. The configuration recommendation operator can be an operator which is configured by a user by adding an index and an operator and is used for generating a cluster configuration recommendation result. For example, the configuration recommendation operator may be a formula configured by the user, where the index added by the user is used as an independent variable and the configuration parameter is used as a dependent variable. The configuration recommendation operator may also be a code block of a method in which an index added by a user is used as a parameter and a value of a configuration parameter is used as a return value. As an example, the cluster configuration information may be "cluster component name: HIVE, configuration parameters: hive. helium, configuration recommendation operator: hive. shoulder. max × 1.2, execution cycle: 20 minutes ".
It should be noted that the wireless connection means may include, but is not limited to, a 3G/4G connection, a WiFi connection, a bluetooth connection, a WiMAX connection, a Zigbee connection, a uwb (ultra wideband) connection, and other wireless connection means now known or developed in the future.
In some optional implementation manners of some embodiments, the executing body may obtain, in response to determining that the current time meets a preset periodic trigger condition included in the preset trigger condition, monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task. The preset trigger condition comprises a preset period trigger condition. The preset period triggering condition may be "the current time is the period triggering time of the configuration task". For example, the current time may be "2021/8/111: 00". The period of the above configuration task trigger may be 20 minutes. The time that the above configuration task was last triggered may be "2021/8/110: 40". The current time "2021/8/111: 00" is the periodic trigger time of the above configuration task after "2021/8/110: 40". Therefore, the monitoring information and the cluster configuration information can be automatically and periodically acquired through the preset periodic trigger condition.
In some embodiments, the execution subject may extract a configuration recommendation operator from the cluster configuration information. In practice, the execution subject may extract a field value with a field of "configuration recommendation operator" from the cluster configuration information as the configuration recommendation operator.
And step 203, generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator.
In some embodiments, the execution subject may generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator. In practice, first, the execution main body may extract, as the respective index value information, respective information corresponding to the respective indexes in the configuration recommendation operator from the monitoring information. Then, the index value information can be input to the configuration recommendation operator respectively to obtain a cluster configuration recommendation result. For example, the configuration recommendation operator may be "hive. The index value information may be "hive. 128G ". The generated cluster configuration recommendation result may be: "hive. helium: 153.6G "(153.6G ═ 128G × 1.2).
Optionally, the monitoring information is collected according to the cluster configuration information. The monitoring information only includes information corresponding to each index in the configuration recommendation operator included in the cluster configuration information. The execution main body can directly input the monitoring information into the configuration recommendation operator to obtain a cluster configuration recommendation result. Therefore, the utilization rate of the monitoring information can be improved, so that the monitoring information is directly input into the configuration recommendation operator to obtain a cluster configuration recommendation result.
And 204, responding to the fact that the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meet the preset abnormal condition, and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster.
In some embodiments, the execution main body may send the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to that the cluster configuration recommendation result and a configuration result of the target cluster corresponding to the configuration recommendation result satisfy a preset abnormal condition. The target cluster may be a cluster of computers that deploy the target cluster component. The configuration result may be a configuration parameter value of the target cluster corresponding to the configuration parameter included in the configuration recommendation result. For example, the above configuration result may be "hive. 128G ". The preset abnormal condition may be that the cluster configuration recommendation result is different from the configuration result. In practice, the execution subject may send the cluster configuration recommendation result to each cluster node corresponding to the target cluster synchronously. It is to be understood that the execution subject may be any node in the cluster nodes.
In some optional implementation manners of some embodiments, the execution subject may further store the cluster configuration recommendation result in a target database. The target database may be a database that stores the monitoring information and the cluster configuration information. For example, the target database may be a MYSQL database. Therefore, the sent cluster configuration recommendation result can be stored and backed up.
The above embodiments of the present disclosure have the following advantages: by the cluster configuration method of some embodiments of the disclosure, the resource configuration of the cluster can be automatically and dynamically modified. Specifically, the reason why the resource configuration of the cluster cannot be automatically and dynamically modified is that: the operation and maintenance personnel are required to manually operate, the configuration cannot be automatically modified, the optimization of the configuration depends on the expert experience, and the configuration cannot be dynamically adjusted at any time. Based on this, in the cluster configuration method according to some embodiments of the present disclosure, first, in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task are obtained. Therefore, the monitoring information of the cluster component (i.e., the target cluster component) corresponding to the currently triggered configuration task and the cluster configuration information of the currently triggered configuration task can be automatically acquired through the trigger condition corresponding to the configuration task. And then, extracting a configuration recommendation operator from the cluster configuration information. And then, generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator. Therefore, the cluster configuration recommendation result can be automatically generated through the configuration recommendation operator and the monitoring information included in the cluster configuration information. And finally, responding to the fact that the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meet preset abnormal conditions, and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster. And the target cluster component is deployed in the target cluster. Therefore, when the automatically generated cluster configuration recommendation result is different from the current configuration result of the target cluster, the cluster configuration recommendation result can be automatically pushed to each cluster node of the target cluster, so that each cluster node can carry out configuration modification according to the cluster configuration recommendation result. And because the recommendation result of the cluster configuration can be automatically generated and pushed, the resource configuration of the cluster can be automatically and dynamically modified.
With further reference to fig. 3, a flow 300 of further embodiments of a cluster configuration method is illustrated. The process 300 of the cluster configuration method includes the following steps:
And 303, generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator.
In some embodiments, the specific implementation and technical effects of steps 301 and 303 can refer to steps 201 and 203 in the embodiments corresponding to fig. 2, which are not described herein again.
In some embodiments, an execution subject of the cluster configuration method (for example, the computing device 101 shown in fig. 1) may send the cluster configuration recommendation result to an associated display device in response to that the cluster configuration recommendation result and a configuration result of a target cluster corresponding to the configuration recommendation result satisfy a preset abnormal condition, so that the display device displays the cluster configuration recommendation result.
In some embodiments, the executing agent may send the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to receiving a confirmation sending information record corresponding to the cluster configuration recommendation result. The sending confirmation information record may be an information record that is generated by the execution main body and indicates that the cluster configuration recommendation result is confirmed to be sent after the user browses the displayed cluster configuration recommendation result through the display device and executes sending confirmation operation on the displayed cluster configuration recommendation result. The above acknowledgement sending operation may include, but is not limited to: click, slide, hover, drag. Therefore, after the user confirms the automatically generated cluster configuration recommendation result, the cluster configuration recommendation result can be pushed.
Optionally, in response to receiving a cancel sending information record corresponding to the cluster configuration recommendation result, or that the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result do not satisfy the preset abnormal condition, the execution main body may determine the configuration result as a target configuration result. The cancel sending information record may be an information record that is generated by the execution main body and represents that the cluster configuration recommendation result is canceled for sending after the user browses the displayed cluster configuration recommendation result through the display device and performs a cancel sending operation on the displayed cluster configuration recommendation result. The cancellation operation may include, but is not limited to: click, slide, hover, drag. The target configuration result may be a configuration result that characterizes the configuration result without modification. Therefore, the original configuration of the target cluster can be still maintained when the user cancels sending of the cluster configuration recommendation result or the cluster configuration recommendation result is the same as the configuration result.
As can be seen from fig. 3, compared with the description of some embodiments corresponding to fig. 2, the flow 300 of the cluster configuration method in some embodiments corresponding to fig. 3 embodies the steps of displaying the recommendation result of the cluster configuration and expanding the record of the sending confirmation information. Therefore, the solutions described in the embodiments may push the cluster configuration recommendation result after the user confirms the automatically generated cluster configuration recommendation result.
With further reference to fig. 4, a flow 400 of still further embodiments of a cluster configuration method is illustrated. The flow 400 of the cluster configuration method includes the following steps:
And 403, generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator.
In some embodiments, the specific implementation and technical effects of steps 401 and 403 may refer to steps 201 and 203 in the embodiments corresponding to fig. 2, which are not described herein again.
In some embodiments, an executing entity (e.g., the computing device 101 shown in fig. 1) of the cluster configuration method may send, in response to that the cluster configuration recommendation result and a configuration result of a target cluster corresponding to the configuration recommendation result satisfy a preset exception condition, configuration modification priority information and the cluster configuration recommendation result to each cluster node. Wherein the cluster configuration information includes the configuration modification priority information. The configuration modification priority information may be information indicating an urgency of modification of the configuration or a priority of processing. For example, the configuration modification priority information may include, but is not limited to, one of: high priority, medium priority, low priority. The high priority can represent that if the current configuration parameters are abnormal, the cluster performance is seriously influenced, and the current configuration parameters need to be modified immediately. The priority of modifying the configuration characterized by the medium priority is inferior to the high priority. The low priority is characterized by a priority of modifying the configuration that is inferior to the medium priority. Therefore, the configuration modification priority information and the cluster configuration recommendation result can be simultaneously sent to each cluster node of the cluster, so that each node of the cluster carries out configuration modification in order according to the configuration modification priority information corresponding to the cluster configuration recommendation result.
As can be seen from fig. 4, compared with the description of some embodiments corresponding to fig. 2, the flow 400 of the cluster configuration method in some embodiments corresponding to fig. 4 embodies a step of expanding the configuration modification priority information. Therefore, the solutions described in the embodiments may send the configuration modification priority information and the cluster configuration recommendation result to each cluster node of the cluster at the same time, so that each node of the cluster performs configuration modification in order according to the configuration modification priority information corresponding to the cluster configuration recommendation result.
With further reference to fig. 5, as an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a cluster configuration apparatus, which correspond to those shown in fig. 2, and which may be specifically applied in various electronic devices.
As shown in fig. 5, the cluster configuration apparatus 500 of some embodiments includes: an acquisition unit 501, an extraction unit 502, a generation unit 503, and a transmission unit 504. The obtaining unit 501 is configured to, in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, obtain monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task; the extracting unit 502 is configured to extract a configuration recommendation operator from the cluster configuration information; the generating unit 503 is configured to generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; the sending unit 504 is configured to send the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to that the cluster configuration recommendation result and a configuration result of the target cluster corresponding to the configuration recommendation result satisfy a preset abnormal condition, where the target cluster component is deployed in the target cluster.
Optionally, the sending unit 504 of the cluster configuration apparatus 500 may be further configured to send the cluster configuration recommendation result to an associated display device; and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to receiving the confirmation sending information record corresponding to the cluster configuration recommendation result.
Optionally, the cluster configuration apparatus 500 may further include: and a determining unit (not shown in the figures) configured to determine the configuration result as a target configuration result in response to receiving a cancel sending information record corresponding to the cluster configuration recommendation result or the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result not meeting the preset abnormal condition.
Optionally, the monitoring information is collected according to the cluster configuration information. The generating unit 503 may be further configured to: and inputting the monitoring information into the configuration recommendation operator to obtain a cluster configuration recommendation result.
Optionally, the obtaining unit 501 may be further configured to: and in response to determining that the current time meets a preset period trigger condition included in the preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.
Alternatively, the sending unit 504 may include: and a storage unit (not shown in the figure) configured to store the cluster configuration recommendation result to the target database.
Optionally, the cluster configuration information includes configuration modification priority information. The sending unit 504 may be further configured to: and sending the configuration modification priority information and the cluster configuration recommendation result to each cluster node.
It will be understood that the elements described in the apparatus 500 correspond to various steps in the method described with reference to fig. 2. Thus, the operations, features and resulting advantages described above with respect to the method are also applicable to the apparatus 500 and the units included therein, and are not described herein again.
Referring now to FIG. 6, a block diagram of an electronic device (e.g., computing device 101 of FIG. 1)600 suitable for use in implementing some embodiments of the present disclosure is shown. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, electronic device 600 may include a processing means (e.g., central processing unit, graphics processor, etc.) 601 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage means 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the electronic apparatus 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device 600 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in fig. 6 may represent one device or may represent multiple devices as desired.
In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In some such embodiments, the computer program may be downloaded and installed from a network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602. The computer program, when executed by the processing device 601, performs the above-described functions defined in the methods of some embodiments of the present disclosure.
It should be noted that the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: in response to determining that a configuration task corresponding to a target cluster component meets a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task; extracting a configuration recommendation operator from the cluster configuration information; generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meeting a preset abnormal condition, wherein the target cluster component is deployed in the target cluster.
Computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in some embodiments of the present disclosure may be implemented by software, and may also be implemented by hardware. The described units may also be provided in a processor, and may be described as: a processor includes an acquisition unit, an extraction unit, a generation unit, and a transmission unit. The names of these units do not form a limitation on the units themselves in some cases, for example, the obtaining unit may also be described as a "unit that obtains monitoring information corresponding to a target cluster component and cluster configuration information corresponding to a configuration task in response to determining that the configuration task corresponding to the target cluster component satisfies a preset trigger condition".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept as defined above. For example, the above features and (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure are mutually replaced to form the technical solution.
Claims (10)
1. A cluster configuration method, comprising:
in response to determining that a configuration task corresponding to a target cluster component meets a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task;
extracting a configuration recommendation operator from the cluster configuration information;
generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator;
and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meeting a preset abnormal condition, wherein the target cluster component is deployed in the target cluster.
2. The method of claim 1, wherein the sending the cluster configuration recommendation to each cluster node corresponding to the target cluster comprises:
sending the cluster configuration recommendation result to associated display equipment;
and responding to the received confirmation sending information record corresponding to the cluster configuration recommendation result, and sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster.
3. The method of claim 2, wherein the method further comprises:
and determining the configuration result as a target configuration result in response to receiving a cancel sending information record corresponding to the cluster configuration recommendation result or determining that the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result do not meet the preset abnormal condition.
4. The method of claim 1, wherein the monitoring information is collected according to the cluster configuration information; and
the generating of the cluster configuration recommendation result includes:
and inputting the monitoring information into the configuration recommendation operator to obtain a cluster configuration recommendation result.
5. The method of claim 1, wherein the obtaining monitoring information corresponding to a target cluster component and cluster configuration information corresponding to a configuration task in response to determining that the configuration task corresponding to the target cluster component satisfies a preset trigger condition comprises:
and in response to determining that the current time meets a preset periodic trigger condition included in the preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.
6. The method of claim 1, wherein the sending the cluster configuration recommendation to each cluster node corresponding to the target cluster comprises:
and storing the cluster configuration recommendation result to a target database.
7. The method of claim 1, wherein the cluster configuration information comprises configuration modification priority information, and
the sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes:
and sending the configuration modification priority information and the cluster configuration recommendation result to each cluster node.
8. A cluster configuration apparatus, comprising:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to respond to the fact that a configuration task corresponding to a target cluster component meets a preset trigger condition, and acquire monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task;
an extraction unit configured to extract a configuration recommendation operator from the cluster configuration information;
the generating unit is configured to generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator;
the sending unit is configured to respond that the cluster configuration recommendation result and a configuration result of a target cluster corresponding to the configuration recommendation result meet a preset abnormal condition, and send the cluster configuration recommendation result to each cluster node corresponding to the target cluster, wherein the target cluster component is deployed in the target cluster.
9. An electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111307620.6A CN114035861A (en) | 2021-11-05 | 2021-11-05 | Cluster configuration method and device, electronic equipment and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111307620.6A CN114035861A (en) | 2021-11-05 | 2021-11-05 | Cluster configuration method and device, electronic equipment and computer readable medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114035861A true CN114035861A (en) | 2022-02-11 |
Family
ID=80136504
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111307620.6A Pending CN114035861A (en) | 2021-11-05 | 2021-11-05 | Cluster configuration method and device, electronic equipment and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114035861A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114896296A (en) * | 2022-02-24 | 2022-08-12 | 浙江华通云数据科技有限公司 | Cloud service resource configuration method and device, electronic equipment and computer readable medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170261949A1 (en) * | 2016-03-11 | 2017-09-14 | University Of Chicago | Apparatus and method for optimizing quantifiable behavior in configurable devices and systems |
| US20180212843A1 (en) * | 2017-01-23 | 2018-07-26 | Electronics And Telecommunications Research Institute | Cloud system for supporting big data process and operation method thereof |
| CN110262899A (en) * | 2019-06-20 | 2019-09-20 | 无锡华云数据技术服务有限公司 | Monitor component elastic telescopic method, apparatus and controlled terminal based on Kubernetes cluster |
| WO2019232980A1 (en) * | 2018-06-05 | 2019-12-12 | 平安科技（深圳）有限公司 | Node configuration method and apparatus, computer readable storage medium, and electronic device |
| CN113032412A (en) * | 2021-03-03 | 2021-06-25 | 北京沃东天骏信息技术有限公司 | Data synchronization method and device, electronic equipment and computer readable medium |
-
2021
- 2021-11-05 CN CN202111307620.6A patent/CN114035861A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170261949A1 (en) * | 2016-03-11 | 2017-09-14 | University Of Chicago | Apparatus and method for optimizing quantifiable behavior in configurable devices and systems |
| US20180212843A1 (en) * | 2017-01-23 | 2018-07-26 | Electronics And Telecommunications Research Institute | Cloud system for supporting big data process and operation method thereof |
| WO2019232980A1 (en) * | 2018-06-05 | 2019-12-12 | 平安科技（深圳）有限公司 | Node configuration method and apparatus, computer readable storage medium, and electronic device |
| CN110262899A (en) * | 2019-06-20 | 2019-09-20 | 无锡华云数据技术服务有限公司 | Monitor component elastic telescopic method, apparatus and controlled terminal based on Kubernetes cluster |
| CN113032412A (en) * | 2021-03-03 | 2021-06-25 | 北京沃东天骏信息技术有限公司 | Data synchronization method and device, electronic equipment and computer readable medium |
Non-Patent Citations (2)
| Title |
|---|
| 李红辉;关婷婷;杨芳南;: "云计算平台状态监控技术研究与应用", 软件, no. 01, 15 January 2018 (2018-01-15) * |
| 熊齐;唐佳明;: "Linux集群实时监控系统的一种实现方法", 计算机系统应用, no. 09, 15 September 2013 (2013-09-15) * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114896296A (en) * | 2022-02-24 | 2022-08-12 | 浙江华通云数据科技有限公司 | Cloud service resource configuration method and device, electronic equipment and computer readable medium |
| CN114896296B (en) * | 2022-02-24 | 2023-08-11 | 浙江华通云数据科技有限公司 | Cloud service resource allocation method and device, electronic equipment and computer readable medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112015816A (en) | Data synchronization method, device, medium and electronic equipment | |
| CN114625597A (en) | Monitoring operation and maintenance system, method and device, electronic equipment and storage medium | |
| CN112416632B (en) | Event communication method and device, electronic equipment and computer readable medium | |
| CN113722055A (en) | Data processing method and device, electronic equipment and computer readable medium | |
| CN112907942A (en) | Vehicle scheduling method, device, equipment and medium based on edge calculation | |
| CN113721811B (en) | Popup window sending method, popup window sending device, electronic equipment and computer readable medium | |
| CN112699111B (en) | Report generation method and device, electronic equipment and computer readable medium | |
| CN112464039B (en) | Tree-structured data display method and device, electronic equipment and medium | |
| CN114035861A (en) | Cluster configuration method and device, electronic equipment and computer readable medium | |
| CN111612434B (en) | Method, apparatus, electronic device and medium for generating processing flow | |
| CN111898061A (en) | Method, device, electronic equipment and computer readable medium for searching network | |
| CN112507676B (en) | Method and device for generating energy report, electronic equipment and computer readable medium | |
| CN110750424A (en) | Resource inspection method and device | |
| CN111625692B (en) | Feature extraction method, device, electronic equipment and computer readable medium | |
| CN113778850A (en) | Data processing method and device, electronic equipment and computer readable medium | |
| CN113486968A (en) | Method, device, equipment and medium for monitoring life cycle of camera | |
| CN112543228A (en) | Data transmission method and device, electronic equipment and computer readable medium | |
| CN112311842A (en) | Method and device for information interaction | |
| CN113472565B (en) | Method, apparatus, device and computer readable medium for expanding server function | |
| CN114629821B (en) | Internet of things consumption data generation method, device, equipment and medium | |
| CN112965827B (en) | Information scheduling method and device, electronic equipment and computer medium | |
| CN112822247B (en) | System asynchronous communication method, device, electronic equipment and computer readable medium | |
| CN112559087B (en) | Information generation method, apparatus, electronic device and computer readable medium | |
| CN112182002A (en) | Data disaster tolerance method and device, electronic equipment and computer readable medium | |
| CN114398437A (en) | User information processing method and device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |