CN108632111A - Service link monitoring method based on log - Google Patents
Service link monitoring method based on log Download PDFInfo
- Publication number
- CN108632111A CN108632111A CN201810282823.6A CN201810282823A CN108632111A CN 108632111 A CN108632111 A CN 108632111A CN 201810282823 A CN201810282823 A CN 201810282823A CN 108632111 A CN108632111 A CN 108632111A
- Authority
- CN
- China
- Prior art keywords
- service
- link
- calling
- service node
- daily record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 26
- 238000000034 method Methods 0.000 title claims abstract description 13
- 238000013500 data storage Methods 0.000 claims description 3
- 238000007619 statistical method Methods 0.000 claims description 3
- 238000011161 development Methods 0.000 abstract description 6
- 230000008878 coupling Effects 0.000 abstract description 3
- 238000010168 coupling process Methods 0.000 abstract description 3
- 238000005859 coupling reaction Methods 0.000 abstract description 3
- 238000013480 data collection Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0677—Localisation of faults
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a service link monitoring method based on logs, which comprises the steps that a service node accesses an http request; generating a service node identifier and binding the http request; putting the service node identification into a thread variable for calling between service nodes; after the calling is finished, the monitoring information of the calling service link is generated, collected and processed, the whole calling link of each request can be monitored, and the problem can be quickly found and positioned; the method is irrelevant to service node business, development language and development architecture, and has strong universality at the bottom of the coupling degree; the method is not only suitable for newly developed services, but also easy to expand the existing services; the service node, the link data collection and the link monitoring platform are independent and do not influence each other, so that the stability and the usability of the service system are better guaranteed.
Description
Technical field
The present invention relates to computer realm, especially a kind of service link monitoring method based on daily record.
Background technology
Under cloud computing environment prevailing, the exploitation of application is more and more to use Distributed Services framework, after an application
Platform is made of several or even tens independent deployment ISPs, and service provider distributed deployment is held in multiple servers
It inside device, is called between each other with data format using the agreement of agreement, the provider of service is also other clothes simultaneously
The consumer of business may need to call multiple service providers using one service request of processing.In so complicated deployment ring
In border, we just need more effective monitoring system to carry out follow-up service node between call relation, handle service node calling
Sequentially, it quickly positions and solves the problems, such as.
Invention content
In order to solve the above technical problems, the object of the present invention is to provide a kind of service link monitoring method based on daily record.
The technical solution adopted by the present invention is：
A kind of service link monitoring method based on daily record, including service node access http request；
Service node is generated to identify and bind the http request；
Service node mark is put into thread variable for the calling between service node；
It after calling, generates, collect and handle and call service link monitoring information.
The service node mark includes request mark and total service identifiers, and the request mark is for being used as service chaining
To distinguish different service links, total service identifiers are used to identify the call relation and tune between each service node label in road
With sequence.
Total service identifiers include father's service identifiers and service identifiers, and the service identifiers are used to be used as next calling
Father's service identifiers of service node.
It is described generate, collect and handle call link monitoring information include
It generates and calls service link daily record data；
Usage log collector will call service link daily record data to be written in daily record document and/or server；
Service link monitor supervision platform obtains data from server and carries out data storage and the data according to collection, provides
The inquiry of service link, statistical analysis, alert function.
Beneficial effects of the present invention：
The present invention can be monitored the entire calling link of each request, can quickly find and orientation problem；With
Service node business, development language, development frame are unrelated, and there is very strong versatility at degree of coupling bottom；It is not only applicable to newly developed
Service, while existing service is extended and is also easy to；Service node, link data collection, three, link monitoring platform
It is independent, is independent of each other have better guarantee to the stabilization of operation system, availability in this way..
Description of the drawings
The specific implementation mode of the present invention is described further below in conjunction with the accompanying drawings.
Fig. 1 is the logic diagram of the present invention.
Fig. 2 is the logic diagram of the call relation and calling sequence of service node mark of the present invention.
Fig. 3 is that the present invention is generated, collected and handles the logic diagram for calling link monitoring information.
Specific implementation mode
As shown in Figure 1, a kind of service link monitoring method based on daily record, including：Service node accesses http request；It is raw
It is identified at service node and binds the http request；Service node mark is put into thread variable between service node
It calls；It after calling, generates, collect and handle and call service link monitoring information, calling service link monitoring information includes
The information such as service node mark, upper service node mark, request time, request used time.In the present invention, service node makes
It is uniformly accessed into processing http request with blocker.
As shown in Fig. 2, the service node mark includes request mark and total service identifiers, the request mark is used for
Different service links is distinguished as the label in service link, total service identifiers are used to identify the tune between each service node
With relationship and calling sequence.
Total service identifiers include father's service identifiers and service identifiers, and the service identifiers are used to be used as next calling
Father's service identifiers of service node.The each branch's service link formed for starting point by service node A in figure, request mark
It is unique constant to be set as r001, and father's service identifiers of service node B, service node C and service node D are service node A
Service identifiers, father's service identifiers of service node E are the service identifiers of service node B, and father's service identifiers of service node F are
The service identifiers of service node C design hierarchical relationship and define in this way, convenient for monitoring and collecting information.
As shown in figure 3, described generate, collect and handle calling link monitoring information including generating calling service link daily record
Data；Usage log collector will call service link daily record data to be written in daily record document and/or server；Service link
Monitor supervision platform obtains data from server and carries out data storage and the data according to collection, provide service link inquiry,
Statistical analysis, alert function.In the present invention, conventional daily record frame can be used directly calling service link daily record
Data are written in individual daily record document, can also usage log collector, such as：The frames such as logstash, flume, directly handle
Log collection is simultaneously written to Message Queuing server.It further includes calling the time started, calling knot to call service link monitoring information
Beam time, required parameter, request address, IP address, service node title etc..
The present invention can be monitored the entire calling link of each request, can quickly find and orientation problem；With
Service node business, development language, development frame are unrelated, and there is very strong versatility at degree of coupling bottom；It is not only applicable to newly developed
Service, while existing service is extended and is also easy to；Service node, link data collection, three, link monitoring platform
It is independent, is independent of each other have better guarantee to the stabilization of operation system, availability in this way.
The foregoing is merely the preferred embodiments of the present invention, and the present invention is not limited to the above embodiments, as long as with
Essentially identical means realize that the technical solution of the object of the invention belongs within protection scope of the present invention.
Claims (4)
1. a kind of service link monitoring method based on daily record, it is characterised in that:Including
Service node accesses http request；
Service node is generated to identify and bind the http request；
Service node mark is put into thread variable for the calling between service node；
It after calling, generates, collect and handle and call service link monitoring information.
2. a kind of service link monitoring method based on daily record according to claim 1, it is characterised in that：The service section
Point identification includes request mark and total service identifiers, and the request mark is used for as the label in service link to distinguish not
Same service link, total service identifiers are used to identify call relation and calling sequence between each service node.
3. a kind of service link monitoring method based on daily record according to claim 2, it is characterised in that：Total service
Mark includes father's service identifiers and service identifiers, and the service identifiers are used to call the father of service node to service mark as next
Know.
4. a kind of service link monitoring method based on daily record according to claim 1, it is characterised in that：The generation,
It collects and handles calling link monitoring information and include
It generates and calls service link daily record data；
Usage log collector will call service link daily record data to be written in daily record document and/or server；
Service link monitor supervision platform obtains data from server and carries out data storage and the data according to collection, provides service
The inquiry of link, statistical analysis, alert function.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810282823.6A CN108632111A (en) | 2018-04-02 | 2018-04-02 | Service link monitoring method based on log |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810282823.6A CN108632111A (en) | 2018-04-02 | 2018-04-02 | Service link monitoring method based on log |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108632111A true CN108632111A (en) | 2018-10-09 |
Family
ID=63696563
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810282823.6A Pending CN108632111A (en) | 2018-04-02 | 2018-04-02 | Service link monitoring method based on log |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108632111A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109639809A (en) * | 2018-12-20 | 2019-04-16 | 上海拍拍贷金融信息服务有限公司 | A kind of method and device of service data request link monitoring |
| CN109873717A (en) * | 2019-01-18 | 2019-06-11 | 深圳壹账通智能科技有限公司 | Monitoring method, device, computer equipment and storage medium |
| CN109981349A (en) * | 2019-02-27 | 2019-07-05 | 华为技术有限公司 | Call chain information query method and equipment |
| CN110113200A (en) * | 2019-04-29 | 2019-08-09 | 平安科技（深圳）有限公司 | The correlating method of chain-circuit system and log system, device and storage medium |
| CN110321273A (en) * | 2019-07-09 | 2019-10-11 | 政采云有限公司 | A kind of business statistical method and device |
| WO2021056739A1 (en) * | 2019-09-25 | 2021-04-01 | 平安科技（深圳）有限公司 | Performance analysis method, device, computer apparatus and storage medium |
| CN112596974A (en) * | 2020-12-10 | 2021-04-02 | 长沙市到家悠享网络科技有限公司 | Full link monitoring method, device, equipment and storage medium |
| CN112699000A (en) * | 2019-10-23 | 2021-04-23 | 拉扎斯网络科技（上海）有限公司 | Data processing method and device, readable storage medium and electronic equipment |
| CN114928530A (en) * | 2022-04-24 | 2022-08-19 | 中国工商银行股份有限公司 | Link information acquisition method and related device |
| CN115766532A (en) * | 2022-10-21 | 2023-03-07 | 上海芯赛云计算科技有限公司 | Link monitoring method and device, storage medium and electronic device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106375458A (en) * | 2016-09-08 | 2017-02-01 | 上海银天下科技有限公司 | Service call system, method and device |
| CN106790718A (en) * | 2017-03-16 | 2017-05-31 | 北京搜狐新媒体信息技术有限公司 | Service call link analysis method and system |
| CN107135276A (en) * | 2017-06-28 | 2017-09-05 | 北京中电普华信息技术有限公司 | A kind of full link monitoring methods, devices and systems under micro services framework |
| CN107306196A (en) * | 2016-04-20 | 2017-10-31 | 中兴通讯股份有限公司 | Virtualization services monitoring method and device |
-
2018
- 2018-04-02 CN CN201810282823.6A patent/CN108632111A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107306196A (en) * | 2016-04-20 | 2017-10-31 | 中兴通讯股份有限公司 | Virtualization services monitoring method and device |
| CN106375458A (en) * | 2016-09-08 | 2017-02-01 | 上海银天下科技有限公司 | Service call system, method and device |
| CN106790718A (en) * | 2017-03-16 | 2017-05-31 | 北京搜狐新媒体信息技术有限公司 | Service call link analysis method and system |
| CN107135276A (en) * | 2017-06-28 | 2017-09-05 | 北京中电普华信息技术有限公司 | A kind of full link monitoring methods, devices and systems under micro services framework |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109639809A (en) * | 2018-12-20 | 2019-04-16 | 上海拍拍贷金融信息服务有限公司 | A kind of method and device of service data request link monitoring |
| CN109873717A (en) * | 2019-01-18 | 2019-06-11 | 深圳壹账通智能科技有限公司 | Monitoring method, device, computer equipment and storage medium |
| CN109981349B (en) * | 2019-02-27 | 2022-02-25 | 华为云计算技术有限公司 | Call chain information query method and device |
| CN109981349A (en) * | 2019-02-27 | 2019-07-05 | 华为技术有限公司 | Call chain information query method and equipment |
| US11809300B2 (en) | 2019-02-27 | 2023-11-07 | Huawei Cloud Computing Technologies Co., Ltd. | Trace chain information query method and device |
| WO2020173080A1 (en) * | 2019-02-27 | 2020-09-03 | 华为技术有限公司 | Method and apparatus for querying call chain information |
| CN110113200A (en) * | 2019-04-29 | 2019-08-09 | 平安科技（深圳）有限公司 | The correlating method of chain-circuit system and log system, device and storage medium |
| CN110321273B (en) * | 2019-07-09 | 2023-10-03 | 政采云有限公司 | Service statistics method and device |
| CN110321273A (en) * | 2019-07-09 | 2019-10-11 | 政采云有限公司 | A kind of business statistical method and device |
| WO2021056739A1 (en) * | 2019-09-25 | 2021-04-01 | 平安科技（深圳）有限公司 | Performance analysis method, device, computer apparatus and storage medium |
| CN112699000A (en) * | 2019-10-23 | 2021-04-23 | 拉扎斯网络科技（上海）有限公司 | Data processing method and device, readable storage medium and electronic equipment |
| CN112596974A (en) * | 2020-12-10 | 2021-04-02 | 长沙市到家悠享网络科技有限公司 | Full link monitoring method, device, equipment and storage medium |
| CN114928530A (en) * | 2022-04-24 | 2022-08-19 | 中国工商银行股份有限公司 | Link information acquisition method and related device |
| CN114928530B (en) * | 2022-04-24 | 2024-04-09 | 中国工商银行股份有限公司 | Link information acquisition method and related device |
| CN115766532A (en) * | 2022-10-21 | 2023-03-07 | 上海芯赛云计算科技有限公司 | Link monitoring method and device, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108632111A (en) | Service link monitoring method based on log | |
| CN108521339B (en) | Feedback type node fault processing method and system based on cluster log | |
| CN106354765B (en) | Log analysis system and method based on distributed acquisition | |
| CN107943668A (en) | Computer server cluster daily record monitoring method and monitor supervision platform | |
| Baruffa et al. | Comparison of MongoDB and Cassandra databases for spectrum monitoring as-a-service | |
| CN106941493B (en) | Network security situation perception result output method and device | |
| CN103152352A (en) | Perfect information security and forensics monitoring method and system based on cloud computing environment | |
| CN112511218B (en) | Satellite ground station monitoring system based on microservice | |
| CN110719194B (en) | Network data analysis method and device | |
| CN104394211A (en) | Hadoop-based user behavior analysis system design and implementation method | |
| CN107800565A (en) | Method for inspecting, device, system, computer equipment and storage medium | |
| CN105045905B (en) | A kind of log maintenance method and system based on full-text search | |
| CN104144142A (en) | Web vulnerability discovery method and system | |
| US20220078101A1 (en) | Protocol and state analysis in a dynamic routing network | |
| CN109639809A (en) | A kind of method and device of service data request link monitoring | |
| CN108462598A (en) | A kind of daily record generation method, log analysis method and device | |
| CN113596078B (en) | Service problem positioning method and device | |
| CN108073693A (en) | A kind of distributed network crawler system based on Hadoop | |
| CN105337764B (en) | A kind of equipment resource information acquisition method | |
| CN107204868B (en) | Task operation monitoring information acquisition method and device | |
| CN109474529B (en) | Method for feeding back terminal network associated data | |
| CN116860555A (en) | Software operation monitoring method, device, equipment and computer storage medium | |
| CN108959041B (en) | Method for transmitting information, server and computer readable storage medium | |
| CN106161339A (en) | Obtain the method and device of IP access relation | |
| CN112422349B (en) | Network management system, method, equipment and medium for NFV |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181009 |
|
| RJ01 | Rejection of invention patent application after publication |