CN102208991A - Blog processing method, device and system - Google Patents
Blog processing method, device and system Download PDFInfo
- Publication number
- CN102208991A CN102208991A CN2010101380207A CN201010138020A CN102208991A CN 102208991 A CN102208991 A CN 102208991A CN 2010101380207 A CN2010101380207 A CN 2010101380207A CN 201010138020 A CN201010138020 A CN 201010138020A CN 102208991 A CN102208991 A CN 102208991A
- Authority
- CN
- China
- Prior art keywords
- log processing
- structural data
- profile information
- journal file
- business item
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention discloses a blog processing method comprising the steps of: obtaining blog files sent by a network side, collating the blog files according to preset allocated file information, processing the collated file information into structured data corresponding to a service project, and storing the structured data in a structural storage system. Correspondingly, the embodiment of the invention also discloses a blog processing device and system. Through the embodiment of the invention, the problem of high development cost in the prior art is solved, the development period is shortened, the ability of processing a large quantity of blogs is enhanced, various kinds of statistical requirements can be rapidly and flexibly met by modifying the allocated file information in real time, statistical results can be obtained in real time, the system is expanded flexibly by additionally providing the blog processing device and the structural storage system, the real-time automatic discovery and the automatic early warming of service hot spots are supported, and real-time automatic warming for the health state of a system service module can be carried out.
Description
Technical field
The present invention relates to the communications field, relate in particular to a kind of log processing method, equipment and system.
Background technology
In existing traditional Internet service, daily record is a requisite part, by the analyzing and processing to business diary, we can recognize professional management state, when health problem appears in server, also can make things convenient for the solution of problem simultaneously by daily record orientation problem place.Current, journal file all is to deposit in file system or Database Systems with original form, when the service operation data are analyzed and added up, need carry out Treatment Analysis to the daily record data file of unprocessed form, the statistics that obtains wanting.
The flow process of analysis of Internet service operation data and statistics and web server, the monitoring of service server operation conditions is as shown in Figure 1 in the prior art:
Step S101: submit the statistical analysis of product operation data, monitoring demand or product business module performance, health status monitoring demand to;
Step S102: analyze according to demand, design is at the embodiment of particular demands;
Step S103: carry out system design and system coding, so that the original log file is carried out specific analysis and processing;
Step S104: be delivered for use.
In the demand to each service operation data statistics, all need through flow process shown in Figure 1, the Demand Design coding at specific obtains the statistics of wanting, thereby causes the development cost height from original log, and the construction cycle is very long.
Summary of the invention
The embodiment of the invention is to provide a kind of log processing method, a kind of log processing equipment and a kind of log processing system, by the profile information that is provided with journal file is put in order, generate the structural data of business item correspondence, solve the high problem of development cost in the prior art, shortened the construction cycle.
In order to reach above-mentioned technique effect, the embodiment of the invention has proposed a kind of log processing method, comprising:
Obtain the journal file that network side sends;
Put described journal file in order according to the profile information that sets in advance;
The fileinfo of putting in order out is treated to the structural data corresponding with business item, and described structural data is stored in the structured storage system.
Preferably, described log processing method also comprises:
Statistical demand real time modifying profile information according to business item.
Preferably, the profile information that sets in advance of the described basis step of putting described journal file in order comprises:
Described journal file is put out in order the fileinfo of business item statistical demand according to described profile information.
Preferably, described the file process of putting in order the out step for the structural data corresponding with business item is comprised:
Periodically call the fileinfo that the real-time processing scripts analysis and arrangement of business item correspondence goes out, generate the structural data corresponding with business item.
Preferably, after the step of the structural data that described generation is corresponding with business item, also comprise:
According to described structural data the health status of business is monitored, and the processing of reporting to the police; Or/and
According to described structural data traffic hotspots is found and automatic early-warning automatically.
Correspondingly, the embodiment of the invention discloses a kind of log processing equipment, comprising:
Acquisition module is used to obtain the journal file that network side sends;
Sorting module is used for putting the journal file that described acquisition module obtains in order according to the profile information that sets in advance;
The structuring processing module is used for the fileinfo that described sorting module is put in order out is treated to the structural data corresponding with business item, and described structural data is stored in the structured storage system.
Preferably, described log processing equipment also comprises:
Profile information is provided with module, is used for the statistical demand real time modifying profile information according to business item.
Preferably, described sorting module is provided with the journal file that the profile information of module setting obtains described acquisition module and puts out the fileinfo of business item statistical demand in order according to described profile information.
Preferably, described structuring processing module comprises:
Analyze generation unit, the real-time processing scripts that is used for periodically calling the business item correspondence is analyzed the fileinfo that described sorting module is put in order out, generates the structural data corresponding with business item;
Transmitting element is used for that the described structural data that described analysis generation unit generates is sent to the structured storage system and stores.
Correspondingly, the embodiment of the invention discloses a kind of log processing system, comprise network side server and daily record distributor, described log processing system also comprises at least one log processing equipment, and described log processing equipment is above-mentioned log processing equipment;
Described network side server sends to described daily record distributor with the journal file that generates, described daily record distributor is transmitted described journal file to described log processing equipment according to the load balancing strategy, by described log processing equipment described journal file is handled.
Preferably, described log processing system also comprises at least one structured storage system, is used for structured data.
Preferably, described log processing system also comprises:
Monitoring alarm equipment is used for according to described structural data the health status of business being monitored, and the processing of reporting to the police; Or/and
Find source of early warning, be used for traffic hotspots being found and automatic early-warning automatically according to described structural data.
Implement the embodiment of the invention, by the profile information that is provided with journal file is put in order, generate the structural data of business item correspondence, solved the high problem of development cost in the prior art, shortened the construction cycle, improved disposal ability to massive logs, by revising profile information in real time, agility satisfies various statistical demand neatly fast, obtain statistics in real time, and can carry out the dilatation of system by adding log processing equipment and structured storage system neatly, and the automatic in real time discovery and the automatic early-warning of supporting business focus, can accomplish to report to the police automatically in real time to the health status of system business module.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the schematic flow sheet of log processing method in the prior art;
Fig. 2 is the schematic flow sheet of embodiment of the invention log processing method;
Fig. 3 is the structural representation of the log processing system of the embodiment of the invention;
Fig. 4 is the structural representation of the log processing equipment of the embodiment of the invention;
Fig. 5 is the structural representation of another embodiment of log processing system of the present invention.
Embodiment
In order to make technical problem to be solved by this invention, technical scheme and beneficial effect clearer,, the present invention is further elaborated below in conjunction with drawings and Examples.
See also the schematic flow sheet of the embodiment of the invention log processing method shown in Fig. 2, comprising:
Step S201: obtain the journal file that network side sends;
Particularly, journal file is to be generated according to specific form by network side server, as, " key=value " form of cutting apart with " || " etc., this network side server can be web server or service server etc., corresponding log system has: log4j, log4cxx, log4cplus or the like, network side server can pass through User Datagram Protocol (UDP, User Datagram Protocol) mode sends to the daily record distributor with the journal file that generates, the daily record distributor is transmitted log processing equipment to local terminal with the journal file received in the UDP mode according to the load balancing strategy, and log processing equipment gets access to the journal file that network side sends.Need to prove that this log processing equipment is the platform of handling magnanimity Internet service log information, have general, but real-time collecting and handle the massive logs informational function.
Step S202: put described journal file in order according to the profile information that sets in advance;
Particularly, log processing equipment sets in advance profile information according to the statistical demand of business item, this profile information comprises the business item information of needs statistics, the platform of promptly handling magnanimity Internet service log information is provided with this profile information in advance, configuration file as the txt form, the technical staff only needs to fill in corresponding profile information according to form can finish setting, need add up a certain index (as number) of certain business as the technical staff, the technical staff only need open the profile information that the configuration file of txt form fills in number item correspondence according to form and gets final product so, log processing equipment will be put described journal file in order according to the profile information of the number item correspondence that sets, particularly, the journal file that for example obtains is cut apart " key=value " form and is produced with " || ", log processing equipment is that the relevant information of number is put in order with the key in the journal file so, as, putting in order out with the number is one group of file of filename.
Step S203: the fileinfo of putting in order out is treated to the structural data corresponding with business item, and described structural data is stored in the structured storage system.
Particularly, log processing equipment is handled the fileinfo of putting in order out among the step S202, the project of needs statistics is treated to structural data, and be stored in the structured storage system, the structured storage system can be relevant database, the perhaps structured storage system of BigTable type is as hadoop/hbase etc.Subsequently, relevant business datum analytical equipment can directly be carried out the further analysis of data apace according to the structural data that is stored in the structured storage system, as carry out the related services such as generation, business datum contrast, business datum inquiry of business datum form, perhaps directly provide online service to use.
Need to prove, the technical staff can revise profile information in real time according to the statistical demand of business item, promptly, log processing equipment according to the technical staff in real time retouching operation can delete, change profile information in real time or add statistical item or log processing function, the profile information of real time modifying can come into force, need not to restart log processing equipment in real time, greatly reduce the required cost of exploitation of finishing said function in the prior art, simplified flow process, save the time, thereby improved log processing efficient.
Need to prove that also log processing equipment can be expanded by starting a plurality of examples, promptly can expand daily record distributor proof load equilibrium by adding log processing equipment and structured storage system neatly.
Further, step S203 can be specially, log processing equipment periodic ground (as per 5 minutes) calls the fileinfo that the real-time processing scripts analytical procedure S202 of business item correspondence puts in order out, generate the structural data corresponding with business item, as, the real-time processing scripts of log processing equipment periodic ground number of calls statistical item correspondence, analysis is one group of file of filename with the number, generate the structural data corresponding, then described structural data is stored in the structured storage system with the number statistical project.
Again further, behind the step S203, monitoring alarm equipment can be monitored the health status of business according to the structural data in certain one-period, and the processing of reporting to the police, or the discovery source of early warning can be found and automatic early-warning traffic hotspots automatically according to described structural data, as popular list, focus, user visitor, the statistics of data such as user trajectory, and by mail or SMS notification technical staff or other associated users, current can being applied to searched, picture searching, music searching, video search, Blog Search, the QQ bookmark, go in search Waltz or the like.
Describe the schematic flow sheet of log processing method of the present invention above in detail, below accordingly, describe the structure of the log processing system of the embodiment of the invention in detail.
The structural representation of the log processing system of the embodiment of the invention as shown in Figure 3, log processing system comprises network side server 31, daily record distributor 32, at least one log processing equipment 33 and at least one structured storage system 34, particularly, log processing system also can comprise a plurality of network side servers 31 and daily record distributor 32, present embodiment is to comprise a network side server 31, a daily record distributor 32, a log processing equipment 33 and a structured storage system 34 describe for example, network side server 31 sends to daily record distributor 32 with the journal file that generates, daily record distributor 32 is transmitted described journal file to log processing equipment 33 according to the load balancing strategy, handle by 33 pairs of described journal files of log processing equipment, log processing equipment 33 is the platform of handling magnanimity Internet service log information, have general, but real-time collecting and processing massive logs informational function, the daily record data after log processing equipment 33 will be handled stores in the structured storage system 34.
Particularly, journal file is to be generated according to specific form by network side server 31, as, " key=value " form of cutting apart with " || " etc., network side server 31 can be web server or service server etc., corresponding log system has: log4j, log4cxx, log4cplus or the like, network side server 31 can send to daily record distributor 32 with the journal file that generates by the UDP mode, daily record distributor 32 is transmitted the journal file of receiving to log processing equipment 33 in the UDP mode according to the load balancing strategy, and the acquisition module 331 of log processing equipment 33 gets access to journal file.
Sorting module 332 is used for putting the journal file that acquisition module 331 obtains in order according to the profile information that sets in advance;
Particularly, log processing equipment 33 sets in advance profile information according to the statistical demand of business item, this profile information comprises the business item information of needs statistics, the platform of promptly handling magnanimity Internet service log information is provided with this profile information in advance, configuration file as the txt form, the technical staff only needs to fill in corresponding profile information according to form can finish setting, need add up a certain index (as number) of certain business as the technical staff, the technical staff only need open the profile information that the configuration file of txt form fills in number item correspondence according to form and gets final product so, sorting module 332 will be put described journal file in order according to the profile information of the number item correspondence that sets, particularly, for example the journal file that obtains of acquisition module 331 is cut apart " key=value " form and is produced with " || ", sorting module 332 is that the relevant information of number is put in order with the key in the journal file so, as, putting in order out with the number is one group of file of filename.
Particularly, structured storage system 34 can be relevant database, and the perhaps structured storage system of BigTable type is as hadoop/hbase etc.Subsequently, relevant business datum analytical equipment can directly be carried out the further analysis of data apace according to the structural data that is stored in the structured storage system 34, as carry out the related services such as generation, business datum contrast, business datum inquiry of business datum form, perhaps directly provide online service to use.
Below in conjunction with Fig. 4, further specify the structure of log processing equipment 33 in the embodiment of the invention, log processing equipment 33 comprises acquisition module 331, outside sorting module 332 and the structuring processing module 333, comprise that also profile information is provided with module 334, be used for statistical demand real time modifying profile information according to business item, particularly, the technical staff can be provided with module 334 by profile information according to the statistical demand of business item and revise profile information in real time, promptly, profile information is provided with module 334 and can deletes profile information in real time, change or interpolation statistical item or log processing function, the profile information of real time modifying can come into force in real time, need not to restart log processing equipment, greatly reduce the required cost of exploitation of finishing said function in the prior art, simplified flow process, save the time, thereby improved log processing efficient; Sorting module 332 is provided with the journal file that profile information that module 334 is provided with obtains acquisition module 331 according to profile information and puts out the fileinfo of business item statistical demand in order.
Further, structuring processing module 333 comprises: analyze generation unit 3331 and transmitting element 3332, wherein
Analyze the fileinfo that real-time processing scripts analysis and arrangement module 332 that generation unit 3331 is used for periodically calling the business item correspondence is put in order out, generate the structural data corresponding with business item;
Transmitting element 3332 is used for analyzing described structural data that generation unit 3331 generates and sends to structured storage system 34 and store.
Particularly, analyze generation unit 3331 periodically (as per 5 minutes) call the fileinfo that the real-time processing scripts analysis and arrangement module 332 of business item correspondence is put in order out, generate the structural data corresponding with business item, as, analyze the periodically real-time processing scripts of number of calls statistical item correspondence of generation unit 3331, analysis is one group of file of filename with the number, generate the structural data corresponding, by transmitting element 3332 described structural data is stored in the structured storage system 34 then with the number statistical project.
The structural representation of another embodiment of log processing system of the present invention as shown in Figure 5, log processing system comprises outside network side server 31, daily record distributor 32, log processing equipment 33 and the structured storage system 34, also comprise monitoring alarm equipment 35 and find source of early warning 36, wherein
Find that source of early warning 36 is used for according to described structural data traffic hotspots being found and automatic early-warning automatically.
Particularly, monitoring alarm equipment 35 can be monitored the health status of business according to the structural data in certain one-period, and the processing of reporting to the police, and discovery source of early warning 36 can be found and automatic early-warning traffic hotspots automatically according to described structural data, as popular list, focus, user visitor, the statistics of data such as user trajectory, and by mail or SMS notification technical staff or other associated users, current can being applied to searched, picture searching, music searching, video search, Blog Search, the QQ bookmark, go in search Waltz or the like.
Need to prove that log processing equipment 33 can be expanded by starting a plurality of examples, log processing system promptly can be expanded the 32 proof load equilibriums of daily record distributor by adding log processing equipment 33 and structured storage system 34 neatly.
In sum, pass through the foregoing description, according to the profile information that is provided with journal file is put in order, generate the structural data of business item correspondence, solved the high problem of development cost in the prior art, shortened the construction cycle, improved disposal ability to massive logs, by revising profile information in real time, agility satisfies various statistical demand neatly fast, obtain statistics in real time, and can carry out the dilatation of system by adding log processing equipment and structured storage system neatly, and the automatic in real time discovery and the automatic early-warning of supporting business focus, can accomplish to report to the police automatically in real time to the health status of system business module.
Need to prove that through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential hardware platform, can certainly all implement by hardware.Based on such understanding, all or part of can the embodying that technical scheme of the present invention contributes to background technology with the form of software product, this computer software product can be stored in the storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be a personal computer, server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the present invention or embodiment.
Above disclosed only is preferred embodiment in the embodiment of the invention, can not limit the present invention's interest field certainly with this, and therefore the equivalent variations of doing according to claim of the present invention still belongs to the scope that the present invention is contained.
Claims (10)
1. a log processing method is characterized in that, comprising:
Obtain the journal file that network side sends;
Put described journal file in order according to the profile information that sets in advance;
The fileinfo of putting in order out is treated to the structural data corresponding with business item, and described structural data is stored in the structured storage system.
2. the method for claim 1 is characterized in that, also comprises:
Statistical demand real time modifying profile information according to business item;
The step that the profile information that described basis sets in advance is put described journal file in order comprises:
Described journal file is put out in order the fileinfo of business item statistical demand according to described profile information.
3. method as claimed in claim 1 or 2 is characterized in that, described the file process of putting in order the out step for the structural data corresponding with business item is comprised:
Periodically call the fileinfo that the real-time processing scripts analysis and arrangement of business item correspondence goes out, generate the structural data corresponding with business item.
4. method as claimed in claim 3 is characterized in that, after the step of the structural data that described generation is corresponding with business item, also comprises:
According to described structural data the health status of business is monitored, and the processing of reporting to the police; Or/and
According to described structural data traffic hotspots is found and automatic early-warning automatically.
5. a log processing equipment is characterized in that, comprising:
Acquisition module is used to obtain the journal file that network side sends;
Sorting module is used for putting the journal file that described acquisition module obtains in order according to the profile information that sets in advance;
The structuring processing module is used for the fileinfo that described sorting module is put in order out is treated to the structural data corresponding with business item, and described structural data is stored in the structured storage system.
6. log processing equipment as claimed in claim 5 is characterized in that, also comprises:
Profile information is provided with module, is used for the statistical demand real time modifying profile information according to business item;
Described sorting module is provided with the journal file that the profile information of module setting obtains described acquisition module and puts out the fileinfo of business item statistical demand in order according to described profile information.
7. log processing equipment as claimed in claim 6 is characterized in that, described structuring processing module comprises:
Analyze generation unit, the real-time processing scripts that is used for periodically calling the business item correspondence is analyzed the fileinfo that described sorting module is put in order out, generates the structural data corresponding with business item;
Transmitting element is used for that the described structural data that described analysis generation unit generates is sent to the structured storage system and stores.
8. a log processing system comprises network side server and daily record distributor, it is characterized in that, described log processing system also comprises at least one log processing equipment, and described log processing equipment is as each described log processing equipment of claim 5-7;
Described network side server sends to described daily record distributor with the journal file that generates, described daily record distributor is transmitted described journal file to described log processing equipment according to the load balancing strategy, by described log processing equipment described journal file is handled.
9. log processing system as claimed in claim 8 is characterized in that, described log processing system also comprises at least one structured storage system, is used for structured data.
10. log processing system as claimed in claim 9 is characterized in that, described log processing system also comprises:
Monitoring alarm equipment is used for according to described structural data the health status of business being monitored, and the processing of reporting to the police; Or/and
Find source of early warning, be used for traffic hotspots being found and automatic early-warning automatically according to described structural data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101380207A CN102208991A (en) | 2010-03-29 | 2010-03-29 | Blog processing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101380207A CN102208991A (en) | 2010-03-29 | 2010-03-29 | Blog processing method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102208991A true CN102208991A (en) | 2011-10-05 |
Family
ID=44697663
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101380207A Pending CN102208991A (en) | 2010-03-29 | 2010-03-29 | Blog processing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102208991A (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103324565A (en) * | 2012-05-30 | 2013-09-25 | 北京神州泰岳软件股份有限公司 | Log monitoring method |
| CN103577417A (en) * | 2012-07-23 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Desktop cleaning method and device |
| CN104113866A (en) * | 2013-04-19 | 2014-10-22 | 中国移动通信集团浙江有限公司 | Wireless controller log processing method and apparatus |
| WO2015027954A1 (en) * | 2013-09-02 | 2015-03-05 | Tencent Technology (Shenzhen) Company Limited | Management of operational data from multiple data sources |
| CN104731796A (en) * | 2013-12-19 | 2015-06-24 | 北京思博途信息技术有限公司 | Data storage computing method and system |
| CN105243022A (en) * | 2015-11-10 | 2016-01-13 | 中国建设银行股份有限公司 | Method and device for analyzing performance data of host application software system |
| CN105337748A (en) * | 2014-06-20 | 2016-02-17 | 北京奇虎科技有限公司 | Log file collection method and system, server, and service cluster controlling apparatus |
| CN105512336A (en) * | 2015-12-29 | 2016-04-20 | 中国建设银行股份有限公司 | Method and device for mass data processing based on Hadoop |
| CN105550250A (en) * | 2015-12-09 | 2016-05-04 | 百度在线网络技术（北京）有限公司 | Access log processing method and apparatus |
| CN106055608A (en) * | 2016-05-25 | 2016-10-26 | 北京百度网讯科技有限公司 | Method and apparatus for automatically collecting and analyzing switch logs |
| CN106227644A (en) * | 2016-07-21 | 2016-12-14 | 柳州龙辉科技有限公司 | A kind of magnanimity information processing device |
| CN106227797A (en) * | 2016-07-21 | 2016-12-14 | 柳州龙辉科技有限公司 | A kind of processing method of massive logs information |
| CN106250287A (en) * | 2016-07-21 | 2016-12-21 | 柳州龙辉科技有限公司 | A kind of log information processing means |
| CN106250406A (en) * | 2016-07-21 | 2016-12-21 | 柳州龙辉科技有限公司 | A kind of log processing method |
| CN106250405A (en) * | 2016-07-21 | 2016-12-21 | 柳州龙辉科技有限公司 | A kind of magnanimity information processing system |
| CN106296246A (en) * | 2015-05-26 | 2017-01-04 | 腾讯科技（深圳）有限公司 | Method for processing business and device |
| CN106302577A (en) * | 2015-05-19 | 2017-01-04 | 广州四三九九信息科技有限公司 | Log processing method |
| CN107832352A (en) * | 2017-10-23 | 2018-03-23 | 中国银行股份有限公司 | Daily record automatic processing method, device, storage medium and equipment |
| CN110730086A (en) * | 2018-07-16 | 2020-01-24 | 视联动力信息技术股份有限公司 | Log information output method and device |
| CN111198752A (en) * | 2019-12-26 | 2020-05-26 | 天津中科曙光存储科技有限公司 | Method and device for improving transaction processing capability of log system |
| CN111209153A (en) * | 2019-12-31 | 2020-05-29 | 联想(北京)有限公司 | Abnormity detection processing method and device and electronic equipment |
| CN112434949A (en) * | 2020-11-25 | 2021-03-02 | 平安普惠企业管理有限公司 | Service early warning processing method, device, equipment and medium based on artificial intelligence |
| CN112799903A (en) * | 2019-11-14 | 2021-05-14 | 北京沃东天骏信息技术有限公司 | Method and device for evaluating health state of business system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339531A (en) * | 2008-08-12 | 2009-01-07 | 杭州华三通信技术有限公司 | Method and device for processing log file |
| US20090240740A1 (en) * | 2008-03-24 | 2009-09-24 | Fuji Xerox Co., Ltd. | Image log management device, image log management method, image log management program |
-
2010
- 2010-03-29 CN CN2010101380207A patent/CN102208991A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090240740A1 (en) * | 2008-03-24 | 2009-09-24 | Fuji Xerox Co., Ltd. | Image log management device, image log management method, image log management program |
| CN101339531A (en) * | 2008-08-12 | 2009-01-07 | 杭州华三通信技术有限公司 | Method and device for processing log file |
Non-Patent Citations (2)
| Title |
|---|
| 刘必雄等: "《基于集群的多源日志综合审计系统》", 《计算机应用》, vol. 28, no. 2, 29 February 2008 (2008-02-29), pages 541 - 544 * |
| 宁兴旺等: "《支持审计与取证联动的日志系统设计》", 《计算机工程与设计》, vol. 30, no. 24, 31 December 2009 (2009-12-31), pages 5580 - 5583 * |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103324565B (en) * | 2012-05-30 | 2016-12-14 | 北京神州泰岳软件股份有限公司 | Daily record monitoring method |
| CN103324565A (en) * | 2012-05-30 | 2013-09-25 | 北京神州泰岳软件股份有限公司 | Log monitoring method |
| CN103577417A (en) * | 2012-07-23 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Desktop cleaning method and device |
| CN103577417B (en) * | 2012-07-23 | 2019-02-22 | 腾讯科技（深圳）有限公司 | The method and apparatus for clearing up desktop |
| CN104113866B (en) * | 2013-04-19 | 2017-11-21 | 中国移动通信集团浙江有限公司 | The processing method and processing device of wireless controller daily record |
| CN104113866A (en) * | 2013-04-19 | 2014-10-22 | 中国移动通信集团浙江有限公司 | Wireless controller log processing method and apparatus |
| WO2015027954A1 (en) * | 2013-09-02 | 2015-03-05 | Tencent Technology (Shenzhen) Company Limited | Management of operational data from multiple data sources |
| CN104731796A (en) * | 2013-12-19 | 2015-06-24 | 北京思博途信息技术有限公司 | Data storage computing method and system |
| CN104731796B (en) * | 2013-12-19 | 2017-12-19 | 秒针信息技术有限公司 | Data storage computational methods and system |
| CN105337748A (en) * | 2014-06-20 | 2016-02-17 | 北京奇虎科技有限公司 | Log file collection method and system, server, and service cluster controlling apparatus |
| CN106302577A (en) * | 2015-05-19 | 2017-01-04 | 广州四三九九信息科技有限公司 | Log processing method |
| CN106302577B (en) * | 2015-05-19 | 2019-07-09 | 广州四三九九信息科技有限公司 | Log processing method |
| CN106296246A (en) * | 2015-05-26 | 2017-01-04 | 腾讯科技（深圳）有限公司 | Method for processing business and device |
| CN105243022A (en) * | 2015-11-10 | 2016-01-13 | 中国建设银行股份有限公司 | Method and device for analyzing performance data of host application software system |
| CN105243022B (en) * | 2015-11-10 | 2018-05-18 | 中国建设银行股份有限公司 | The performance data analysis method and device of host application software system |
| CN105550250A (en) * | 2015-12-09 | 2016-05-04 | 百度在线网络技术（北京）有限公司 | Access log processing method and apparatus |
| CN105550250B (en) * | 2015-12-09 | 2019-06-28 | 百度在线网络技术（北京）有限公司 | A kind of processing method and processing device of access log |
| CN105512336A (en) * | 2015-12-29 | 2016-04-20 | 中国建设银行股份有限公司 | Method and device for mass data processing based on Hadoop |
| CN106055608A (en) * | 2016-05-25 | 2016-10-26 | 北京百度网讯科技有限公司 | Method and apparatus for automatically collecting and analyzing switch logs |
| CN106055608B (en) * | 2016-05-25 | 2019-06-07 | 北京百度网讯科技有限公司 | The method and apparatus of automatic collection and analysis interchanger log |
| CN106250406A (en) * | 2016-07-21 | 2016-12-21 | 柳州龙辉科技有限公司 | A kind of log processing method |
| CN106250287A (en) * | 2016-07-21 | 2016-12-21 | 柳州龙辉科技有限公司 | A kind of log information processing means |
| CN106227797A (en) * | 2016-07-21 | 2016-12-14 | 柳州龙辉科技有限公司 | A kind of processing method of massive logs information |
| CN106227644A (en) * | 2016-07-21 | 2016-12-14 | 柳州龙辉科技有限公司 | A kind of magnanimity information processing device |
| CN106250405A (en) * | 2016-07-21 | 2016-12-21 | 柳州龙辉科技有限公司 | A kind of magnanimity information processing system |
| CN107832352B (en) * | 2017-10-23 | 2022-01-04 | 中国银行股份有限公司 | Log automatic processing method, device, storage medium and equipment |
| CN107832352A (en) * | 2017-10-23 | 2018-03-23 | 中国银行股份有限公司 | Daily record automatic processing method, device, storage medium and equipment |
| CN110730086A (en) * | 2018-07-16 | 2020-01-24 | 视联动力信息技术股份有限公司 | Log information output method and device |
| CN110730086B (en) * | 2018-07-16 | 2022-11-25 | 视联动力信息技术股份有限公司 | Method and device for outputting log information |
| CN112799903B (en) * | 2019-11-14 | 2024-07-16 | 北京沃东天骏信息技术有限公司 | Method and device for evaluating health state of service system |
| CN112799903A (en) * | 2019-11-14 | 2021-05-14 | 北京沃东天骏信息技术有限公司 | Method and device for evaluating health state of business system |
| CN111198752A (en) * | 2019-12-26 | 2020-05-26 | 天津中科曙光存储科技有限公司 | Method and device for improving transaction processing capability of log system |
| CN111198752B (en) * | 2019-12-26 | 2023-10-13 | 天津中科曙光存储科技有限公司 | Method and device for improving transaction processing capacity of log system |
| CN111209153B (en) * | 2019-12-31 | 2021-10-22 | 联想(北京)有限公司 | Abnormity detection processing method and device and electronic equipment |
| CN111209153A (en) * | 2019-12-31 | 2020-05-29 | 联想(北京)有限公司 | Abnormity detection processing method and device and electronic equipment |
| CN112434949A (en) * | 2020-11-25 | 2021-03-02 | 平安普惠企业管理有限公司 | Service early warning processing method, device, equipment and medium based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102208991A (en) | Blog processing method, device and system | |
| CN103838867A (en) | Log processing method and device | |
| CN107040863B (en) | Real-time service recommendation method and system | |
| CN102375837B (en) | Data acquiring system and method | |
| CN103761309A (en) | Operation data processing method and system | |
| CN111258978B (en) | Data storage method | |
| CN106933724B (en) | Distributed information tracking system, information processing method and device | |
| CN103209087A (en) | Distributed log statistical processing method and system | |
| EP2802979A2 (en) | Processing store visiting data | |
| CN103561078A (en) | Telecom operation system and service implementation method | |
| CN103310087A (en) | Service data statistic analysis method and device | |
| CN105354132A (en) | Mobile application release processing method and release channel tracking method and system | |
| CN105045905A (en) | Log maintenance method and system based on full-text retrieval | |
| CN110727727A (en) | Statistical method and device for database | |
| CN105976226A (en) | Internet E-commerce platform | |
| CN108228432A (en) | A kind of distributed link tracking, analysis method and server, global scheduler | |
| CN102724290B (en) | Method, device and system for getting target customer group | |
| CN107644017A (en) | The querying method and device of journal file | |
| CN101764761B (en) | Method for limiting transmission flow capacity of service provider interfaces and multi-media service gateway | |
| CN102200943A (en) | Method and equipment for automatically detecting CPU utilization rate based on background | |
| US20230252011A1 (en) | Method and system for data indexing and reporting | |
| CN103226572A (en) | Expandable monitoring method and monitoring system based on data compression | |
| CN103220363A (en) | Distributed network training resource management system based on cloud computing and scheduling method | |
| CN112929237B (en) | Analysis method, system, equipment and medium for website subdivision flow | |
| CN112506886B (en) | Multi-source service operation log acquisition method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: SHENZHEN SHIJI LIGHT SPEED INFORMATION TECHNOLOGY Free format text: FORMER OWNER: TENGXUN SCI-TECH (SHENZHEN) CO., LTD. Effective date: 20131114 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20131114 Address after: A Tencent Building in Shenzhen Nanshan District City, Guangdong streets in Guangdong province science and technology 518057 16 Applicant after: Shenzhen Shiji Guangsu Information Technology Co., Ltd. Address before: Shenzhen Futian District City, Guangdong province 518057 Zhenxing Road, SEG Science Park 2 East Room 403 Applicant before: Tencent Technology (Shenzhen) Co., Ltd. |
|
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20111005 |