CN116383299A - Data display system based on distributed database - Google Patents

Data display system based on distributed database Download PDF

Info

Publication number
CN116383299A
CN116383299A CN202310363007.9A CN202310363007A CN116383299A CN 116383299 A CN116383299 A CN 116383299A CN 202310363007 A CN202310363007 A CN 202310363007A CN 116383299 A CN116383299 A CN 116383299A
Authority
CN
China
Prior art keywords
data
index
analysis
preset
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310363007.9A
Other languages
Chinese (zh)
Inventor
董新
姚磊
王晓育
杨文龙
黄有坚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guoren Property Insurance Co ltd
Original Assignee
Guoren Property Insurance Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guoren Property Insurance Co ltd filed Critical Guoren Property Insurance Co ltd
Priority to CN202310363007.9A priority Critical patent/CN116383299A/en
Publication of CN116383299A publication Critical patent/CN116383299A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/26Visual data mining; Browsing structured data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application provides a data presentation system based on a distributed database, the system comprising: the acquisition module is used for acquiring system data corresponding to each service type in the source system; the calculation module is used for calculating the system data according to the first database to generate analysis data; the generation module is used for generating a data set corresponding to each operation index theme by the analysis data and the preset index rule; the synchronization module is used for synchronizing the data set to a second database, wherein the second database generates index data of a plurality of display types according to the management index subject; the display module is used for acquiring target data and target display types corresponding to the target data in the index data according to a preset query language. The display data is real and considerable, the data is updated in real time, and the cockpit surface is concise and refined; each level of manager can select analysis subject indexes according to self-service and conduct multidimensional analysis.

Description

Data display system based on distributed database
Technical Field
The application relates to the field of data processing, in particular to a data display system based on a distributed database.
Background
In recent years, the development of the large data industry continuously loses the application of a large screen in a data display occasion, because various data are required to be displayed through the large screen to realize visual display, the core of the whole scheme is realized around how to display the data on the screen and realize functions such as high-definition display and the like. Basically, the whole data display system mainly uses images pre-stored on a traditional computer or on a real-time data system, and has the functions of uniformly displaying data on a plurality of computers on a large screen. The third part is the core of the large screen data visualization system, i.e., the large screen, which is responsible for the immediate display of all data,
at present, for data display in the insurance field, as rules of index topics related to insurance are complex, part of index rules and red-yellow-blue rules can change along with operation decisions, and as the quality of source end data is not ideal, the later operation and maintenance difficulty is complex; the project adopts a single-point deployment mode, the fault tolerance rate is low, and the concurrent processing capacity is limited by the performance limit of the server.
Disclosure of Invention
In view of the problems, the present application has been developed to provide a distributed database-based data presentation system that overcomes, or at least partially solves, the problems, including:
a distributed database-based data presentation system, the system comprising:
the acquisition module is used for acquiring system data corresponding to each service type in the source system;
the calculation module is used for calculating the system data according to the first database to generate analysis data;
the generation module is used for generating a data set corresponding to each operation index theme by the analysis data and the preset index rule;
the synchronization module is used for synchronizing the data set to a second database, wherein the second database generates index data of a plurality of display types according to the management index subject;
the display module is used for acquiring target data and target display types corresponding to the target data in the index data according to a preset query language.
Further, the business types include one or more of an underwriting class, a claims class, a pay-as-you-pay class, a reconfirm class, and a finance class.
Further, the calculation module generates analysis data by integrating or model calculation through the system data, specifically, the bottom layer detail data scattered by the multi-source system is converted into a preset data set through preset merging logic, and aggregation analysis is performed on the preset data set.
Further, the business index theme generates the index data of a plurality of display types through a data cockpit and/or index attribution analysis.
Further, the presentation types include one or more of a ring chart, dashboard, pie chart, bar chart, and progress bar chart.
Further, when the operation index theme generates the index data according to the data cockpit, the data which is accessed to the data cockpit for the first time is cached to a target storage end.
Further, the cleaning device further comprises a cleaning unit, wherein the cleaning unit is used for cleaning historical data in the data cockpit according to preset time and preset cleaning rules.
Further, when the operation index theme generates the index data according to the index attribution analysis, abnormal data are determined through the preset index rule, and the abnormal image factors of index abnormality are determined through the abnormal data and the data cockpit.
Further, the display module determines an analysis dimension type through the preset query language, and obtains target data and a target display type corresponding to the target data in the index data according to the analysis dimension type.
Further, the analysis dimension types include one or more of institutions, channels, and products.
The application has the following advantages:
in the embodiment of the application, compared with the prior art that the source end data quality is not ideal, the later operation and maintenance difficulty is relatively complex; the fault tolerance rate is low, the concurrency processing capacity is limited by the server performance limit, and the application provides a solution for generating index data by using an operation index theme, which specifically comprises the following steps: the acquisition module is used for acquiring system data corresponding to each service type in the source system; the calculation module is used for calculating the system data according to the first database to generate analysis data; the generation module is used for generating a data set corresponding to each operation index theme by the analysis data and the preset index rule; the synchronization module is used for synchronizing the data set to a second database, wherein the second database generates index data of a plurality of display types according to the management index subject; and the display module is used for acquiring target data and target display types corresponding to the target data in the index data according to a preset query language. The index data of a plurality of display types are generated by the second database according to the management index subject, so that the problem that the quality of source end data is not ideal is solved, and the later operation and maintenance difficulty is relatively complex; the fault tolerance rate is low, the concurrent processing capacity is limited by the performance limit of the server, the system display data is real and considerable, the data is updated in real time, and the cockpit cabin surface is concise and refined; each level of manager can select and analyze the theme index according to self-service, and then multidimensional analysis can be carried out according to different time dimensions of day, month and year, product dimensions, mechanism dimensions and channel dimensions. The system automatically identifies abnormal index data according to preset red, yellow and blue rules of various indexes; the system realizes the visualization, the early warning and the intellectualization of the management and the monitoring and the supervision and the automation of the tracking and supervision of the management and the management data. Enabling each level manager to diagnose, insight, act and track in time.
Drawings
In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the description of the present application will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.
Fig. 1 is a block diagram of a data display system based on a distributed database according to an embodiment of the present application.
In the accompanying drawings: 110. an acquisition module; 120. a computing module; 130. a generating module; 140. a synchronization module; 150. and a display module.
Detailed Description
In order to make the objects, features and advantages of the present application more comprehensible, the present application is described in further detail below with reference to the accompanying drawings and detailed description. It will be apparent that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The inventors found by analyzing the prior art that: at present, for data display in the insurance field, as rules of index topics related to insurance are complex, part of index rules and red-yellow-blue rules can change along with operation decisions, and as the quality of source end data is not ideal, the later operation and maintenance difficulty is complex; the project adopts a single-point deployment mode, the fault tolerance rate is low, and the concurrent processing capacity is limited by the performance limit of the server.
Referring to FIG. 1, a block diagram of a distributed database-based data presentation system is shown, according to one embodiment of the present application;
a distributed database-based data presentation system, the system comprising:
an acquiring module 110, configured to acquire system data corresponding to each service type in a source system;
the calculation module 120 is configured to calculate the system data according to a first database to generate analysis data;
a generating module 130, configured to generate a dataset corresponding to each operation index topic from the analysis data and a preset index rule;
the synchronization module 140 is configured to synchronize the data set to a second database, where the second database generates index data of a plurality of display types according to the business index subject;
the display module 150 is configured to obtain target data and a target display type corresponding to the target data from the index data according to a preset query language.
In the embodiment of the application, compared with the prior art that the source end data quality is not ideal, the later operation and maintenance difficulty is relatively complex; the fault tolerance rate is low, the concurrency processing capacity is limited by the server performance limit, and the application provides a solution for generating index data by using an operation index theme, which specifically comprises the following steps: an "acquisition module 110, configured to acquire system data corresponding to each service type in a source system; the calculation module 120 is configured to calculate the system data according to a first database to generate analysis data; a generating module 130, configured to generate a dataset corresponding to each operation index topic from the analysis data and a preset index rule; the synchronization module 140 is configured to synchronize the data set to a second database, where the second database generates index data of a plurality of display types according to the business index subject; and the display module 150 is configured to obtain target data and a target display type corresponding to the target data from the index data according to a preset query language. The index data of a plurality of display types are generated by the second database according to the management index subject, so that the problem that the quality of source end data is not ideal is solved, and the later operation and maintenance difficulty is relatively complex; the fault tolerance rate is low, the concurrent processing capacity is limited by the performance limit of the server, the system display data is real and considerable, the data is updated in real time, and the cockpit cabin surface is concise and refined; each level of manager can select and analyze the theme index according to self-service, and then multidimensional analysis can be carried out according to different time dimensions of day, month and year, product dimensions, mechanism dimensions and channel dimensions. The system automatically identifies abnormal index data according to preset red, yellow and blue rules of various indexes; the system realizes the visualization, the early warning and the intellectualization of the management and the monitoring and the supervision and the automation of the tracking and supervision of the management and the management data. Enabling each level manager to diagnose, insight, act and track in time.
A data presentation system based on a distributed database in the present exemplary embodiment will be further described below.
In an embodiment of the present invention, the first database is greenplus, where greenplus is one type of distributed database, and the architecture adopts MPP (massively parallel processing), and by using powerful parallel processing capability, resource allocation according to a user group can be implemented by using resource queue management, and by building a cluster, data from TB level to PB level can be grouped, stored and analyzed.
In one embodiment of the present invention, the second database is MySQL, which is a relational database management system, and the relational database stores data in different tables instead of placing all data in one large warehouse, which increases the speed and increases the flexibility.
In one embodiment of the invention, the operation diagnosis is to perform multidimensional analysis on the subject indexes such as business, finance and the like through any combination of three dimensions of a mechanism, a channel and a product, and perform fine diagnosis through obtaining data reference values such as a same ratio, a ring ratio, an average value and the like, so that the power-assisted abnormal indexes are accurately tracked and analyzed.
In one embodiment of the invention, the business types include one or more of an underwriting class, a claims class, a pay-per-view class, a reconfirm class, and a finance class.
In an embodiment of the present invention, the calculation module 120 performs integration or model calculation on the system data to generate analysis data, specifically, converts the bottom layer detail data scattered by the multi-source system into a preset data set through preset merging logic, and performs aggregation analysis on the preset data set; in a specific embodiment, the business analysis result data, i.e. analysis data, is obtained by integrating and model computing the system data of each business source end based on the data center on the distributed database Greemplum.
In one embodiment of the invention, the analysis data realizes the synchronization of a final operation analysis index data set from a data center station to a digital intelligent radar MySQL database through a data X; wherein, dataX is an offline synchronization framework/tool that exchanges data between heterogeneous data sources, enabling data exchange between arbitrary data processing systems.
In an embodiment of the invention, the operation index theme generates the index data of a plurality of display types through a data cockpit and/or index attribution analysis; in a specific embodiment, the management index subject to be displayed is used for generating the index data of a plurality of display types in the form of cockpit or index attribution analysis.
In one embodiment of the present invention, the display types include one or more of a ring chart, a dashboard, a pie chart, a bar chart, and a progress bar chart; in one embodiment, the Mysql database is configured in an automated configuration by various graphics such as a ring graph, dashboard, pie graph, bar graph, progress bar graph, and the like.
In an embodiment of the invention, a user accesses operation index data through a PC end or a mobile end, a system background displays the index data through a preset dynamic sql (Structured Query Language, a structured query statement), and the early warning and distribution conditions of the index data are maintained, so that each dimension of a mechanism/channel/product is supported to drill down and link the query, and the linkage jump of a cockpit and index attribution analysis is supported.
In an embodiment of the present invention, when the operation index theme generates the index data according to the data cockpit, the data that access the data cockpit for the first time is cached to a target storage end.
In an embodiment of the present invention, the cleaning unit is further configured to clean the historical data in the data cockpit according to a preset time and a preset cleaning rule; in a specific embodiment, the cockpit data accessed for the first time is cached to redis, so that a user can conveniently inquire the result data for the second time and quickly return the result data, a timed cleaning mechanism is adopted, the correctness of the data is ensured, and the latest data is summarized.
In an embodiment of the present invention, when the operation index theme generates the index data according to the index attribution analysis, abnormal data is determined according to the preset index rule, and an image factor of index abnormality is determined according to the abnormal data and the data cockpit; in a specific embodiment, the attribution analysis is to automatically identify abnormal index data according to preset index red-yellow-blue rules by the system, and combine the index cockpit of the red-yellow-blue early warning and distribution condition of the main analysis dimension to assist the manager in making analysis decisions and finding out the influence factors of the index abnormality.
In an embodiment of the present invention, the display module determines an analysis dimension type through the preset query language, and obtains target data and a target display type corresponding to the target data in the index data according to the analysis dimension type.
In one embodiment of the invention, the analysis dimension types include one or more of institutions, channels, and products.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
While preferred embodiments of the present embodiments have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the present application.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The foregoing has described in detail a data display system based on a distributed database provided in the present application, and specific examples have been applied herein to illustrate the principles and embodiments of the present application, where the foregoing examples are provided only to assist in understanding the methods of the present application and their core ideas; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.

Claims (10)

1. A distributed database-based data presentation system, the system comprising:
the acquisition module is used for acquiring system data corresponding to each service type in the source system;
the calculation module is used for calculating the system data according to the first database to generate analysis data;
the generation module is used for generating a data set corresponding to each operation index theme by the analysis data and the preset index rule;
the synchronization module is used for synchronizing the data set to a second database, wherein the second database generates index data of a plurality of display types according to the management index subject;
the display module is used for acquiring target data and target display types corresponding to the target data in the index data according to a preset query language.
2. The system of claim 1, wherein the business types include one or more of an underwriting class, a claims class, a pay-as-you-pay class, a reconfirm class, and a financial class.
3. The system according to claim 1, wherein the calculation module generates analysis data by integrating or model calculating the system data, specifically, converts the bottom layer detail data scattered by the multi-source system into a preset data set by preset merging logic, and performs aggregation analysis on the preset data set.
4. The system of claim 1, wherein the business index topic generates the index data for a number of the presentation types by data cockpit and/or index attribution analysis.
5. The system of claim 4, wherein the presentation type comprises one or more of a ring chart, a dashboard, a pie chart, a bar chart, and a progress bar chart.
6. The system of claim 4, wherein when the business metric topic generates the metric data from the data cockpit, the data that was first accessed to the data cockpit is cached to a target storage.
7. The system of claim 6, further comprising a cleaning unit for cleaning historical data within the data cockpit according to a preset time and a preset cleaning rule.
8. The system of claim 1, wherein when the business index topic generates the index data according to the index attribution analysis, determining abnormal data by the preset index rule, and determining an imaging factor of an index abnormality by the abnormal data and the data cockpit.
9. The system of claim 1, wherein the presentation module determines an analysis dimension type by the preset query language, and obtains target data and a target presentation type corresponding to the target data within the index data according to the analysis dimension type.
10. The system of claim 9, wherein the analysis dimension types include one or more of institutions, channels, and products.
CN202310363007.9A 2023-03-31 2023-03-31 Data display system based on distributed database Pending CN116383299A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310363007.9A CN116383299A (en) 2023-03-31 2023-03-31 Data display system based on distributed database

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310363007.9A CN116383299A (en) 2023-03-31 2023-03-31 Data display system based on distributed database

Publications (1)

Publication Number Publication Date
CN116383299A true CN116383299A (en) 2023-07-04

Family

ID=86972796

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310363007.9A Pending CN116383299A (en) 2023-03-31 2023-03-31 Data display system based on distributed database

Country Status (1)

Country Link
CN (1) CN116383299A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110716966A (en) * 2019-10-16 2020-01-21 京东方科技集团股份有限公司 Data visualization processing method and system, electronic device and storage medium
CN110955717A (en) * 2019-11-19 2020-04-03 深圳市航通智能技术有限公司 Visual dynamic display method and system based on big data
US20200250871A1 (en) * 2019-02-01 2020-08-06 Sap Se Enhancement layers for data visualization
CN111522872A (en) * 2020-04-26 2020-08-11 山东健康医疗大数据有限公司 Data visualization method based on index configuration
CN112347092A (en) * 2020-11-05 2021-02-09 中国平安人寿保险股份有限公司 Method and device for generating data analysis billboard and computer equipment
CN113297279A (en) * 2021-05-26 2021-08-24 杭州安恒信息技术股份有限公司 Data analysis and display method, system, equipment and storage medium
WO2022007592A1 (en) * 2020-07-08 2022-01-13 苏宁易购集团股份有限公司 Multidimensional data analysis method, apparatus, and system
CN114218309A (en) * 2021-11-04 2022-03-22 招银云创信息技术有限公司 Data processing method, system and computer equipment
CN115857929A (en) * 2022-12-09 2023-03-28 中国工商银行股份有限公司 Resource data processing method and device, computer equipment and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200250871A1 (en) * 2019-02-01 2020-08-06 Sap Se Enhancement layers for data visualization
CN110716966A (en) * 2019-10-16 2020-01-21 京东方科技集团股份有限公司 Data visualization processing method and system, electronic device and storage medium
CN110955717A (en) * 2019-11-19 2020-04-03 深圳市航通智能技术有限公司 Visual dynamic display method and system based on big data
CN111522872A (en) * 2020-04-26 2020-08-11 山东健康医疗大数据有限公司 Data visualization method based on index configuration
WO2022007592A1 (en) * 2020-07-08 2022-01-13 苏宁易购集团股份有限公司 Multidimensional data analysis method, apparatus, and system
CN112347092A (en) * 2020-11-05 2021-02-09 中国平安人寿保险股份有限公司 Method and device for generating data analysis billboard and computer equipment
CN113297279A (en) * 2021-05-26 2021-08-24 杭州安恒信息技术股份有限公司 Data analysis and display method, system, equipment and storage medium
CN114218309A (en) * 2021-11-04 2022-03-22 招银云创信息技术有限公司 Data processing method, system and computer equipment
CN115857929A (en) * 2022-12-09 2023-03-28 中国工商银行股份有限公司 Resource data processing method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
US10592838B2 (en) Risk simulation and assessment tool
US10409367B2 (en) Predictive graph selection
US8122337B2 (en) Apparatus and method for navigating a multi-dimensional database
US20070156479A1 (en) Multivariate statistical forecasting system, method and software
US20180357595A1 (en) Data collection and correlation
Baloui Jamkhaneh et al. Inspection error and its effects on single sampling plans with fuzzy parameters
US20160179852A1 (en) Visualizing Large Data Volumes Utilizing Initial Sampling and Multi-Stage Calculations
CN113614758A (en) Equipment index goodness grade prediction model training method, monitoring system and method
CN108108459A (en) Multi-source fusion and the associated dynamic data cleaning method of loop and electronic equipment
Zhao et al. MetricsVis: A visual analytics system for evaluating employee performance in public safety agencies
CN117952483A (en) Digital platform-based balance index monitoring method, system and medium thereof
CN106599313A (en) Visual data cognition method
US7912809B2 (en) Data management system for manufacturing enterprise and related methods
US12050974B1 (en) System and method for enhanced distribution of data to compute nodes
CN116383299A (en) Data display system based on distributed database
Daza et al. Impact of business intelligence on incident management in the control center of a security company
CN114766023B (en) Data processing method, device and system and electronic equipment
CN113886465A (en) Big data analysis platform for automobile logistics
CN111223028A (en) Policy information sharing system and sharing method
CN109447552A (en) A kind of method, computer equipment and storage medium determining plant stock state
CN114968744B (en) Implementation method and system based on financial industry capacity management prediction analysis AI algorithm
Avdeeva et al. Distributed Environment of Decision Support Centers: An Interests Representation Model of Virtual Collaboration and Technological Basic
Samonte et al. Conditional cash transfer data analysis of the Philippines: an e-government data visualization tool
Wu et al. Research on decision support system of automobile service based on distributed data warehouse
Zhou et al. Research on mixed transaction analytical data management oriented to data middle platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20230704

RJ01 Rejection of invention patent application after publication