CN113034111A

CN113034111A - Data export and import method and device

Info

Publication number: CN113034111A
Application number: CN202110346673.2A
Authority: CN
Inventors: 马春宇
Original assignee: Beijing Kingsoft Cloud Network Technology Co Ltd
Current assignee: Beijing Kingsoft Cloud Network Technology Co Ltd
Priority date: 2021-03-31
Filing date: 2021-03-31
Publication date: 2021-06-25
Anticipated expiration: 2041-03-31
Also published as: CN113034111B

Abstract

The embodiment of the invention provides a data export method and a data import method and a data export device, which relate to the field of data processing, wherein the data export method comprises the following steps: determining the job to be exported of the target service; obtaining a job flow representing each job execution flow to be exported; for each job to be exported, obtaining implementation data for implementing the job to be exported and configuration data of the job to be exported; and generating export data containing the workflow, the obtained implementation data and the configuration data, and exporting the export data. When the scheme provided by the embodiment is applied to data export and import, the efficiency of providing the service configuration operation for the service platform is improved.

Description

Data export and import method and device

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for exporting and importing data.

Background

The service platform based on technologies such as big data can provide various services for users, and when the service platform provides services for users, a large amount of service data can be generated. Before providing the service data to the user, the service data may need to be processed according to a certain data processing manner based on the user requirement or the requirement of the service platform. Processing the service data based on a data processing method may be referred to as an operation.

Due to the above requirements, it is necessary to perform job development respectively for various services provided by the service platform, and configure corresponding jobs for each service of the service platform.

Therefore, under the condition that the number of the service platforms is large and the number of the services provided by each service platform is large, the number of the tasks required to be developed is large, and the development period is long, so that the efficiency of the service configuration task provided for the service platforms is low.

Disclosure of Invention

The embodiment of the invention aims to provide a data exporting method and a data importing method and a data exporting device, so as to improve the efficiency of service configuration operation provided for a service platform. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a data export method, where the method includes:

determining the job to be exported of the target service;

obtaining a job flow representing each job execution flow to be exported;

for each job to be exported, obtaining implementation data for implementing the job to be exported and configuration data of the job to be exported;

and generating export data containing the workflow, the obtained implementation data and the configuration data, and exporting the export data.

In an embodiment of the present invention, the determining the job to be exported of the target service includes:

obtaining a job export request sent by a job export service to an export interface of a target component, wherein the target component is: a component for providing a target service to a user;

and determining the job to be exported of the target service according to the job export request.

In an embodiment of the invention, the deriving the derived data includes:

and storing the export data into an export database through the export interface.

In an embodiment of the present invention, in a case that there are multiple target services, the generating export data including the job flow, the obtained implementation data, and the configuration data includes:

aiming at each target service, generating a product package containing a target operation flow, target implementation data and target configuration data corresponding to the target service, and a corresponding relation between the generated product package and the target service, wherein the target operation flow is as follows: characterizing the operation flow of the operation execution flow to be exported, which belongs to the target service, wherein the target implementation data is as follows: the data for realizing the operation to be exported belonging to the target service is realized, and the target configuration data is as follows: configuration data of the job to be exported belonging to the target service;

and packaging the generated corresponding relation and the product package to obtain export data.

In a second aspect, an embodiment of the present invention provides a data importing method, where the method includes:

obtaining data to be imported of a target service, wherein the data to be imported comprises: representing the operation flow of each operation to be imported of the target service, the implementation data of each operation to be imported for implementing the target service and the configuration data of each operation to be imported for the target service;

and importing the workflow and the implementation data of each job to be imported into the target business, and configuring each job to be imported according to the configuration data of each job to be imported so that each job to be imported performs data processing according to the workflow.

In an embodiment of the present invention, the obtaining of the data to be imported of the target service includes:

obtaining data to be imported of a target service from an import database, wherein the import database is used for storing: and the job import service uploads the data to be imported after receiving the data import request.

In an embodiment of the present invention, the job importing service uploads data to be imported by:

obtaining import data based on the received data import request;

unpacking the imported data to obtain product packages and corresponding relations between the product packages and services, wherein the product packages comprise target operation flows, target implementation data and target configuration data of the services corresponding to the product packages, and the target operation flows are as follows: representing the operation flow of the operation execution flow to be exported, which belongs to the service corresponding to the product package, wherein the target implementation data is as follows: the data for realizing the operation to be exported belonging to the service corresponding to the product package are realized, and the target configuration data are as follows: configuration data of the operation to be exported, which belongs to the service corresponding to the product package;

and uploading the obtained product package and the corresponding relation into a database.

In a third aspect, an embodiment of the present invention provides a data export apparatus, where the apparatus includes:

the operation determining module is used for determining the operation to be exported of the target service;

the workflow obtaining module is used for obtaining workflow representing each job execution flow to be exported;

the data acquisition module is used for acquiring implementation data for implementing the operation to be exported and configuration data of the operation to be exported aiming at each operation to be exported;

and the data export module is used for generating export data containing the workflow, the obtained implementation data and the configuration data and exporting the export data.

In an embodiment of the present invention, the job determining module includes:

a request obtaining submodule, configured to obtain a job export request sent by a job export service to an export interface of a target component, where the target component is: a component for providing a target service to a user;

and the operation determining submodule is used for determining the operation to be exported of the target service according to the operation exporting request.

In an embodiment of the invention, the data export module is specifically configured to store the export data in an export database through the export interface.

In an embodiment of the present invention, in a case that there are multiple target services, the data export module includes:

a data generation submodule, configured to generate, for each target service, a product package including a target job flow, target implementation data, and target configuration data corresponding to the target service, and a correspondence between the generated product package and the target service, where the target job flow is: characterizing the operation flow of the operation execution flow to be exported, which belongs to the target service, wherein the target implementation data is as follows: the data for realizing the operation to be exported belonging to the target service is realized, and the target configuration data is as follows: configuration data of the job to be exported belonging to the target service;

and the data obtaining submodule is used for packaging the generated corresponding relation and the product package to obtain export data.

In a fourth aspect, an embodiment of the present invention provides a data importing apparatus, where the apparatus includes:

the data obtaining module is configured to obtain data to be imported of a target service, where the data to be imported includes: representing the operation flow of each operation to be imported of the target service, the implementation data of each operation to be imported for implementing the target service and the configuration data of each operation to be imported for the target service;

and the data import module is used for importing the workflow and the implementation data of each job to be imported into the target service, and configuring each job to be imported according to the configuration data of each job to be imported so as to enable each job to be imported to perform data processing according to the workflow.

In an embodiment of the present invention, the data obtaining module is specifically configured to obtain data to be imported of a target service from an import database, where the import database is configured to store: and the job import service uploads the data to be imported after receiving the data import request.

In an embodiment of the present invention, the job importing service specifically uploads data to be imported by: obtaining import data based on the received data import request; unpacking the imported data to obtain product packages and corresponding relations between the product packages and services, wherein the product packages comprise target operation flows, target implementation data and target configuration data of the services corresponding to the product packages, and the target operation flows are as follows: representing the operation flow of the operation execution flow to be exported, which belongs to the service corresponding to the product package, wherein the target implementation data is as follows: the data for realizing the operation to be exported belonging to the service corresponding to the product package are realized, and the target configuration data are as follows: configuration data of the operation to be exported, which belongs to the service corresponding to the product package; and uploading the obtained product package and the corresponding relation into a database.

In a fifth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;

a memory for storing a computer program;

a processor configured to implement the method steps of any one of the first or second aspects when executing a program stored in the memory.

In a sixth aspect, the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method steps of the first aspect or the second aspect.

As can be seen from the above, when data export is performed by applying the scheme provided in the embodiment of the present invention, since the export data includes the job flow representing the execution flow of each job to be exported, the implementation data for implementing each job to be exported, and the configuration data of each job to be exported, after the export data is exported, the export data can be imported into the target service that is not subject to job development, and the target service can directly process the service data based on the imported data.

In addition, as the export data comprising the operation flow, the implementation data and the configuration data is exported, the exported data comprises more comprehensive data and more data quantity, the export and the migration of batch data are realized, and the efficiency of the service configuration operation provided for the service platform is further improved.

Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flowchart of a data export method according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a data importing method according to an embodiment of the present invention;

fig. 3 is a signaling interaction diagram of a data export and import method according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a data export apparatus according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a data importing apparatus according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

First, an execution subject of the data export method provided by the embodiment of the present invention is explained.

In one case, the execution subject that implements the data export may be an electronic device in the service platform. The service platform comprises the following steps: the platform for providing services to users, such as the service platform described above, may be a service platform based on big data technology.

In this case, the electronic device may be an electronic device having a management function in the service platform.

The electronic device may also be an electronic device that deploys a job to be exported in a service platform, and specifically, a target component in the electronic device may be an execution subject, where the target component is: and the component is used for realizing the target business corresponding to the job to be exported.

In another case, the execution subject for implementing data export may also be an electronic device in a test platform, where the test platform is used for implementing a test function.

Specifically, the electronic device may be an electronic device having a management function in a test platform.

In another case, the execution subject for implementing data export may be: an electronic device external to the platform for enabling data export.

Referring to fig. 1, fig. 1 is a schematic flow chart of a data export method according to an embodiment of the present invention, where the method includes the following steps S101 to S104.

Step S101: and determining the job to be exported of the target service.

The target service can be one or more services provided by the service platform to the user. For example: the target service can provide services for audio and video, information query services, identity authentication services and the like. The service platform can be a service platform based on big data technology.

The job can be understood as: a data processing mode or a data processing service logic for processing service data of the service. For example: the operation may be: the method is used for deleting, inserting, combining and the like the service data of the service.

On this basis, the operation to be exported refers to: and the data processing mode is used for processing the service data of the target service.

The job to be exported may be a job to be exported of a target service determined based on an obtained job identifier, which is obtained by analyzing the job export request after the electronic device receives the export request sent by the client used by the developer, and obtaining the job identifier carried in the job export request.

The job to be exported may be a job to be exported in which the developer selects each of the target services on the user operation interface, and the electronic device determines each of the jobs to be exported selected by the developer as the job to be exported for the target service.

The job to be exported may be a job to be exported in which the developer selects a target service on the user operation interface, the electronic device determines each job corresponding to the target service selected by the developer, and uses each determined job as the job to be exported of the target service.

Step S102: and obtaining the job flow representing the execution flow of each job to be exported.

The job flow is used for representing the execution flow of each job to be exported. When the service data of the service is processed, the operations are required to be sequentially executed according to the execution flow of each operation of the service, so that the service data of the service is processed, and therefore, the operation flow representing the execution flow of each operation to be exported is required to be obtained.

For example: assuming that the jobs to be exported of the target traffic include W1, W2, W3, the job flow may be: the workflow of executing W1, then W2, and finally W3 is characterized.

Specifically, the execution flow of the job of each service may be set in advance. In this case, after the jobs to be exported are determined, a job flow representing the execution flow of each job to be exported representing the target service may be obtained from the preset execution flows.

The workflow may also determine a workflow representing an execution flow of each job to be exported according to the input information and the output information of each job to be exported.

Specifically, an input physical meaning represented by input information and an output physical meaning represented by output information of each job to be exported may be determined; for each job to be exported, matching the input physical meaning corresponding to the job to be exported with the output physical meanings corresponding to other jobs to be exported, matching the output physical meaning corresponding to the job to be exported with the input physical meanings corresponding to other jobs to be exported, and determining the execution flow between the job to be exported and other jobs to be exported according to the matching result; and determining the job flow representing the execution flow of each job to be exported according to the determined execution flow among the jobs to be exported.

For example: assuming that the jobs to be exported of the target service include W1, W2, and W3, the input physical meaning and the output physical meaning corresponding to each job to be exported are as shown in table 1 below.

TABLE 1

For job to be derived W1 whose corresponding output physical meaning matches the corresponding input physical meaning of job to be derived W3, that is, the output information of job to be derived W1 is the input information of job to be derived W3, it can be determined that job to be derived W3 is started to be executed after job to be derived W1 is executed.

For job to be derived W2 whose corresponding input physical meaning matches the corresponding output physical meaning of job to be derived W3, that is, the input information of job to be derived W2 is the output information of job to be derived W3, it can be determined that job to be derived W2 is started to be executed after job to be derived W3 is executed.

For job to be derived W3 whose corresponding input physical meaning matches the output physical meaning corresponding to job to be derived W1 and whose corresponding output physical meaning matches the input physical meaning corresponding to job to be derived W2, that is, the input information of job to be derived W3 is the output information of job to be derived W1 and the output information of job to be derived W3 is the input information of job to be derived W2, it can be determined that job to be derived W3 is started to be executed after job to be derived W1 is executed and job to be derived W2 is started to be executed after job to be derived W3 is executed.

Thus, according to the determined execution flow of each job to be exported, the job flow can be determined as follows: the job flow of the execution flow of executing W1, then executing W3 and finally executing W2 is characterized.

The workflow may also be a workflow representing each to-be-exported job execution flow determined by the developer, and the electronic device determines the workflow based on each to-be-exported job execution flow determined by the developer after the developer determines each to-be-exported job execution flow of the target service on the user operation interface.

Step S103: for each job to be exported, implementation data for implementing the job to be exported and configuration data for the job to be exported are obtained.

The implementation data refers to data for implementing a job to be exported, for example: the implementation data may be code, SQL, or other data for implementing the job to be exported.

The configuration data of the job to be exported is data for configuring the job to be exported. The configuration data of the job to be exported may include: and running rules, resource allocation, alarm rules, scheduling allocation and other data of the operation to be exported.

Specifically, the operation rule of the job to be exported is as follows: rules for implementing dependencies upon execution of jobs to be exported. For example: the operation rule may be: and starting to execute the job when a preset job execution trigger condition is met, and ending to execute the job when a preset job ending trigger condition is met.

The resource configuration of the job to be exported is as follows: for implementing dependent resources in the execution of the job to be exported. For example: the resource configuration may be to configure a computing resource, a storage resource, and the like with a preset size.

The alarm rule of the operation to be exported is as follows: and the rule is used for realizing the rule that when the operation to be exported is executed, a fault occurs and an alarm is generated. For example: the alarm rule may be: sending alarm short messages to workers, flashing alarm lamps and the like.

The scheduling configuration of the job to be exported is as follows: and the rule is used for realizing the resource scheduling configuration when the job to be exported is executed. For example: the scheduling configuration may be: scheduling path and scheduling implementation method when configuring resources.

Specifically, the implementation data for implementing each job to be exported and the configuration data for each job to be exported may be obtained from a preset database, where the implementation data and the configuration data developed by the developer for each job of the target service in advance are stored in the preset database.

The method comprises the steps that a developer can perform job development in advance on a data development platform, the data development platform is used for providing various services such as job development, job operation and job submission for a user, the user can select a job plugin in a user operation interface when performing the job development, configuration data such as a dependence rule, a set resource configuration, a configuration alarm rule and a scheduling configuration of the job are configured based on a frame of the selected job plugin, and implementation data for implementing the job is configured in a code writing or sql mode, so that the job development is realized. The electronic device in the data development platform may store the implementation data and the configuration data of the job configured by the user into the database.

Step S104: export data including the workflow, the obtained implementation data, and the configuration data is generated, and the export data is exported.

Specifically, the obtained job flow, implementation data, and configuration data may be packaged to obtain a data packet, which may be referred to as a product packet as export data.

As can be seen from the above, when data export is performed by applying the scheme provided in this embodiment, the export data includes the job flow representing the execution flow of each job to be exported, the implementation data for implementing each job to be exported, and the configuration data of each job to be exported, after the export data is exported, the export data can be imported into the target service that is not subject to job development, and the target service can directly process the service data based on the imported data.

In addition, because the export data comprising the operation flow, the implementation data and the configuration data is exported, the exported data comprises more comprehensive data and more data quantity, when the data is imported, the export and the migration of batch data are realized, and the efficiency of the service configuration operation provided for the service platform is further improved.

In an embodiment of the present invention, a job export service for exporting jobs may also be deployed in the electronic device, in which case, the jobs to be exported for determining the target business in step S101 described above may be implemented according to the following steps a 1-a 2.

Step A1: a job export request sent by the job export service to an export interface of the target component is obtained.

The target components are as follows: a component for a targeted service provided to a user. The export interface is: and the interface is used for realizing the operation to be exported of the export target service.

The job export service can perform data interaction with target components deployed in various business platforms, and therefore, the job export service can also be called a common job export service.

Since the target component is used for realizing the target business, and the business data generated by the target business is also generated by the target component, the export data for processing the business data can also be generated and exported by the target component, so that the job export service can send the job export request to the export interface of the target component. When the target component receives the job export request, the target component may generate export data and export the generated export data according to steps S101 to S104.

The job export request may be that the job export service analyzes the job export request after receiving the job export request sent by the client used by the developer, obtains an identifier of the target component carried in the job export request, and sends the job export request to the target component corresponding to the obtained identifier.

The job export request may be a job to be exported of a target service selected by the developer on the user operation interface, and the job export service may generate the job export request based on the job to be exported of the target service selected by the developer and send the generated job export request to the target component.

Step A2: determining the job to be exported of the target service according to the job export request

The job to be exported may be that the target component parses the job export request, obtains an identifier of the job to be exported carried in the job export request, and determines the job to be exported of the target service based on the identifier of the job to be exported.

The job to be exported may also be a job to be exported of the target service, where the job export request does not carry the identifier of the job to be exported, and the target component takes each job corresponding to the target service as the job to be exported of the target service.

In this way, since the job export service is a service for providing job export, when the job export service provides a service, a job to be exported of the target service can be obtained according to a job export request sent by the job export service to the export interface of the target component.

In one embodiment of the invention, when exporting the export data, the export data can be stored into the export database through the export interface of the target component.

The export database may be a database on the electronic device, and may also be a database on the electronic device for storing export data, and the electronic device may be referred to as a tri-state public service machine.

Specifically, a download button/interface may be set in a service page of the job export service, and a developer may download export data in the export database through the download button/interface.

The export data are stored in the export database, the generated export data can be stored, and when the export data are needed later, the export data can be directly obtained from the export database without regenerating the export data, so that the efficiency of obtaining the export data is improved, and the centralized management of the export data based on the export database can be realized.

In an embodiment of the present invention, when generating the export data in the case that there are a plurality of target services, for each target service, a production package including a target job flow, target implementation data, and target configuration data corresponding to the target service may be generated, and a correspondence between the generated production package and the target service may be generated, and the generated correspondence and the production package may be packaged to obtain the export data.

The target workflow is as follows: and characterizing the operation flow of the operation execution flow to be exported, which belongs to the target service. The above target implementation data is: and realizing the realization data of the operation to be exported, which belongs to the target service. The target configuration data is: configuration data of the job to be exported belonging to the target service.

The corresponding relation is as follows: and the generated corresponding relation between each product package and each target service.

Specifically, the generated corresponding relationship and each product package may be subjected to data encapsulation, so as to implement packing processing, and obtain export data.

After the product package and the corresponding relationship are obtained, the product package and the corresponding relationship may be imported into an export database, and the export database may be referred to as a product library because the product package is stored in the export database.

Therefore, under the condition that a plurality of target services exist, the corresponding relation between the target services and the product packages is contained in the derived data, and the target services corresponding to the product packages can be determined more accurately according to the corresponding relation.

Corresponding to the data export method, the embodiment of the invention also provides a data import method.

First, an execution body of the data import method according to the embodiment of the present invention will be described.

The execution subject for realizing data import is the electronic equipment in the service platform. The service platform is a service platform for data import.

Specifically, the electronic device may be: and the electronic equipment has a management function in the service platform.

The electronic device may further include: an electronic device for deploying a target service corresponding to data to be imported in a service platform, specifically, a target component in the electronic device may be an execution subject, and the target component is: a component for implementing a targeted service to a user.

Referring to fig. 2, fig. 2 is a schematic flowchart of a data importing method according to an embodiment of the present invention, where the method includes the following steps S201 to S202.

Step S201: and acquiring data to be imported of the target service.

The data to be imported includes: the system comprises a workflow representing the execution flow of each job to be imported of the target service, implementation data of each job to be imported for implementing the target service and configuration data of each job to be imported for the target service.

The data to be imported may be the data to be imported of the target service carried in the data import request, which is obtained by analyzing the data import request after the electronic device receives the data import request sent by the client used by the developer.

Specifically, since the service can be deployed on each service platform, different service platforms can provide the same service, and for the same service, the data processing mode for processing the service data of the service is the same. Therefore, after obtaining the export data of the target service of a certain service platform, the user can use the obtained export data as the data to be imported of the target service of another service platform, and send a data import request carrying the obtained data to be imported of the target service to another service platform. Therefore, development operation for the target service of another service platform is not needed, and the efficiency of service configuration operation provided for the service platform is improved.

For example: the method comprises the steps that a developer can download export data of a target service to a U disk or a network disk on a service page of a job export service of a certain service platform, the developer takes the export data of the target service downloaded to the U disk or the network disk as import data of the same target service in another service platform and uploads the import data of the target service to the other service platform, and a client used by the developer sends a data import request carrying the import data of the target service to the service platform.

Of course, the data processing manner for processing the service data of the service may be the same for different services. Therefore, after obtaining export data of a certain target service, a user may use the obtained export data as data to be imported of the target service having the same operation as the target service, and send a data import request carrying the obtained data to be imported of the target service to the service platform.

The data to be imported may also be data to be imported, which is obtained from the import database for the target service. The import database is used for storing: and the job import service uploads the data to be imported after receiving the data import request.

The job import service is used for realizing an import job function, can perform data interaction with each component for realizing the business, and can be also called as a common job import service.

For one service platform, the export data of the target service can be exported, and the import data of the target service can be imported, so that on one service platform, the common job export service and the common job import service can be simultaneously set, the common job export service can be integrated with the common job import service, and the integrated service can be called as a common job import and export service.

Specifically, after receiving the data import request, the job import service may parse the data import request, obtain an identifier of data to be imported carried by the data import request, obtain data to be imported of the target service from an export database based on the obtained identifier of the data to be imported, and import the obtained data to be imported into the import database, where the export database is used to store: derived data of the target service.

Step S202: and importing the job flow and the implementation data of each job to be imported into the target service, and configuring each job to be imported according to the configuration data of each job to be imported so that each job to be imported performs data processing according to the job flow.

Specifically, the job flow and the implementation data of each job to be imported may be imported through the import interface of the target service, and each job to be imported is configured according to the configuration data of each job to be imported through the import interface of the target service.

For the same target service, the export data of the target service can be exported, and the import data of the target service can be imported, so that for the same target service, an import/export interface can be arranged, and the interface can realize both data import and data export.

The workflow is a to-be-imported job execution flow representing a target service, the implementation data of each to-be-imported job is used for implementing each to-be-imported job, the workflow and the implementation data of each to-be-imported job are imported into the target service, and after each import job is configured according to the configuration data of each import job, the target service can sequentially execute the implementation data of each to-be-imported job according to each to-be-imported job execution flow represented by the workflow.

As can be seen from the above, when data import is performed by applying the scheme provided in this embodiment, after data to be imported of a target service is obtained, a job flow and implementation data included in the data to be imported are imported into the target service, and each job to be imported is configured according to configuration data of each job to be imported, because the configuration data is data for implementing configuration of the job to be imported, the job flow is an execution flow that characterizes each job to be imported, and the implementation data is implementation data that characterizes each job to be imported, the data to be imported can be configured based on the configuration data, and the implementation data of each job to be imported can be sequentially executed according to the execution flow of each job to be imported that is characterized by the job flow, so that the service data of the target service can be processed. Compared with the prior art, the method and the device have the advantages that the working personnel do not need to respectively develop the operation of each service, only the data to be imported of the target service needs to be imported, and the efficiency of the service configuration operation provided for the service platform is improved.

In addition, the imported data comprises the operation flow, the implementation data and the configuration data, so that the data contained in the imported data is comprehensive and the data volume is large, the batch data is migrated and imported when the data is imported, and the efficiency of the service configuration operation provided for the service platform is further improved.

In an embodiment of the present invention, the job importing service may also upload data to be imported through the following steps B1-B3.

Step B1: and obtaining import data based on the received data import request.

Specifically, the data import request may be analyzed to obtain the import data carried in the data import request.

Step B2: and unpacking the imported data to obtain the product packages and the corresponding relation between each product package and the service.

The product package comprises a target operation flow, target implementation data and target configuration data of the corresponding service.

The target workflow is as follows: representing the operation flow of the operation execution flow to be exported, which belongs to the business corresponding to the product package, wherein the target realization data is as follows: the method comprises the following steps of realizing the realization data of the operation to be exported, belonging to the business corresponding to the product package, wherein the target configuration data comprises the following data: and configuration data of the operation to be exported, which belongs to the service corresponding to the product package.

The correspondence is a correspondence between each product package and a service, and when the product package and the service have a correspondence, it indicates that the service data of the service can be processed based on the data in the product package.

Because the data processing modes for processing the service data of the same service on different service platforms are the same, for a product package, the product package can have a corresponding relation with the same target service on different service platforms.

Of course, when the data processing modes for processing the service data of different services are the same, the same product package may also have a corresponding relationship with different target services.

When the imported data is unpacked, the imported data can be split to obtain each product package and the corresponding relation between each product package and the service, and the service corresponding to each product package can be determined according to the corresponding relation.

Step B3: and uploading the obtained product package and the corresponding relation into a database.

The obtained product packages and the corresponding relations are uploaded and imported into the database, and the corresponding relations are the corresponding relations between the product packages and the services, so the services corresponding to the product packages can be determined more accurately based on the corresponding relations.

The following describes a data exporting and importing method according to an embodiment of the present invention with reference to fig. 3.

Since different service platforms can provide the same service, for example: the service platform A and the service platform B can both provide identity information inquiry service, and the data processing modes for processing the service data of the same service are the same, so that when data export is carried out, developers can export the export data of the target service of the service platform A, the exported data is used as the import data of the target service of the service platform B, and the import data is imported into the target service of the service platform B, so that the services in different service platforms do not need to be developed, and the service development efficiency is improved.

Fig. 3 is an information interaction diagram of a data export and import method according to an embodiment of the present invention. Fig. 3 includes developers, a common import/export service S1, a target component T1, and a product library D1 in the service platform a, and a common import/export service S2, a target component T2, and a product library D2 in the service platform B.

The developer logs in to the common import/export service S1, and sends a job export request to the common import/export service S1. The job export request is used for requesting the export of jobs of each target service in the service platform a.

The common import/export service S1 sends a job export request to the export interface of the target component T1 corresponding to each target service.

Each target component T1 generates each product package including the job flow, the implementation data, and the configuration data based on the job export request, determines the correspondence between each product package and the target service, and merges each generated product package and the correspondence to obtain export data.

The target component imports the export data into the product library D1 through an export interface.

The developer downloads export data corresponding to each target service in the artifact library D1 through the download interface of the common import/export service S1.

The developer uploads the downloaded export data as import data to the common import/export service S2.

The public import/export service S2 splits the import data to obtain the correspondence between each artifact package and the service and each artifact package.

The public import and export service S2 records information of each product package, and uploads the split product package and the corresponding relationship to the product library D2.

And the public import and export service imports each product package into a target component of the service corresponding to each product package.

Corresponding to the data export method, the embodiment of the invention also provides a data export device.

Referring to fig. 4, fig. 4 is a schematic structural diagram of a data export apparatus according to an embodiment of the present invention, where the apparatus includes the following

modules

401 and 404.

A job determining module 401, configured to determine a job to be exported for the target service;

a job flow obtaining module 402, configured to obtain a job flow representing each job execution flow to be exported;

a data obtaining module 403, configured to, for each job to be exported, obtain implementation data for implementing the job to be exported and configuration data of the job to be exported;

a data export module 404, configured to generate export data including the workflow, the obtained implementation data, and the configuration data, and export the export data.

In an embodiment of the present invention, the job determining module 401 includes:

Therefore, under the condition that a plurality of target services exist, the corresponding relation between the target services and the product packages is contained in the derived data, so that the target services corresponding to the product packages can be determined more accurately according to the corresponding relation.

Corresponding to the data importing method, the embodiment of the invention also provides a data importing device.

Referring to fig. 5, fig. 5 is a schematic structural diagram of a data importing apparatus according to an embodiment of the present invention, where the apparatus includes the following

modules

501 and 502.

A data obtaining module 501, configured to obtain data to be imported of a target service, where the data to be imported includes: representing the operation flow of each operation to be imported of the target service, the implementation data of each operation to be imported for implementing the target service and the configuration data of each operation to be imported for the target service;

a data import module 502, configured to import the workflow and the implementation data of each job to be imported into the target service, and configure each job to be imported according to the configuration data of each job to be imported, so that each job to be imported performs data processing according to the workflow.

In an embodiment of the present invention, the data obtaining module 501 is specifically configured to obtain data to be imported of a target service from an import database, where the import database is configured to store: and the job import service uploads the data to be imported after receiving the data import request.

In an embodiment of the present invention, the job importing service specifically uploads data to be imported by:

obtaining import data based on the received data import request; unpacking the imported data to obtain product packages and corresponding relations between the product packages and services, wherein the product packages comprise target operation flows, target implementation data and target configuration data of the services corresponding to the product packages, and the target operation flows are as follows: representing the operation flow of the operation execution flow to be exported, which belongs to the service corresponding to the product package, wherein the target implementation data is as follows: the data for realizing the operation to be exported belonging to the service corresponding to the product package are realized, and the target configuration data are as follows: configuration data of the operation to be exported, which belongs to the service corresponding to the product package; and uploading the obtained product package and the corresponding relation into a database.

Corresponding to the data exporting and importing methods, the embodiment of the invention also provides electronic equipment.

Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, including a processor 601, a communication interface 602, a memory 603, and a communication bus 604, where the processor 601, the communication interface 602, and the memory 603 complete mutual communication through the communication bus 604,

a memory 603 for storing a computer program;

the processor 601 is configured to implement the data exporting or data importing method according to the embodiment of the present invention when executing the program stored in the memory 603.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.

In another embodiment provided by the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the data export or data import method provided by the embodiment of the present invention.

In yet another embodiment provided by the present invention, a computer program product containing instructions is also provided, which when executed on a computer, causes the computer to implement the data export or data import method provided by the embodiment of the present invention.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the embodiments of the apparatus, the electronic device, and the computer-readable storage medium, since they are substantially similar to the embodiments of the method, the description is simple, and for the relevant points, reference may be made to the partial description of the embodiments of the method.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A method of data derivation, the method comprising:

determining the job to be exported of the target service;

obtaining a job flow representing each job execution flow to be exported;

2. The method of claim 1, wherein the determining the job to be exported for the target service comprises:

3. The method of claim 2, wherein the deriving the derived data comprises:

4. The method according to any one of claims 1-3, wherein in the case that there are multiple target services, the generating derived data comprising the workflow, the obtained implementation data, and configuration data comprises:

5. A method for importing data, the method comprising:

6. The method of claim 5, wherein the obtaining data to be imported for the target service comprises:

7. The method of claim 6, wherein the job import service uploads data to be imported by:

obtaining import data based on the received data import request;

8. A data derivation apparatus, the apparatus comprising:

9. The apparatus of claim 8, wherein the job determination module comprises:

10. The apparatus of claim 9,

the data export module is specifically configured to store the export data in an export database through the export interface.

11. The apparatus according to any one of claims 8-10, wherein in case of multiple target services, the data derivation module comprises:

12. A data import apparatus, characterized in that the apparatus comprises:

13. The apparatus of claim 12,

the data obtaining module is specifically configured to obtain data to be imported of the target service from an import database, where the import database is configured to store: and the job import service uploads the data to be imported after receiving the data import request.

14. The apparatus of claim 13,

the job import service specifically uploads the data to be imported in the following manner: obtaining import data based on the received data import request; unpacking the imported data to obtain product packages and corresponding relations between the product packages and services, wherein the product packages comprise target operation flows, target implementation data and target configuration data of the services corresponding to the product packages, and the target operation flows are as follows: representing the operation flow of the operation execution flow to be exported, which belongs to the service corresponding to the product package, wherein the target implementation data is as follows: the data for realizing the operation to be exported belonging to the service corresponding to the product package are realized, and the target configuration data are as follows: configuration data of the operation to be exported, which belongs to the service corresponding to the product package; and uploading the obtained product package and the corresponding relation into a database.

15. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any one of claims 1 to 4 or 5 to 7 when executing a program stored in the memory.

16. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 4 or 5 to 7.