| nodeId required | string Example: nodeId=dataset:food_delivery:public.delivery_7_days The ID of the node. A node can either be a dataset node, a dataset field node or a job node. The format of nodeId for dataset is dataset:<namespace_of_dataset>:<name_of_the_dataset>, for dataset field is datasetField:<namespace_of_dataset>:<name_of_the_dataset>:<name_of_field>, and for job is job:<namespace_of_the_job>:<name_of_the_job>.
+ http://localhost:5000/api/v1/lineage Response samples Content typeapplication/json {"graph": [{"id": "string", "type": "JOB", "data": {"type": "DB_TABLE", "name": "my-dataset", "physicalName": "public.mytable", "createdAt": "2019-05-09T19:49:24.201361Z", "upodatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "my-namespace", "sourceName": "my-source", "fields": [{"name'": "a", "type": "INTEGER", "tags": [ ]
}, {"name'": "b", "type": "TIMESTAMP", "tags": [ ]
}, {"name'": "c", "type": "INTEGER", "tags": [ ]
}, {"name'": "d", "type": "INTEGER", "tags": [ ]
}
], "tags": [ ], "lastModifiedAt": null, "description": "My first dataset!", "facets": { }, "currentVersion": "b1d626a2-6d3a-475e-9ecf-943176d4a8c6"
}, "inEdges": [{"origin": "string", "destination": "string"
}
], "outEdges": [{"origin": "string", "destination": "string"
}
]
}
]
}Get the upstream lineage for a given run http://localhost:5000/api/v1/runlineage/upstream Response samples Content typeapplication/json Get a column lineage graph query Parameters| nodeId required | string Example: nodeId=dataset:food_delivery:public.delivery_7_days The ID of the node. A node can either be a dataset node, a dataset field node or a job node. The format of nodeId for dataset is dataset:<namespace_of_dataset>:<name_of_the_dataset>, for dataset field is datasetField:<namespace_of_dataset>:<name_of_the_dataset>:<name_of_field>, and for job is job:<namespace_of_the_job>:<name_of_the_job>.
| | depth | integer Default: 20 Depth of lineage graph to create.
| | withDownstream | boolean Default: false Determines if downstream lineage should be returned.
|
http://localhost:5000/api/v1/column-lineage Response samples Content typeapplication/json {"graph": [{"id": "string", "type": "JOB", "data": {"type": "DB_TABLE", "name": "my-dataset", "physicalName": "public.mytable", "createdAt": "2019-05-09T19:49:24.201361Z", "upodatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "my-namespace", "sourceName": "my-source", "fields": [{"name'": "a", "type": "INTEGER", "tags": [ ]
}, {"name'": "b", "type": "TIMESTAMP", "tags": [ ]
}, {"name'": "c", "type": "INTEGER", "tags": [ ]
}, {"name'": "d", "type": "INTEGER", "tags": [ ]
}
], "tags": [ ], "lastModifiedAt": null, "description": "My first dataset!", "facets": { }, "currentVersion": "b1d626a2-6d3a-475e-9ecf-943176d4a8c6"
}, "inEdges": [{"origin": "string", "destination": "string"
}
], "outEdges": [{"origin": "string", "destination": "string"
}
]
}
]
}Create a tag Creates a new tag object.
+ http://localhost:5000/api/v1/column-lineage Response samples Content typeapplication/json {"graph": [{"id": "string", "type": "JOB", "data": {"type": "DB_TABLE", "name": "my-dataset", "physicalName": "public.mytable", "createdAt": "2019-05-09T19:49:24.201361Z", "upodatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "my-namespace", "sourceName": "my-source", "fields": [{"name'": "a", "type": "INTEGER", "tags": [ ]
}, {"name'": "b", "type": "TIMESTAMP", "tags": [ ]
}, {"name'": "c", "type": "INTEGER", "tags": [ ]
}, {"name'": "d", "type": "INTEGER", "tags": [ ]
}
], "tags": [ ], "lastModifiedAt": null, "description": "My first dataset!", "facets": { }, "currentVersion": "b1d626a2-6d3a-475e-9ecf-943176d4a8c6"
}, "inEdges": [{"origin": "string", "destination": "string"
}
], "outEdges": [{"origin": "string", "destination": "string"
}
]
}
]
}Create a tag Creates a new tag object.
path Parameters| tag required | string Example: SENSITIVE |
Request Body schema: application/json| description | string The description of the tag.
|
http://localhost:5000/api/v1/tags/{tag} Request samples Content typeapplication/json Response samples Content typeapplication/json Query all datasets and jobs Returns one or more datasets and jobs of your query.
+ http://localhost:5000/api/v1/tags Response samples Content typeapplication/json Query all datasets and jobs Returns one or more datasets and jobs of your query.
query Parameters| q required | string Example: q=my-dataset Query containing pattern to match; datasets and jobs pattern matching is string based and case-insensitive. Use percent sign (%) to match any string of zero or more characters (my-job%), or an underscore (_) to match a single character (_job_).
| | filter | string Example: filter=dataset Filters the results of your query by dataset or job.
| | sort | string Example: sort=name Sorts the results of your query by name or updated_at.
@@ -2393,9 +2395,9 @@
| | after | stringYYYY-MM-DD Example: after=2022-09-15 Match jobs or datasets after YYYY-MM-DD.
|
http://localhost:5000/api/v1/search Response samples Content typeapplication/json {"totalCount": 1, "results": [{"type": "DATASET", "name": "public.delivery_7_days", "updatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "food_delivery", "nodeId": "dataset:food_delivery:public.delivery_7_days"
}
]
}http://localhost:5000/api/v1/search Response samples Content typeapplication/json {"totalCount": 1, "results": [{"type": "DATASET", "name": "public.delivery_7_days", "updatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "food_delivery", "nodeId": "dataset:food_delivery:public.delivery_7_days"
}
]
} |