Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FTP、OSS、HDFS统一成T-DFS #253

Closed
baisui1981 opened this issue Aug 3, 2023 · 1 comment
Closed

FTP、OSS、HDFS统一成T-DFS #253

baisui1981 opened this issue Aug 3, 2023 · 1 comment
Labels
3.8.0 enhancement New feature or request
Milestone

Comments

@baisui1981
Copy link
Member

baisui1981 commented Aug 3, 2023

目前 TIS中基于 FTP,OSS,HDFS 方式的reader和write,这些端类型(reader)相同点是非结构化的文件,需要在定义源端时,为数据源配置 schema,设置文件格式format,文件压缩类型等。

目前每种端类型各自有一套,这样代码维护起来比较麻烦,每种端类型不同点仅仅是获取文件流的方式不同而已,所以有必要将 FTP,OSS,HDFS 这几种类型统一成一个新的端 名字就叫 T-DFS( TIS 分布式文件系统) ,这样还能方便将来扩充类型

相关issue:#252

@baisui1981 baisui1981 added the enhancement New feature or request label Aug 3, 2023
@baisui1981 baisui1981 added this to the v4.0.0 milestone Aug 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3.8.0 enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant