-
Notifications
You must be signed in to change notification settings - Fork 209
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FTP、OSS、HDFS统一成T-DFS #253
Labels
Milestone
Comments
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Aug 8, 2023
baisui1981
added a commit
that referenced
this issue
Aug 8, 2023
baisui1981
added a commit
that referenced
this issue
Aug 12, 2023
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Aug 12, 2023
baisui1981
added a commit
to qlangtech/DataX
that referenced
this issue
Aug 12, 2023
baisui1981
added a commit
to qlangtech/ng-tis
that referenced
this issue
Aug 12, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
目前 TIS中基于 FTP,OSS,HDFS 方式的reader和write,这些端类型(reader)相同点是非结构化的文件,需要在定义源端时,为数据源配置 schema,设置文件格式format,文件压缩类型等。
目前每种端类型各自有一套,这样代码维护起来比较麻烦,每种端类型不同点仅仅是获取文件流的方式不同而已,所以有必要将 FTP,OSS,HDFS 这几种类型统一成一个新的端 名字就叫
T-DFS
( TIS 分布式文件系统) ,这样还能方便将来扩充类型相关issue:#252
The text was updated successfully, but these errors were encountered: