FATE数据接入指南¶
1. upload¶
fate提供upload组件供用户上传数据至fate所支持的存储系统内(默认eggroll)¶
用法如下:
# cli
python fate_flow_client.py -f upload -c $config_path
# fate client
flow data upload -c $config_path
eggroll
python fate_flow_client.py -f upload -c examples/upload/upload_to_eggroll.json
flow data upload -c examples/upload/upload_to_eggroll.json
mysql
python fate_flow_client.py -f upload -c examples/upload/upload_to_mysql.json
flow data upload -c examples/upload/upload_to_mysql.json
hdfs
python fate_flow_client.py -f upload -c examples/upload/upload_to_hdfs.json
flow data upload -c examples/upload/upload_to_hdfs.json
2. table bind¶
若用户的数据已经存在fate所支持的存储系统内,可通过table bind将真实存储路径映射到fate存储表¶
用法如下:
# cli
python fate_flow_client.py -f table_bind -c $config_path
# fate client
flow table bind -c $config_path
mysql
python fate_flow_client.py -f table_bind -c examples/table_bind/bind_mysql_table.json
flow table bind -c examples/table_bind/bind_mysql_table.json
hdfs
python fate_flow_client.py -f table_bind -c examples/table_bind/bind_hdfs_table.json
flow table bind examples/table_bind/bind_hdfs_table.json