2 Commits

Author	SHA1	Message	Date
Xingjun.Wang	f77b51e3c9	Support upload file and folder in the hub api (#1152) ... * update features * update api * add upload_file and thread_executor * update upload file * update api.py * add cli for uploading * run lint * lint in msdataset * temp * add tqdm_desc in thread_executor * update * refine upload_file and upload_folder * add endpoint for cli * add uploading checker * add path_or_fileobj and path_in_repo check in upload_file func * add size limit to lfs: 1MB by default * update lfs limit size: 10MB * 5MB lfs limit * fix test issue * add pbar for upload_blob; del size_to_chunk_mb; fix allow_patterns and ignore_patterns * fix commit uploaded blobs * add update action for folder * fix issues * add normal files check * update * update * set normal file size limit to 500MB * update tqdm	2025-01-14 23:59:53 +08:00
liuyhwangyh	ff77845772	add command line usage, optimize command line log, optimize packaging… (#888) ... * add command line usage, optimize command line log, optimize packaging version compatible * Update command.md * fix logging dup * Refactor install dependencies (#889) * refactor install dependencies, default only depencies of hub and datasets * move pandas import to function * update hub deps * test * remove generate ast file * remove gast dependency * replace gast with ast * add dependency version * remove lap for compile error * fix comments issue * add install ollama --------- Co-authored-by: mulin.lyh <mulin.lyh@taobao.com> --------- Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>	2024-06-30 20:15:03 +08:00