Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

重写 actions.upload #37

Open
muma378 opened this issue Jun 23, 2018 · 0 comments
Open

重写 actions.upload #37

muma378 opened this issue Jun 23, 2018 · 0 comments
Assignees

Comments

@muma378
Copy link
Owner

muma378 commented Jun 23, 2018

All scenes to upload

  1. 最常见的情况:单个文件夹下所有文件上一期任务
  2. 多个文件夹上一期任务
  3. 一次性多个文件夹上多期任务
  4. 一个文件夹下平均上到多期任务
  5. 不上传文件但是生成到容器的索引
  6. 找到所有文件,处理后上传:
    • 视频:抽帧
    • 图片:格式转换
    • 音频:pcm->wav, downsample, mono, 切割

Abstract config files

[upload]
root = 

How to locate files by blobname?

.files/
	2a/
		823446d2f806ae9f842156acc8b35d
	27/
		330c419a7d358098fedc4b09cdcb4b
		...
.index/
	20717
	20718
.config
2a/823446d2f806ae9f842156acc8b35d (md5 of file1)

$0/relpath/to/file1
# raw:intermediate1:intermediate2...
27330c419a7d358098fedc4b09cdcb4b:39dc4c419a7d358098fedc4b09cdcb4b
metadata(size, samplerate, channels...)
./index/20717

blob1: 2a823446d2f806ae9f842156acc8b35d  # 对应原始文件 or blob本地文件?
blob2: 27330c419a7d358098fedc4b09cdcb4b
.config

[upload]
0 = /local/path/to/root1
1 = /local/path/to/root2

  • 工具 moose-admin update-index root: 当原始文件的路径移动后根据md5值更新relpath
@muma378 muma378 self-assigned this Jun 23, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant