Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read directly from cloud. #69

Open
valentina-s opened this issue Mar 21, 2023 · 4 comments
Open

Read directly from cloud. #69

valentina-s opened this issue Mar 21, 2023 · 4 comments
Assignees

Comments

@valentina-s
Copy link
Collaborator

Add functionality and examples to read directly from the cloud.

@valentina-s
Copy link
Collaborator Author

A script which reads .evr files from the cloud and downloads them temporarily and reads them with echoregions:
https://github.com/uw-echospace/hake-labels/blob/2019/zarr/zarr_mask_generation_2019.py

@leewujung
Copy link
Member

Check the functions from echopype util/io.py: there should be a few functions that you can use directly!

@ctuguinay ctuguinay self-assigned this Jun 23, 2023
@ctuguinay ctuguinay moved this to Todo in Echoregions Jun 23, 2023
@leewujung leewujung mentioned this issue Jun 26, 2023
@ctuguinay
Copy link
Collaborator

Referencing, an issue that @leewujung #95, we want to change the name validate_path (in utils.io) function so that we can use the validate_path described in echopype verbatim.

@ctuguinay
Copy link
Collaborator

ctuguinay commented Jun 27, 2023

Also, as mentioned by @leewujung #95, there needs to be changes made to the check_file function:

Also I think the content of this function should be cleaned up (the logic and also to check filename extension properly with pathlib or properly extracting the .XXX part instead of endwith; pathlib does not work for cloud path last time I checked so maybe some simple re use or similar). Could you put this as a separate issue?

@ctuguinay ctuguinay moved this from Todo to In Progress in Echoregions Jun 27, 2023
@ctuguinay ctuguinay linked a pull request Jun 27, 2023 that will close this issue
@ctuguinay ctuguinay changed the title Read directly from cloud. Read directly from cloud. (On Hold) Jun 28, 2023
@ctuguinay ctuguinay changed the title Read directly from cloud. (On Hold) (On Hold) Read directly from cloud. Jun 30, 2023
@ctuguinay ctuguinay moved this from In Progress to On Hold in Echoregions Jun 30, 2023
@ctuguinay ctuguinay changed the title (On Hold) Read directly from cloud. Read directly from cloud. Jun 30, 2023
@ctuguinay ctuguinay moved this from On Hold to Todo in Echoregions Jul 7, 2023
@ctuguinay ctuguinay moved this from Todo to In Progress in Echoregions Jul 7, 2023
@ctuguinay ctuguinay moved this from In Progress to To-Be-Updated in Echoregions Jul 7, 2023
@ctuguinay ctuguinay moved this from To-Be-Updated to In Progress in Echoregions Jul 7, 2023
@ctuguinay ctuguinay removed the status in Echoregions Jul 7, 2023
@ctuguinay ctuguinay moved this to On Hold in Echoregions Apr 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: On Hold
Development

Successfully merging a pull request may close this issue.

3 participants