Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A question about TwoStepTask.step() function #1

Open
fangzefunny opened this issue Sep 9, 2020 · 0 comments
Open

A question about TwoStepTask.step() function #1

fangzefunny opened this issue Sep 9, 2020 · 0 comments

Comments

@fangzefunny
Copy link

Thanks for providing such a readable code.

If I am correct, you were compressing stage1 and stage2 into 1 trial. In this case, I think the next_state of this trial should be S1, because each trial should begin with stage1. However, in my simple simulation, the non-ep environment never returns S1 [ 1, 0,0]:
image

I wonder if it is a special design for the "incremental" case? I am not sure if I am on the same page with you. Can you offer a brief definition of "incremental", "episodic" in your README?

Thank you very much!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant