Skip to content

Added fixed-size sequence length for GRU#253

Open
ColdFrenzy wants to merge 1 commit into
facebookresearch:mainfrom
ColdFrenzy:main
Open

Added fixed-size sequence length for GRU#253
ColdFrenzy wants to merge 1 commit into
facebookresearch:mainfrom
ColdFrenzy:main

Conversation

@ColdFrenzy

Copy link
Copy Markdown

When using an RNN, the sequence length was directly linked to n_envs_per_worker:

sequence_length = -(
    -self.experiment_config.collected_frames_per_batch(self.on_policy)
    // self.experiment_config.n_envs_per_worker(self.on_policy)
)

For large values of collected_frames_per_batch, this requires a high number of n_envs_per_workers. This can cause problems or overhead in non-vectorized and CPU environments.
The goal of this pull request is to remove this dependency and use fixed sized sequence length by leveraging the hidden state obtained during the collection phase.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant