Skip to content

fix: ensure to_json(lines=False) produces valid JSON#8279

Open
decembercomposer697-hue wants to merge 1 commit into
huggingface:mainfrom
decembercomposer697-hue:fix/to_json-lines-false
Open

fix: ensure to_json(lines=False) produces valid JSON#8279
decembercomposer697-hue wants to merge 1 commit into
huggingface:mainfrom
decembercomposer697-hue:fix/to_json-lines-false

Conversation

@decembercomposer697-hue

Copy link
Copy Markdown

Fixes #7037: when lines=False, multi-batch writes produced
invalid concatenated JSON arrays. Now forces a single batch.

…datasets

When lines=False, each batch wrote a separate JSON array, producing
invalid concatenated JSON. Now forces a single batch when lines=False.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

A bug of Dataset.to_json() function

1 participant