Skip to content

Export with encyclopedia global.bcsv lookups or raw, and update the Importer for PS3 support and raw exported CSV#2

Open
Cri4Key wants to merge 8 commits into
pschap:masterfrom
Cri4Key:use_global_as_encyclopedia
Open

Export with encyclopedia global.bcsv lookups or raw, and update the Importer for PS3 support and raw exported CSV#2
Cri4Key wants to merge 8 commits into
pschap:masterfrom
Cri4Key:use_global_as_encyclopedia

Conversation

@Cri4Key

@Cri4Key Cri4Key commented Mar 2, 2026

Copy link
Copy Markdown
Contributor

Turns out most of BCSV files actually make use of the localization values from global.bcsv
It's a list of FNV1a hash mappings to the global.bcsv ones, so effectively retrieving a text value.
Encyclopedia now includes all the hash and string values of the english global.bcsv file. If known localization hash is found in the row of a FNV1a column, it will map it like:

(hash_value)Localization text

This will make A LOT EASIER to figure out how most of BCSV files work. For example, added the characer_readycolor.bcsv in the encyclopedia, which maps character waves in the character selection screen to a RGBA color. In this regard:

  • Fixed wrong datatype detection: float and int were reversed. Float is 0x1, int is 0x2;
  • Endianness is now detected automatically;
  • The datatype is appended in the columns now for easier readibility.

@Cri4Key

Cri4Key commented Mar 3, 2026

Copy link
Copy Markdown
Contributor Author

Updated the importer and added a raw option.

  • For research purposes the exported BCSV files are mapped to known values in the encyclopedia. Since taking filling the encyclopedia takes time anyway, and for ease of modding for BCSV files, added a -r argument to enable raw export of all values of the CSV
  • Importer has been updated: added support for PS3 BCSV files, and supports feeding in a raw mode with argument -r to parse raw values in a CSV. Column hashes and datatype are pulled from the CSV instead of the encyclopedia.

With these changes the tools now allow for either researching or full modding of the BCSV files for either PS3 or PSV version, without needing to have the BCSV documented in the encyclopedia.

The localization file global.bcsv seems to be the only BCSV not being handled correctly by the importer, surely due to some special structure and string encoding, but it's not currently a priority to fix.

@Cri4Key Cri4Key changed the title Use global as encyclopedia Export with encyclopedia global.bcsv lookups or raw, and update the Importer for PS3 support and raw exported CSV Mar 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant