Authority file: correct entries (inlcuding Arabic)

[tillgrallert]

There are multiple issues with names in the authority file that will require fixing.

1. The automatically generated translation of Latin into Arabic script needs to be corrected. Particularly for names that were not originally Arabic. Due to the mark-up in the original master file, these could not be filtered out beforehand. They can be found with some regex, I suppose, because the automatic translation often contains a mix of Arabic and Latin characters within a single word:

<persName xml:lang="ar-Latn-x-ijmes">Isaac Temām</persName>
<persName change="#d2e154" xml:lang="ar">اسc تeمام</persName>

2. Some <persName> nodes contain multiple names separated by /. These need to be split into individual <persName> children of the containing <person> element.

3. DONE Quite a few <persName>s do not carry an @xml:lang attribute and have, therefore, not been translated into Arabic script. @xml:lang needs to be added first and then we re-run the translation script.

[tillgrallert]

IMPORTANT NOTE: when cleaning the authority file and resolving duplicates, do not delete any IDs. Instead, unified entities should gather all IDs of the former duplicates. This is necessary because the master file links to these IDs and the links will be broken when IDs are deleted.

[Mestyan]

fantastic @tillgrallert I hope that you & family are safe in Beirut. I will turn to this at EST night. Question: if I clean authority file is the master automatically repopulated?

[tillgrallert]

Dear @Mestyan, yes, we are safe. Mainly because I travelled to Beirut alone ;-) Concerning your actual question, the master file has to be actively updated from the authority file.

[Mestyan]

Great! So I guess the best is to clean the authority file first?

…

On Nov 7, 2020, at 7:29 AM, Till Grallert ***@***.***> wrote: Dear @Mestyan <https://github.com/Mestyan>, yes, we are safe. Mainly because I travelled to Beirut alone ;-) Concerning your actual question, the master file has to be actively updated from the authority file. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#86 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFTHW4VO62K7RZJMPMFXCTDSOU4SRANCNFSM4TNRFAOA>.

[tillgrallert]

The good thing is one can rerun the scripts at any one point. Therefore, there is no need to clean the authority file first. We can work incrementally instead.

[tillgrallert]

I fixed point 3 in the above issue description.

[Mestyan]

@tillgrallert I merged to master and I also merged my little additions of holdings from the last two days in gh-pages. There was a conflict but I checked and edited. Please fetch - just to be up-to-date! So I work solely on corrections in the master file (on gh-pages). I will also test the CETEIcean transformation and the JS needed to represent the new Arabic data. Very exciting!

[Mestyan]

Couple of questions:

1. The authority file is not valid because there are two duplicate xml:id :
   "persName_525.d5e2753"
   "persName_528.d5e2768"
   what is the right method to correct this? can I delete them or overwrite them?

[Mestyan]

2. is there a way I can identify the journal title in the authority file to which the name belongs in the authority file ?

[Mestyan]

3. Can you try the Arabization of orgNames? Or, I can just start to add them manually but then, how should I generate xml:ids?

[tillgrallert]

Dear Adam,

1. duplicate @xml:id can be manually changed and shouldn't break anything. They are automatically generated and apparently the code to do so isn't fool proof.
2. I am afraid I don't understand the question. The set-up is thus that the authority file has no knowledge of any other files (master or not). It only provides (long) lists of people, organisations, and places which other files can link to through their respective IDs (as recorded in the <idno type="jaraid"> children).
3. <orgName>s have already been Arabized. What still needs to be done is linking the master file to the authority file. So you can edit the <orgList> in the authority file like everything else. Please take not that quite a few <person> elements are indeed organisations and I have marked some of them with comments (<!-- ... -->). I will try and add the code to point from <orgName>s in the master file to the authority file over the coming days.

[Mestyan]

1. excellent
2. OK - for the cleaning purposes I always have to see the full entry in master to which the authority persName etc belongs. This is not a big deal just a tiny bit of changing windows and searching
3. great, I will edit as well !

[Mestyan]

With the persName I follow our principle with the titles and if the original is an English/French/Italian etc in Latin characters then I just correct all of its versions into Latin characters, and correct the xml:lang attributes as well, OK? @tillgrallert