Skip to content

Latest commit

History

119 Commits

Folders and files

NameName
Last commit message
Last commit date

Repository files navigation

Kola Saami Christian Text Corpus (KSCTC)

Current version: Alpha (not released yet)

This is a repository including written data collected and/or annotated by Kola Saami Documentation Project (KSDP).

Authors and credits

The originator of the dataset and administrator of this project is Michael Rießler. The second main author is Ilia Egorov.

The paper Rießler 2024 includes a more complete description. If you use the data, please cite this paper (see the bibtex code snippet below).


@incollection{riesler2024a,
address = {Helsinki},
author = {Rie{\ss}ler, Michael},
booktitle = {Proceedings of the 9th International Workshop on Computational Linguistics for Uralic Languages},
editor = {H{\"a}m{\"a}l{\"a}inen, Mika and Pirinen, Flammie and Macias, Melany and Avila, Mario Crespo},
pages = {138-144},
publisher = {ACL},
title = {Kola Saami Christian Text Corpus},
url = {https://aclanthology.org/2024.iwclul-1.18},
year = {2024}}

License, data reuse, and collaboration

The corpus data in this repository are free and open and licensed under CC-BY, see LICENSE. Other parts of the corpus – under bound licenses – are found in KSCTC-bound, which is a private repository and visible only to project collaborators.

If you are interested in collaboration, contact Michael Rießler. Collaborators must acknowledge the terms of use by signing the Code of Conduct (in the works).

Data format

The data is modelled in XLM using the corpus tool ELAN.

Tiers included are

  • "ref" - project-internal ID for each single chunk
  • "ref(orig)" - if applicable: verse number (Gospel of Matthew and Lord's Prayer) as location for parallelization
  • "orth(orig_)" - original text in original script ( refers to an ID in the Bibliography); there can be more than one original texts included, e.g. in case of reprints of the same texts or different transcripts/transliterations of the same texts
  • "orth" - normalized orthography
  • "ft-rus(orig_)" - if applicable: original Russian text on which the translation is based ( refers to an ID in the Bibliography)

Metadata

Basic metadata can be extracted from the overview below. Bibliographic metadata about the text sources is found in Bibliography. Personal metadata about the text originators is included in the tier names in each individual session (e.g. "PAP1821m" is a male person born 1821, "AAA1932f" is a female person born 1932).

Corpus statistics

Focus of our work so far has been on the Kildin Saami (sjd) subset in contemporary orthography. Genetz's original texts are not fully complete yet. Akkala Saami (sia) and Skolt Saami (sms) data are not included yet.

The following table provides an overview of the included data and the state of their completion. Below are more explanations of this table.

SessionDescriptionTokensStatusUse
sia18760800_bibleMATTHEW1878a-23Matthew 23free
sia18760800_bibleMATTHEW1878a-24Matthew 24free
sia18760800_bibleMATTHEW1878a-25Matthew 25free
sia18760800_bibleMATTHEW1878a-26Matthew 26free
sia18760800_bibleMATTHEW1878a-27Matthew 27free
sia18760800_bibleMATTHEW1878a-28Matthew 28free
sia18760800_genetz1879a-23Matthew 23free
sia18760800_genetz1879a-24Matthew 24free
sia18760800_genetz1879a-25Matthew 25free
sia18760800_genetz1879a-26Matthew 26free
sia18760800_genetz1879a-27Matthew 27free
sia18760800_genetz1879a-28Matthew 28free
sjd18280000_sjogren1828a-LordsPrayerLord's Prayer59finishedfree
sjd18760800_bibleMATTHEW1878a-00TitleImprint2finishedfree
sjd18760800_bibleMATTHEW1878a-00TitlepageImprint19finishedfree
sjd18760800_bibleMATTHEW1878a-01Matthew 1323finishedfree
sjd18760800_bibleMATTHEW1878a-02Matthew 2444finishedfree
sjd18760800_bibleMATTHEW1878a-03Matthew 3281finishedfree
sjd18760800_bibleMATTHEW1878a-04Matthew 4404finishedfree
sjd18760800_bibleMATTHEW1878a-05Matthew 5822finishedfree
sjd18760800_bibleMATTHEW1878a-06Matthew 6664finishedfree
sjd18760800_bibleMATTHEW1878a-07Matthew 7497finishedfree
sjd18760800_bibleMATTHEW1878a-08Matthew 8546finishedfree
sjd18760800_bibleMATTHEW1878a-09Matthew 9639finishedfree
sjd18760800_bibleMATTHEW1878a-10Matthew 10679finishedfree
sjd18760800_bibleMATTHEW1878a-11Matthew 11517finishedfree
sjd18760800_bibleMATTHEW1878a-12Matthew 12847finishedfree
sjd18760800_bibleMATTHEW1878a-13Matthew 131002finishedfree
sjd18760800_bibleMATTHEW1878a-14Matthew 14528finishedfree
sjd18760800_bibleMATTHEW1878a-15Matthew 15583finishedfree
sjd18760800_bibleMATTHEW1878a-16Matthew 16517finishedfree
sjd18760800_bibleMATTHEW1878a-17Matthew 17483finishedfree
sjd18760800_bibleMATTHEW1878a-18Matthew 18639finishedfree
sjd18760800_bibleMATTHEW1878a-19Matthew 19556finishedfree
sjd18760800_bibleMATTHEW1878a-20Matthew 20579finishedfree
sjd18760800_bibleMATTHEW1878a-21Matthew 21822finishedfree
sjd18760800_bibleMATTHEW1878a-22Matthew 22625finishedfree
sjd18760800_genetz1879a-01Matthew 1328finishedfree
sjd18760800_genetz1879a-05Matthew 5825finishedfree
sjd18760800_genetz1879a-07Matthew 7498finishedfree
sjd18760800_genetz1879b-01Matthew 1328finishedfree
sjd18760800_genetz1879b-02Matthew 2450finishedfree
sjd18760800_genetz1879b-05Matthew 5825finishedfree
sjd18760800_genetz1879b-07Matthew 7498finishedfree
sjd18760800_genetz1891a-kilb05Matthew 5824finishedfree
sjd18760800_genetz1891a-kilb06Matthew 6633finishedfree
sjd18760800_genetz1891a-kilb07Matthew 7497finishedfree
sjd19960000_arapovic1996a-00ContentImprint152finishedfree
sjd19960000_arapovic1996a-00FrontImprint3finishedfree
sjd19960000_arapovic1996a-00ImprintImprint80finishedfree
sjd19960000_arapovic1996a-00TitleImprint13finishedfree
sjd19960000_arapovic1996a-02AnnunciationJesus260finishedacad
sjd19960000_arapovic1996a-04BirthJesus191finishedacad
sjd19960000_arapovic1996a-06ShepherdsJesus240finishedacad
sjd19960000_arapovic1996a-08AdorationJesus251finishedacad
sjd19960000_arapovic1996a-10ExileJesus275finishedacad
sjd19960000_arapovic1996a-12DisciplinesJesus253finishedacad
sjd19960000_arapovic1996a-14SamaritanJesus289finishedacad
sjd19960000_arapovic1996a-16Sermon-BeatitudesJesus259finishedacad
sjd19960000_arapovic1996a-18Sermon-LoveJesus407finishedacad
sjd19960000_arapovic1996a-19LordsPrayerJesus63finishedacad
sjd19960000_balakinaEtAl2019a-LordsPrayerLord's Prayer63acad
sjd19960000_arapovic1996a-20SowerJesus214finishedacad
sjd19960000_arapovic1996a-22StormJesus132finishedacad
sjd19960000_arapovic1996a-24RaisingJesus282finishedacad
sjd19960000_arapovic1996a-24Raising-FnJesus10finishedacad
sjd19960000_arapovic1996a-26FeedingJesus196finishedacad
sjd19960000_arapovic1996a-28GoodSamaritanJesus227finishedacad
sjd19960000_arapovic1996a-28GoodSamaritan-FnJesus6finishedacad
sjd19960000_arapovic1996a-30GoodShepherdJesus287finishedacad
sjd19960000_arapovic1996a-32LostSheepJesus144finishedacad
sjd19960000_arapovic1996a-34ProdigalJesus150finishedacad
sjd19960000_arapovic1996a-36ReturnJesus234finishedacad
sjd19960000_arapovic1996a-38BlessesJesus122finishedacad
sjd19960000_arapovic1996a-40BlindJesus165finishedacad
sjd19960000_arapovic1996a-42ZacchaeusJesus197finishedacad
sjd19960000_arapovic1996a-44CommandmentJesus114finishedacad
sjd19960000_arapovic1996a-46SupperJesus164finishedacad
sjd19960000_arapovic1996a-48GethsemaneJesus245finishedacad
sjd19960000_arapovic1996a-50ArrestJesus208finishedacad
sjd19960000_arapovic1996a-52PilatusJesus310finishedacad
sjd19960000_arapovic1996a-54CrucifixionJesus351finishedacad
sjd19960000_arapovic1996a-56BurialJesus266finishedacad
sjd19960000_arapovic1996a-56Burial-FnJesus14finishedacad
sjd19960000_arapovic1996a-58RisenJesus218finishedacad
sjd19960000_arapovic1996a-60AscentJesus195finishedacad
sjd19960000_arapovic1996a-62WayJesus344finishedacad
sjd19960000_bibleLORDMATTHEW1996aLord's Prayer63finishedfair
sjd20050300_saam2005-03PrayerPrayer70finishedfair
sjd20020900_saam2002-03PrayerPrayer69finishedfair
sjd20080000_ermolaeva2010a-00TitleImprint5finishedfree
sjd20080000_ermolaeva2010a-01Matthew 1322finishedfair
sjd20141008_bibleLORDMATTH2022bLord's Prayer58finishedfair
sjd20220300_bibleAPOSTLES2022aApostles' Creed71finishedfair
sjd20220300_bibleLORDMATTH2022aLord's Prayer60finishedfair
sjd20220300_bibleMATTHEW2022a-00ImprintImprint56finishedfree
sjd20220300_bibleMATTHEW2022a-00TitleImprint10finishedfree
sjd20220300_bibleMATTHEW2022a-01Matthew 1315finishedbound
sjd20220300_bibleMATTHEW2022a-02Matthew 2392finishedbound
sjd20220300_bibleMATTHEW2022a-03Matthew 3269finishedbound
sjd20220300_bibleMATTHEW2022a-04Matthew 4385finishedbound
sjd20220300_bibleMATTHEW2022a-05Matthew 5771finishedbound
sjd20220300_bibleMATTHEW2022a-06Matthew 6619finishedbound
sjd20220300_bibleMATTHEW2022a-07Matthew 7466finishedbound
sjd20220300_bibleMATTHEW2022a-08Matthew 8521finishedbound
sjd20220300_bibleMATTHEW2022a-09Matthew 9612finishedbound
sjd20220300_bibleMATTHEW2022a-10Matthew 10643finishedbound
sjd20220300_bibleMATTHEW2022a-11Matthew 11465finishedbound
sjd20220300_bibleMATTHEW2022a-12Matthew 12795finishedbound
sjd20220300_bibleMATTHEW2022a-13Matthew 13938finishedbound
sjd20220300_bibleMATTHEW2022a-14Matthew 14486finishedbound
sjd20220300_bibleMATTHEW2022a-15Matthew 15534finishedbound
sjd20220300_bibleMATTHEW2022a-16Matthew 16464finishedbound
sjd20220300_bibleMATTHEW2022a-16L2Matthew 16:22-28127finishedfair
sjd20220300_bibleMATTHEW2022a-17Matthew 17438finishedbound
sjd20220300_bibleMATTHEW2022a-18Matthew 18622finishedbound
sjd20220300_bibleMATTHEW2022a-19Matthew 19536finishedbound
sjd20220300_bibleMATTHEW2022a-20Matthew 20536finishedbound
sjd20220300_bibleMATTHEW2022a-21Matthew 21779finishedbound
sjd20220300_bibleMATTHEW2022a-22Matthew 22594finishedbound
sjd20220300_bibleMATTHEW2022a-23Matthew 23643finishedbound
sjd20220300_bibleMATTHEW2022a-24Matthew 24736finishedbound
sjd20220300_bibleMATTHEW2022a-25Matthew 25700finishedbound
sjd20220300_bibleMATTHEW2022a-26Matthew 261106finishedbound
sjd20220300_bibleMATTHEW2022a-27Matthew 271228finishedbound
sjd20220300_bibleMATTHEW2022a-28Matthew 28309finishedbound
sjd20220300_scheller2022aPreface559finishedbound
sms18940000_bibleMATTHEW1894a-02Matthew 2545free
sms18940000_bibleMATTHEW1894a-00TitleImprint3finishedfree
sms18940000_bibleMATTHEW1894a-00ImprintImprintfree
sms18940000_bibleMATTHEW1894a-01Matthew 1free

Session

  • Points to the file name
    • The language is indicated (as ISO) in the first three letters of the file name.
    • The second section of the file name indicates the (known or estimated) date of origin, at least the year.
    • The third section (after underscore) includes a pointer to the Bibliography, where the original text sources are listed.
    • The fourth section (if applicable, after hyphen) indicates sub-sets (e.g. for footnotes or Matthew 16:22-28).

Description

  • See more metadata in the respective CMDI files (work in progress).

Tokens

  • Word token count

Status

  • Data marked as "finished" includes data in the minimal tier set (ref, [ref(orig)], orth(orig), [ft-rus(orig)]; read the paper for more detail).

Use

  • Data marked as "bound" must not be re-published or shared in any way outside this project because copyright applies. These data can, however, be analysed and processed by project collaborators.
  • Data marked as "acad" are under copyright and not made freely available via the present repository . But they can be used under an academic license, which is handled by the Language Bank of Finland.
  • Data marked as "fair" are technically also under copyright. But the nature of these texts (especially Lord's Prayer), their earlier distribution, or other reasons allow their use as open corpus data in research, in our opinion.
  • Data marked as "free" are either in the Open Domain or do not meet the threshold of originality (book imprints, title pages, etc.).

ISSUES

  • fix encoding issues, e.g. ӯ (to ӯ) and similar
  • fix OCR issues, e.g. ending -ень (to -енҍ)

TODO

Planned improvements in the data

  • finnish the Kildin Saami data
  • finnish the parallel data
  • one more round of proofreading?

Planned improvements at the platform level

  • Website
  • Pipeline: sjd-fair --> KSCTC
  • validation scripts
  • dynamic corpus statistics
  • metadata links to Wikidata

Open questions

  • what to do with letter η in Cyrillic (Genetz), using Greek or Latin?

About

Kola Saami Christian Text Corpus

Resources

Stars

1 star

Watchers

3 watching

Forks

Releases

Packages

Used by

Contributors

Languages