Distributed NLP training pipeline on Apache Spark and DL4J that prepares data with sliding windows, adds positional embeddings and trains Word2Vec in parallel.
apache-spark tensorflow word2vec scalatest dl4j deeplearning4j sliding-window llm llm-training logback-classic mapreduce-scala
-
Updated
Aug 26, 2025 - Scala