Skip to content

Scalding for Processing Images #3

@anilmuppalla

Description

@anilmuppalla

Hi,

My work flow is:

Job1:
A list of images => A Binary Sequence File

I have gotten so far:

class TestImageJob(args : Args) extends Job(args) {
implicitly[Mode] match {
case Hdfs(_, configuration) => {

  TextLine(args("input"))
  .map('line , 'image){
    line : String =>
    val fs = FileSystem.get(URI.create(line), configuration)
    val in = fs.open(new Path(line))
    IOUtils.toByteArray(in)

  }  
  .project('image)
  .write(SequenceFile(args("output")))
  }  
}  

But this doesn't seem to be working!
Job2:
The Binary Sequence File => Images

I have the code for this using Java Hadoop

Job1: http://pastebin.com/m1EuBaqj
Job2: http://pastebin.com/Y6gZZkmi

Thanks,
Anil

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions