Golang / Go Job: Golang and Parquet files


TUNE Lab

Golang and Parquet files at TUNE Lab

Seattle, Washington, United States 🇺🇸   (Posted Nov 11 2015)

Job position
Project based - Remote work possible

Job description
I am an experienced Golang engineer myself and working on a big data project with Spark. A key requirement is using Parquet formatted files.

There is this unfinished Go library that supports working with Parquet files here:

https://github.com/kostya-sh/parquet-go

I am looking for a Golang engineer that can finish this library and get it working.

Skills & requirements
We have thousands of files on S3. This library would need to enable:

- a script to transform these on S3 in json format into Parquet formatted files

- be able to append data to existing Parquet files

We don't need to support

- nested data structures

- multiple data types in a single a column

The end result will be a forked version of the above that we will keep public.

Instructions how to apply
Email our Chief Product Officer, Lucas Brown, lucas@tune.com

Please include details on your experience with Golang and/or Spark.
[ job website ]

Let them know you found the job via https://www.golangprojects.com
(Companies love to know recruiting strategies that works)
 

Company: TUNE Lab


Other jobs that might be interesting

ETCDEV Team Sr Go Engineer - ETCDEV Team   (August 2018)
Remote, United States (Remote possible)
Ethereum Classic is an independent community driven blockchain continued after EF (a foundation originally started Ethereum blockchain) moved to a separate fork by introducing censoring transactions into their blockchain. Ethereum Classic community opposed tha...
TreeTop Commons Lead Software Developer - TreeTop Commons   (July 2018)
Portland, Oregon, United States
We are hiring a Lead Software Developer with solid technical project management skills who brings both a reputation for strong collaboration and communication, as well as building reliable, well-constructed software. In this role, you will partner with our Di...
Polyverse Software Engineer - Polyverse   (July 2018)
Seattle, Washington, United States
If you're an exceptional software engineer that excels when challenged to invent elegant solutions to really hard problems, let's talk! Our flagship product is polymorphic versions of popular Linux distros. We deliver uniquely compiled packages for every cust...


 
Golangprojects on Twitter Golangprojects on Facebook Golangprojects at Google+ Golangprojects as rss About Golangprojects