Golang / Go Job: Golang and Parquet files


TUNE Lab

Golang and Parquet files at TUNE Lab

Seattle, Washington, United States ๐Ÿ‡บ๐Ÿ‡ธ   (Posted Nov 11 2015)

Job position
Project based - Remote work possible

Job description
I am an experienced Golang engineer myself and working on a big data project with Spark. A key requirement is using Parquet formatted files.

There is this unfinished Go library that supports working with Parquet files here:

https://github.com/kostya-sh/parquet-go

I am looking for a Golang engineer that can finish this library and get it working.

Skills & requirements
We have thousands of files on S3. This library would need to enable:

- a script to transform these on S3 in json format into Parquet formatted files

- be able to append data to existing Parquet files

We don't need to support

- nested data structures

- multiple data types in a single a column

The end result will be a forked version of the above that we will keep public.

Instructions how to apply
Email our Chief Product Officer, Lucas Brown, lucas@tune.com

Please include details on your experience with Golang and/or Spark.
[ job website ]

Let them know you found the job via https://www.golangprojects.com
(Companies love to know what recruiting strategies that works)
 

Company: TUNE Lab


Other jobs that might be interesting

Movere Software Engineer (Golang) - Movere   (June 2018)
Bellevue, Washington, United States
A typical week in your new life: Mondays will be focused on our Inventory bots. They are designed to capture system and software data from vms, hypervisors, workstations, and even containers running on Windows and Linux. Tuesday is all about monitoring. Our ...
Igneous Systems Senior Software Engineer - Systems - Igneous Systems   (May 2018)
Seattle, Washington, United States
Weโ€™re looking for passionate Systems Engineers to join our team working on complex distributed systems with a focus on scale, performance, security, and availability. We work primarily in Go! Will you will love it as a Systems Engineer on our team? We thi...
Senior Software Engineer โ€“ Applications (Golang) - Igneous Systems   (May 2018)
Seattle, Washington, United States
Join us as a Senior Applications Engineer and you will be a key part of our high energy, collaborative, customer-obsessed team. You'll be integrated in building the enterprise applications that drive our data storage and protection platform, while having the o...


 
Golangprojects on Twitter Golangprojects on Facebook Golangprojects at Google+ Golangprojects as rss About Golangprojects