Golang / Go Job: Golang and Parquet files

TUNE Lab

Golang and Parquet files at TUNE Lab

Seattle, Washington, United States 🇺🇸   (Posted Nov 11 2015)

Job position
Project based - Remote work possible

Job description
I am an experienced Golang engineer myself and working on a big data project with Spark. A key requirement is using Parquet formatted files.

There is this unfinished Go library that supports working with Parquet files here:

https://github.com/kostya-sh/parquet-go

I am looking for a Golang engineer that can finish this library and get it working.

Skills & requirements
We have thousands of files on S3. This library would need to enable:

- a script to transform these on S3 in json format into Parquet formatted files

- be able to append data to existing Parquet files

We don't need to support

- nested data structures

- multiple data types in a single a column

The end result will be a forked version of the above that we will keep public.

Instructions how to apply
Email our Chief Product Officer, Lucas Brown, lucas@tune.com

Please include details on your experience with Golang and/or Spark.
[ job website ]

Let them know you found the job via https://www.golangprojects.com
(Companies love to know recruiting strategies that work)
 

Other jobs that might be interesting

MaxMind, Inc. Site Reliability Engineer - Telecommuting Opportunity (U.S./Canada) - MaxMind, Inc.   (December 2018)
Waltham, Massachusetts, United States (Remote possible)
MaxMind (www.maxmind.com) is looking for a talented Site Reliability Engineer (SRE) to join our Engineering team. We help protect thousands of companies worldwide from fraud, screening over 2 billion online transactions each year, and we provide IP intelligenc...
SendGrid Senior Core Platform Engineer - SendGrid   (December 2018)
Redwood City, California, United States
At SendGrid, we send over 1 billion emails every day across the globe, and our Core Platform team designs and develops the software foundation that enables the rest of engineering to achieve this scale. While we leverage and augment Open Source solutions wher...
Tigera Senior Software Engineer - Golang - SF Bay Area, Vancouver, or Remote (North America) - Tigera   (December 2018)
San Francisco, California, United States (Remote possible)
Tigera is looking for passionate and skilled software engineers to join us in our mission to secure the next generation of cloud native applications. At the heart of our strategy is a set of open source networking and security projects (currently Calico, flann...

 
About Golangprojects