Golang / Go Job: Golang and Parquet files

TUNE Lab

Golang and Parquet files at TUNE Lab

Seattle, Washington, United States 🇺🇸   (Posted Nov 11 2015)

Job position
Project based - Remote work possible

Job description
I am an experienced Golang engineer myself and working on a big data project with Spark. A key requirement is using Parquet formatted files.

There is this unfinished Go library that supports working with Parquet files here:

https://github.com/kostya-sh/parquet-go

I am looking for a Golang engineer that can finish this library and get it working.

Skills & requirements
We have thousands of files on S3. This library would need to enable:

- a script to transform these on S3 in json format into Parquet formatted files

- be able to append data to existing Parquet files

We don't need to support

- nested data structures

- multiple data types in a single a column

The end result will be a forked version of the above that we will keep public.

Instructions how to apply
Email our Chief Product Officer, Lucas Brown, lucas@tune.com

Please include details on your experience with Golang and/or Spark.
[ job website ]

Let them know you found the job via https://www.golangprojects.com
(Companies love to know recruiting strategies that works)
 

Other jobs that might be interesting

Tigera Senior Software Engineer - Golang - SF Bay Area or Remote (North America) - Tigera   (October 2018)
San Francisco, California, United States (Remote possible)
Tigera is looking for passionate and skilled Golang software engineers to join us in our mission to secure the next generation of cloud native applications. At the heart of our strategy is a set of open source networking and security projects (currently Calico...

Western Digital Backend Software Engineer, GoLang - Western Digital   (October 2018)
Redwood City, California, United States
We’re looking for a talented and passionate engineer to join our Backend Software team. You will design and implement new services and features of our core software that runs on a multitude of servers and handles massive amounts of network traffic and user d...
Backend Engineering roles @ WeWork in SF - WeWork   (October 2018)
San Francisco, California, United States
Hello, I am Kevin an Engineering Manager at WeWork. We are looking for engineers to help build out our next generation Identity system in San Francisco. Check out how we choose to use Go as our language choice at Choosing a (Language) Stack. Today, 260,000+ M...
 
About Golangprojects