Golang and Parquet files at TUNE Lab
Seattle, Washington, United States (Posted Nov 11 2015)
- Remote work possible
I am an experienced Golang engineer myself and working on a big data project with Spark. A key requirement is using Parquet formatted files.
There is this unfinished Go library that supports working with Parquet files here:
I am looking for a Golang engineer that can finish this library and get it working.
Skills & requirements
We have thousands of files on S3. This library would need to enable:
- a script to transform these on S3 in json format into Parquet formatted files
- be able to append data to existing Parquet files
We don't need to support
- nested data structures
- multiple data types in a single a column
The end result will be a forked version of the above that we will keep public.
Instructions how to apply
Email our Chief Product Officer, Lucas Brown, firstname.lastname@example.org
Please include details on your experience with Golang and/or Spark.
[ job website
Let them know you found the job via http://www.golangprojects.com
(Companies love to know what recruiting strategies that works)