Golang / Go Job: Senior Data Engineer (Hybrid / Remote)

Senior Data Engineer (Hybrid / Remote) at Kaiko

🇫🇷 France › Paris   (Posted Apr 19 2022)

Please mention that you found the job at Golangprojects.com

Apply now!  

Do they allow remote work?
Remote work is possible, see the description below for more information.

Job description
The Challenge

You will be joining a fast-paced engineering team made up of people with significant experience working with terabytes of data. We believe that everybody has something to bring to the table, and therefore put collaborative effort and team-work above all else (and not just from an engineering perspective).

You will be able to work autonomously as an equally trusted member of the team, and participate in efforts such as:

Addressing high availability problems: cross-region data replication, disaster recovery, etc.

Addressing “big data” problems: 200+ millions of messages/day, 160B data points since 2010 (currently growing at a rate of 10B per month).

Improving our development workflow, continuous integration, continuous delivery and in a broader sense our team practices

Expanding our platform’s observability through monitoring, logging, alerting and tracing

What you’ll doing

Design, develop and deploy scalable and observable backend microservices

Reflect on our storage, querying and aggregation capabilities, as well as the technologies required to meet our objectives

Work hand-in-hand with the business team on developing new features, addressing issues and extending the platform

Our tech stack

Monitoring: VictoriaMetrics, Grafana

Alerting: AlertManager, Karma, PagerDuty

Logging: Vector, Loki

Caching: FoundationDB, Redis

Secrets management and PKI: Vault

Configuration management and provisioning: Terraform, Ansible

Service discovery: Consul

Messaging: Kafka

Proxying: HAProxy, Traefik

Service deployment: Terraform, Nomad (plugged in Consul and Vault), Kubernetes (to a lesser extent, used for non production critical workloads)

Database systems: ClickHouse (main datastore), PostgreSQL (ACID workloads)

Protocols: gRPC, HTTP (phasing out in favor of gRPC), WebSocket (phasing out in favor of gRPC)

Platforms (packaged in containers): Golang, NodeJS (phasing out in favor of Golang), Ruby (phasing out in favor of Golang)

About You

Significant experience as a Software/Data/DevOps Engineer

Knowledgeable about data ingestion pipelines and massive data querying

Worked with, in no particular order: microservices architecture, infrastructure as a code, self-managed services (eg. deploy and maintain our own databases), distributed services, server-side development, etc

You’ll notice that we don’t have any “hard” requirements in terms of development platforms or technologies: this is because we are primarily interested in people capable of adapting to an ever changing landscape of technical requirements, who learn fast and are not afraid to constantly push our technical boundaries.

It is not uncommon for us to benchmark new technologies for a specific feature, or to change our infrastructure in a big way to better suit our needs.

The most important skills for us revolve around two things:
What we like to call “core” knowledge: what’s a software process, how does it interact with a machine’s or the network’s resources, what kind of constraints can we expect for certain workloads, etc
How fast you can adapt to a technology you didn’t know existed 10 minutes ago

In short, we are looking for someone able to spot early on that spending 10 days to migrate data to a more efficient schema is the better solution compared to scaling out a database cluster in a matter of minutes if we are looking to improve performance in the long term.

Nice to have
Experience with data scraping over HTTP, WebSocket, and/or FIX Protocol
Experience developing financial product methodologies for indices, reference rates, and exchange rates
Knowledgeable about the technicalities of financial market data, such as the difference between: calls, puts, straddles, different types of bonds, swaps, CFD, CDS, options, futures, etc

Personal Skills
Honest: receiving and giving feedback is very important to you
Humble: making new errors is an essential part of your journey
Empathetic: you feel a sense of responsibility for all the team’s endeavors rather than focus on individual contributions
Committed: as an equally important member of the team, you want to make yourself heard while respecting everybody’s point of view
Fluent in written and spoken English
You have the utmost respect for legacy code and infrastructure, with some occasional and perfectly understandable respectful complaints

What we offer
An entrepreneurial environment with a lot of autonomy and responsibilities
Opportunity to work with an internationally diverse team
Hardware of your choice
Perks: meal vouchers, multiple team events and staff surprises

Process
Introduction call (30mins)
Meeting with members of the team for a technical/product RPG: you read that right, no written test, no whiteboard quicksort implementation (1h30)
Cross team interviews (2-3 persons, 45m x2)
Meeting with VP of Engineering (20m)

As our working language is English, we would appreciate it if you send us your application and any accompanying documents in English.

Location
On-site in our Paris office, or full remote (+- 2h maximum with CET).

Please mention that you found the job at Golangprojects.com

Apply now!