Golang / Go Job: DevOps Engineer

DataSift

DevOps Engineer at DataSift

๐Ÿ‡ฌ๐Ÿ‡ง United Kingdom โ€บ Reading, Berkshire
  (Posted Aug 22 2015)

About the company
We are DataSift. The hottest Big Data platform company in the world.

And we mean - really really Big Data. Our platform processes billions of interactions from social networks, blogs and news sites every day.

We are on the cutting edge of how human-generated data (social, blog, news and business data) can be used by brands and application developers to get to know their customers better and build new products faster.
DataSift is rapidly growing and currently have more than 160 employees worldwide with offices in San Francisco, New York, Los Angeles, London and Reading, UK and Canada. We work with the biggest brands such as Bloomberg, CBS Interactive and Dell as well as thousands of application developers across a wide variety of industries including retail, telecommunications, high tech, consumer packaged goods and digital agencies. We are well-funded by amazing investors, including Scale Venture Partners, Upfront Ventures and IA Ventures.

Job position
Permanent

Job description
We plan on doubling in size over the next year, so we need your help. If youโ€™re up to the challenge, keep reading and apply.

As a DataSift engineer, you will have the opportunity to work on several different technology stacks, ranging from PHP/Web Development to Java/Data Warehousing, to C++/Processing Engine. Some of the challenges we get to work on daily range from Web Scaling to Distributed Systems to Big Data. Pretty much every system at DataSift works within our Service Oriented Architecture, with REST and ZMQ predominantly used for communication.

What you will be doing:

Deploying, maintaining and scaling DataSift's infrastructure and application

Work using our "monitor everything" principle, gathering metrics and taking appropriate action

Working closely with our systems automation framework, Chef

Diagnose issues with hardware, software, network and applications

Taking part in our 24x7 on-call rotation

Our stack:

At DataSift we process over 2 Billion tweets, posts and updates each day. This requires an incredibly solid and scalable infrastructure. To support this our tech stack looks like this;

Service-oriented architecture, communicating over ZMQ and REST

500+ CentOS physical servers in production

All servers entirely managed by Chef and Rundeck

Hadoop for bulk data storage

Arista switches and Cisco routers

Graphite and Riemann used for all levels of monitoring

A mix of open-source and in-house software, written in the right language for the job, ranging from C++, Golang and Scala to PHP and Python.

Extensive development and testing environment infrastructure running on Openstack

Skills & requirements
About you:

Passionate about Linux and Open Source technology and you strive to use up-to-date tools and techniques

Very comfortable working on the Linux command line and have a broad knowledge of the surrounding technologies

You have a 2:1 or higher Computer Science, Software Engineering or related degree or can demonstrate additional relevant experience

Significantly experienced working in an Operations or System Administration role

Practical knowledge of shell scripting and at least one of our primary languages (C++, Go, PHP, or Scala), or in Ruby, Python or Java

Experienced in monitoring systems or services, ideally using software such as Graphite, Riemann or collectd

Familiar with systems automation tools, such as Chef, Puppet or Ansible

You have a good understanding and passion for working with and optimising distributed systems

You have the ability to collaborate with and enjoy a small, intense team of engineers and business people

Strong verbal and written communication skills

Readiness to take responsibility and go the extra yard to hit a deadline

Useful extras:

Exposure to modern distributed systems software such as Hadoop, ZMQ, Elasticsearch, kafka or zookeeper.


 

Company: DataSift

DataSift
job info / career page
Location: Reading, Berkshire, United Kingdom

map of company location

Skills wanted, in addition to Golang:
devops ansible chef elasticsearch go
hadoop java kafka linux php
puppet python ruby scala zookeeper
centos golang

๐Ÿ‡ฌ๐Ÿ‡ง ๐Ÿ‡ช๐Ÿ‡บ Golang recruitment

Golang jobs recruiter
Based in UK / Europe and
prefer to let a Go recruiter
find your dream job?

Browse golang jobs from Vistas Recruitment
or
Get in touch with Martin &
let him know with what you are looking for

Other interesting golang jobs

Golang job Senior Software Engineer, Golang at Multi Media, LLC Senior Software Engineer, Golang - Multi Media, LLC   (January 2025)
Remote US, 100% Remote - Salary: $165,000 - $215,000
Multi Media, LLC is a leading provider of innovative online platforms and services, with Chaturbate as our flagship product. Our platform empowers independent broadcasters to engage with their fans th...
Golang job Senior Golang Backend Engineer at Salesforge Senior Golang Backend Engineer - Salesforge
Remote Europe, 100% Remote
Salesforge is hiring a Backend Engineer (5+ yrs) to build autonomous AI sales agents. Use APIs, message queues, and DBs (Go is a plus). Join our high-impact, no-BS team to redefine sales

Golang job Senior Go backend Developer at Cycloid Senior Go backend Developer - Cycloid
Remote Europe, 100% Remote
This role is fully remote, you can be located anywhere in Europe and UK. Hi there! Thanks for being here and letโ€™s get started. At Cycloid, We aim to promote efficient infrastructure & software ...

Golang job Senior / Staff Software Engineer, Fullstack at Knot Senior / Staff Software Engineer, Fullstack - Knot
NYC, New York, United States
Knotโ€™s mission is to empower consumers and businesses alike with connected merchant and banking experiences. Knot is like โ€œPlaid for merchant connectivity.โ€ We are building the platform connecti...

Golang job Senior Software Engineer - KSPM at Cast AI Senior Software Engineer - KSPM - Cast AI   (April 2025)
Remote Europe, 100% Remote - Salary: 78000- 108000 EUR gross
We are looking for a Senior Security Engineer to join our Security Team. In this role, you will propose new ideas and improvements, collaborate with peers on the architecture, and implement new softwa...
Not the Go job you are looking for?
Browse all Golang jobs and we're sure you will find a suitable one!
Browse Golang Jobs with similar combinations of skills
Golang jobs with devops Golang jobs with ansible Golang jobs with chef Golang jobs with elasticsearch Golang jobs with hadoop Golang jobs with java Golang jobs with kafka Golang jobs with linux Golang jobs with php Golang jobs with puppet Golang jobs with python Golang jobs with ruby Golang jobs with scala Golang jobs with zookeeper Golang jobs with centos
๐ŸŒ Remote golang jobs ๐Ÿ”Ž ๐Ÿ‡ฌ๐Ÿ‡ง ๐Ÿ‡ช๐Ÿ‡บ Golang recruiter ๐Ÿ“ง Golang jobs newsletter ๐Ÿ“Š Golang jobs statistics ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in United States ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in California ๐Ÿ‡ฌ๐Ÿ‡ง Golang jobs in United Kingdom ๐Ÿ‡ฌ๐Ÿ‡ง Golang jobs in London ๐Ÿ‡ฉ๐Ÿ‡ช Golang jobs in Germany ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in New York ๐Ÿ‡ธ๐Ÿ‡ช Golang jobs in Sweden ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in San Francisco, CA ๐Ÿ‡ฆ๐Ÿ‡บ Golang jobs in Australia ๐Ÿ‡ฆ๐Ÿ‡บ Golang jobs in Sydney ๐Ÿ‡ฉ๐Ÿ‡ช Golang jobs in Berlin ๐Ÿ‡ฎ๐Ÿ‡ณ Golang jobs in India ๐Ÿ‡ธ๐Ÿ‡ช Golang jobs in Stockholm ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in Texas ๐Ÿ‡จ๐Ÿ‡ฆ Golang jobs in Canada ๐Ÿ‡ฉ๐Ÿ‡ช Golang jobs in Hamburg ๐Ÿ‡ฎ๐Ÿ‡ณ Golang jobs in Bengaluru ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in NYC, NY ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in New York, NY ๐Ÿ‡บ๐Ÿ‡ธ Golang jobs in Mountain View, CA ๐Ÿ˜ Aws & Golang jobsโ˜ธ๏ธ Kubernetes & Golang jobs๐Ÿ Python & Golang jobs๐Ÿณ Docker & Golang jobsโ˜๏ธ Gcp & Golang jobs๐Ÿค– Ai & Golang jobs๐ŸŽ›๏ธ Microservices & Golang jobs๐Ÿช› Terraform & Golang jobsโ˜๏ธ Azure & Golang jobsโ˜• Java & Golang jobs๐ŸŸฆ Typescript & Golang jobsโœ‰๏ธ Kafka & Golang jobs๐Ÿ—„๏ธ Sql & Golang jobs๐Ÿ—„๏ธ Postgresql & Golang jobs๐Ÿง‘โ€๐Ÿ’ป Devops & Golang jobsโš™๏ธ Saas & Golang jobsโš›๏ธ React & Golang jobs๐Ÿง Linux & Golang jobsโ†”๏ธ Grpc & Golang jobs๐Ÿ—„๏ธ Postgres & Golang jobs๐Ÿ“‚ Redis & Golang jobs๐Ÿด Git & Golang jobsโš™๏ธ Rust & Golang jobsโ˜• Javascript & Golang jobs