Big Data Engineer (NYC)

New York, NY 10012

Post Date: 04/27/2018 Job ID: 10348 Category: Data

                                                                    Senior   Big Data Engineer

 

New York, NY

Full-time

Our Client is a market structure technology provider focused on delivering high

performance trading technologies and big data solutions to financial market participants.

They are looking for a self-motivated contributor who is passionate about supporting and building

high-quality tools and systems. This person will help develop a new product in the domain of big

data analytics on financial data. The role involves combining cutting-edge open source and

proprietary technology to support back-end systems written in Apache Spark, Python, and Scala. The

role will also help improve supporting tools and infrastructure, create fast build systems, and improve

workflows, with a persistent emphasis on pushing the limits of scalability and performance.

Responsibilities
  • Using dynamic programming languages, such as Scala and Python to architect, implement and

integrate data analytics tools for financial markets
  • Proactively assisting other developers in diagnosing and solving issues with development and build environments
  • Establishing and improving infrastructure in support of production, QA, and development systems
  • Implementation of system monitoring infrastructure and tools, including dashboards
  • Monitoring systems for issues in real-time, responding to them as they occur, and working

proactively to minimize future issues
  • Level 3 support Requirements

Qualifications
  • 5+ years of experience building large scale big data applications (spark streams, kafka streams,

HDFS internals)
  • Proactive with a high attention to detail and ability to manage multiple projects simultaneously
  • Strong working knowledge of the Linux operating system, including basic system administration

and a high degree of comfort working from the command line
  • Experience with version control software and SDLC principles
  • Strong programming skills using Scala and Python
  • Experience with containers, orchestration and CI/CD pipelines
  • Experience with Open Source software including Puppet, Jenkins, Nagios, GNU make, Redmine,

OpenLDAP, FreeRADIUS, BIND, collectd, Graphite, Grafana, Hypertable, consul, zookeeper, and
  • PostgreSQL are a bonus
  • Financial experience is not required
Scala, Python, Apache, Kafka, Data Analytics

Evan Pollock


Not ready to apply?

Send an email reminder to:

Share This Job:

Related Jobs: