SecurityScorecard Senior Data Engineer - Spark expertise - NYC or Remote North America

About Us

The SecurityScorecard ratings platform helps enterprises across the globe manage the cyber security posture of their vendors. Our SaaS products have created a new category of enterprise software and our culture has helped us be recognized as one of the 10 hottest SaaS startups in NY for two years in a row. Our investors include both Sequoia and Google Ventures. We are scaling quickly but are ever mindful of our people and products as we grow.

This role will be based in our HQ in NYC, or remote (home office) i North America.

Position Summary

The Senior Data Analytics Engineer will build meaningful analytics that inform companies of security risk.  You will be working closely with our Data Science team, implementing algorithms and managing the analytic pipeline. We have over 1 PB of data, so the ideal candidate will have experience processing and querying large amounts of data.  

Responsibilities

• Manage the analytic pipeline using Spark, Hadoop, etc 


• Leverage cutting-edge technologies to support new and existing and services and processes.


• Quickly and efficiently design and implement in an agile environment


• Work with other team members to implement consistent architecture


• Drive projects through all stages of development


• Actively share knowledge and responsibility with other team members and teams


• Improve the effective output of the engineering team by managing quality, and identifying inconsistencies.  

Skills and Experience:

• Bachelor's degree (CS, EE or Math preferred) or equivalent work experience as well as interest in a fast paced, complex environment.


• 5+ years of experience Scala or another functional language experience in a commercial environment (highly preferred)


• 3+ Experience with Spark, and the Hadoop ecosystem and similar frameworks


• Familiarity with various tools such as AWS and Docker and an instinct for automation


• Expert in SQL


• Strong understanding of Software Architecture principles and patterns.


• Experience working with 3rd party software and libraries, including open source


• Experience with Postgres

Traits:

• Quick-thinker who takes ownership and pride in their work


• A commitment and drive for excellence and continual improvement 


• A strong sense of adventure, excitement and enthusiasm.


• Excellent systems analytical, problem solving and interpersonal skills