Big Data Engineer
About JOBSwithDOD
What began as a way to help emerging defense companies find top candidates has grown into the largest defense industry careers marketplace. JOBSwithDOD provides a unified ecosystem of career opportunities across both private sector defense companies of all sizes and DoD civilian employers: one industry, one network. At JOBSwithDOD our purpose unites us. The core values that animate everything we do are based upon integrity, service, and excellence. This commitment to our mission, and a focus on delivering the highest quality solutions for the defense industry means we are ever striving for continuous improvement and growth.
- Location:
- Reston, VA
JOBSwithDOD is a leading online employment marketplace for the defense industry.
About the Team:
Our team has a unique opportunity to work on applications at-scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need full-stack engineers to build fast, scalable, and effective applications that help connect people to their next defense industry job. We provide an essential service and have a thriving business as a result.About the Job:
- We use models and algorithms of machine-learning and deep-learning to find candidates for a job, and get the job information to reach the candidate as quickly as possible to allow the employer to reach the best candidates in the least possible time.
- We are looking for a passionate Big Data Engineer with expertise in cloud technologies, big data, and distributed systems to join our product teams. This exciting role requires the experience and skills to design and build key components and infrastructure for our data science and engineering team.
Key focuses:
- Build infrastructure to empower fellow engineers and data scientists to build together best-in-class machine learning based products
- Working in a high-volume production environment that gets bigger and bigger
- Mastering scalability and enterprise-grade production services implementation
- Sense of ownership - leading design for new products and initiatives as well as integrating with currently implemented best-practices
- Working with a number of modern technologies including Spark, Delta Lake, Elasticsearch, Kafka, DynamoDB, K8s, and more
- Collaborating and working as part of a highly skilled team that enjoys doing the impossible together every day
Minimum Requirements:
- 3+ years of coding experience with one of the following: Python, Scala
- Experience in development, maintenance, and monitoring of data applications and data pipelines
- Dealing with data on high volume, high availability production systems
- Experience with Spark
- Fluent with SQL
Preferred Qualifications:
- Experience with one or more of these technologies: Flink, MapReduce, Airflow, Kafka, Key/Value Stores like DynamoDB, SQL DB's
- Experience working with a cloud provider (AWS / Azure / GCP)
- End-to-end experience - owning features from an idea stage, through design, architecture, coding, integration, and deployment stages
- Experience in algorithm design and implementation or Machine learning
- Bachelor's degree or higher in Computer Science or equivalent professional Software Engineering experience
As part of our team you'll enjoy:
- Competitive salary
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan