Big Data Engineer - Durham

Company: Kairos Technologies
State/City: Durham
Job Description:

Job Description:

8+ years of experience in one or more of the following disciplines: data analysis, software engineering or database development. Experience working in an agile development environment encouraged (Scrum and/or Kanban). Thrive in a multifaceted, fast paced, highly upbeat TEAM based environment. Design, develop and execute Apache Spark analytical jobs across several data sources and types, utilizing both Java and Scala and interfacing with Apache Cassandra; will be designing and developing RestFUL Java API's. Exposure and/or development with messaging technologies (Kafka) is a plus. Updating and building standards around data ingestion and processes within the analytics ecosystem for scalable and maintainable platforms. Identification of currently inefficient processes and data flows and proposed future state, passionate about data
quality and performance. Full grasp of continuous integration and delivery, including branching strategies, automated unit tests, static analysis (code structure and security), automated deployment and functional automation within CI Pipelines. Experience working with analytic and partner to understand and propose solutions and approaches to sophisticated analytic problems. Exposure to DataStax Enterprise (Cassandra and Spark). Experience with large-scale data sets (50+ terabytes .. 1+ petabyte); exposure to Relational Database and traditional ETL Tools (Oracle, Informatica).

Thanks&Regards

 

Rahul | Sr Executive-TAG | Kairos Technologies Inc.

O: 972-366-7688 x 304 | E:  rahul@kairostech.com



Salary: Negotiable

Age requirements:
Minimal experience: No experience


Jobs you may be interested in


Tips You May Be Interested In