Data Engineer - Raleigh

Company: Software Technology Inc
Your Application: You have not applied yet
Location: Raleigh, USA
JOB DESCRIPTION

Title: Datalake Developer

SUMMARY

Successful candidates will be strong leaders who can prioritize well, communicate clearly, and have a consistent track record of delivery and support of ecommerce solutions. The implementation around Data Lake systems requires strong critical thinking skills, creative engineering balanced with high quality and customer focus. The ideal candidate is one that is not only passionate about software development and software architecture but also focus on business needs and customer experience. The day-to-day work is interesting, challenging and fast-paced!

ESSENTIAL DUTIES AND RESPONSIBILITIES include the following. Other duties may be assigned.

As a developer of this team, you will work with business stakeholders, project managers, business analysts, and other IT teams to understand the business needs and their requirements. You will be working closely with a nimble team of Data engineers and enterprise architects to determine the best architectural and design decisions, find and develop innovative and practical solutions to meet our business needs in a fast-paced environment.

QUALIFICATIONS

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Hands-on technical experience:

The team utilizes a variety of technologies to provide the best solution for requirements including AWS S3 [data lake], lambda, glue jobs, Snowflake for data warehouse, pyspark and Talend for data processing.Experience in Data Lake including ingestion, etl, and Spark processing. Preferably Talend and pyspark in that order.Experience with developing Lambdas, and glue jobs is needed.Experience / exposure to DynamoDB is an advantage.Experience with enhancing and maintaining existing data lake applicationsExperience with the Data Stage 11.7 will be an Add On only but not necessary.

Communication Skills

Exceptional customer relationship skills including the ability to discover the true requirements underlying feature requests, recommend alternative technical and business approaches, work with architects to come to an agreed technical approach, and lead development efforts to meet aggressive timelines with optimal solutions.Ability to work collaboratively with or lead cross-functional teams with minimal supervision.Ability to drive consensus within a team and influence outcomes in significant technical decision-making.Excellent interpersonal, written and verbal communication skills to work with different business groups as well as IT partners (enterprise architects, vendors, etc.)

Problem Solving

Attention to
detail and organization in all aspects of the system development along with a solid understanding of the customer need.Ability to understand, master, and be able to prototype with existing and new technologies quickly.

Time Management

Ability to effectively plan, organize and prioritize multiple streams of activity. Adapt well to changes.Demonstrated ability to meet commitments and multi-task in a fast-paced work environment with a high-level of accuracy and efficiency.

Analytic Skills

Demonstrated critical thinking skills.Open-minded, willing to consider multiple options, sources, perspectives, and possible solutions. Careful assessment of the importance, relevance, and validity of all options.Inquisitive. Ask probing questions and research as a basis for making design decisions and judging quality; understand the true reason behind the request rather than just accepting an initial thought or proposed solution.Proactive and willing to contribute ideas. Not afraid to ask questions.Should be a very quick learner and adapt to changes.

EDUCATION and/or EXPERIENCE

Bachelor's degree in a technical discipline or equivalent experience/training

7-10 years of overall experience IT experience.At least 4+ years of experience working with large scale datasets in Data Lakes. [AWS s3 experience preferred]At least 3+ years of hands-on experience in Spark development. Talend is required.Experience in understanding, and working with Parquet files, Lambdas, and Glue jobs is required.Experience creating and configuring deployments in Jenkins (nice to have)Ability to effectively plan, organize and prioritize multiple streams of activity. Adapt well to changes.Demonstrated ability to meet commitments and multi-task in a fast-paced work environment with a high-level of accuracy and efficiency.Demonstrated knowledge in building, debugging and maintaining mission critical enterprise applications.Excellent communication skills and ability to work both independently and with a dispersed team
Required Skills : Talend Cloud AWS (S3/SFTP/data movement) Snowflake
Basic Qualification :
Additional Skills : 100% remote
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :100% remote
Project Verification Info :
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :Other Project Type
Master Job Title :Dev: Other
Branch Code :Raleigh


JOB TYPE
Work Day: Full Time
Salary: Negotiable


JOB REQUIREMENTS
Minimal experience: No experience



Jobs you may be interested in


    Tips You May Be Interested In