AWS & ETL Lead - Austin

Company: Fisec Global
Your Application: You have not applied yet
Location: Austin, USA
JOB DESCRIPTION

Job Title: AWS & ETL Lead

location Dallas, Texas.

Job Description:

8- 10 years of Strong hands on AWS and ETL experience as a lead. Mandatory Exprience is building end to end data Pipeline on cloud. Mandatory Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, Kinesis, Kafka, API data. Hands-on in python, pyspark /glue is must. Mandatory Experience in Data migration from On-prem to Cloud . Mandatory Good understanding of Informatica to understand existing complex transformations. Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services. Design and build production data pipelines from ingestion to consumption within a big data architecture, using Databricks and snowflake. Design and implement data engineering, ingestion and curation functions on AWS cloud using
AWS native or custom programming. Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud Experience in handling project in AWS data landscape with hands on experience on S3 buckets . Experience of Splunk, ELK (Elasticsearch, Logstash, and Kibana) preferable Hands-on administering Jenkins, or proficiency with other CI/CD tools. Deployment Orchestration and Containerization (Docker or Kubernetes) preferable Experience with building data pipelines and applications to stream and process datasets at low latencies. Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures. Knowledge of Engineering and Operational Excellence using standard methodologies.
Employment type: C2C, W-2, 1099, C2H, W2


JOB TYPE
Work Day: Full Time
Salary: Negotiable


JOB REQUIREMENTS
Minimal experience: No experience



Jobs you may be interested in


    Tips You May Be Interested In