Cloud Data Engineer
Job Description
Pay Rate: $115,037 to $151,561 annually commensurate with experience
DUTIES:
- Design and implement scalable and secure data processing pipelines and storage environments using cloud services and tools.
- Collaborate with technical analysts, business analysts, and line of business stakeholders to understand data requirements and implement appropriate data solutions.
- Ensure data is cleansed, mapped, transformed, and otherwise optimized for storage and use according to business and technical requirements.
- Build effective data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
- Load transformed data into storage and reporting structures in destinations including data warehouse, reporting systems and analytics applications.
- Monitor and troubleshoot issues with the data environment to maintain high availability and performance.
- Provide on-call support for critical production systems.
- Implement data security measures, including encryption, access controls, and auditing, to protect sensitive information.
- Utilize analytics services to provide actionable insights and support data-driven decision-making.
- Maintain effective documentation regarding data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards.
- Mentor IT staff on security best practices and emerging technologies.
- Participate in continuous learning to stay current with cybersecurity advancements.
- Collaborate with colleagues to draft technology plans that enhance security posture.
- Manage the relationship with the System Integrator.
- Review Statements of Work (SOWs), deliverables, and invoices.
- Measure SI performance against KPIs and SLAs.
- Resolve contractual or delivery issues.
REQUIREMENTS:
- The ideal candidate has a combination of education and experience equivalent to a bachelor’s degree in computer science or closely related field
- Minimum of five plus years of Azure migration experience.
- Proven experience using data processing languages such as Python and SQL.
- Experience with Azure: Data Factory, Databricks, Data Lake Storage, SQL DW, Analysis Services, and API – PySpark.
- ETL experience in a data warehouse environment using slowly changing dimensions.
- Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
- Ability to multi-task in a fast-paced environment.
- Ability to prioritize tasks and projects using a browser -based tracking system.
- Familiarity with JIRA preferred.
- Current knowledge of laws, rules, and regulations pertaining to information technology relating to financial institutions.
- Ability to work independently with limited supervision.
- Ability to effectively interact and communicate with outside vendors and internal clients.
- Ability to communicate effectively both verbally and in writing.
- Ability to establish and maintain effective working relationships with a diverse group of people.
- Expereince working with an “SI” (System Integrator)
- Experience managing of 500 – 800+ pipelines during a large-scale enterprise cloud migration
Job Requirements
Share This Job:
Related Jobs:
Login to save this search and get notified of similar positions.About Napa, CA
What to expect when working with Kavaliro
Just like with our clients, we build our process to meet each individual candidate s needs. Our recruiters take the time to listen to your career goals and ambitions, then work one-on-one with you to help place you in a company that provides the best professional fit.
01
Call us with a detailed overview of your experience, skills, background, and goals. If you are local and prefer, we will set up a face-to-face interview.
02
You will be asked to complete an online assessment form to assess your skill level. At the same time, your references will be checked.
03
Your Kavaliro recruiter will discuss and review potential job opportunities.
04
When you and your recruiter agree on a potential match, you ll be briefed with helpful insight into the client s needs.
05
When you begin your employment tenure with the client, Kavaliro will continue to be there to support you in your career.
More From Kavaliro
About Us
We ve been in the staffing business for over 10 years because we receive great satisfaction helping both companies and job candidates find their perfect match.
Meet our teamLife at Kavaliro
We take culture seriously and believe true strength comes from a collaborative and open-minded environment where everyone is supported and empowered to succeed.
Learn moreCareers at Kavaliro
If you want to always have your finger on the pulse of the latest and newest trends in staffing and recruiting, join the Kavaliro team!
See internal opportunitiesCareer Advice
We offer guidance on resume revisions, clarifying your career objectives, and other advice to help you land your dream job.
Visit our blog

