AI Data Pipeline Engineer
Job Description
Kavaliro is seeking an AI Data Pipeline Engineer to design and optimize secure, scalable pipelines that move structured and unstructured data into AI processing services and vector databases. This position requires strong expertise in data engineering, AI integration, and performance optimization to support rapid AI workflows.
Responsibilities:
-
Develop pipelines using AWS Glue, Lambda, Kinesis, Kafka, NiFi, or Airflow.
-
Integrate pipelines with AI/LLM models via RESTful APIs.
-
Ensure data quality, caching, and high-speed processing (50–2000 tokens/sec).
-
Work with system administrators to maintain compliance with security requirements.
-
Document workflows and support evaluation of AI outputs.
Qualifications:
-
3+ years in data engineering or AI infrastructure.
-
Strong skills in AWS services, Kafka/NiFi, JSON, Python, and APIs.
-
Experience with low-latency pipeline design and optimization.
-
Desired: familiarity with LlamaIndex, Qdrant, and classification-aware data processing.
Â
Clearance Requirement: Must hold an active TS/SCI clearance and the ability to pass a CI Polygraph. Applicant MUST hold a permanent U.S. citizenship for this position in accordance with government contract requirements.
Location Requirement: This role is based in Reston, VA or Bolling AFB, DC, with 50% onsite and 50% telework.
Kavaliro provides Equal Employment Opportunities to all employees and applicants. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Kavaliro is committed to the full inclusion of all qualified individuals. In keeping with our commitment, Kavaliro will take the steps to assure that people with disabilities are provided reasonable accommodations. Accordingly, if reasonable accommodation is required to fully participate in the job application or interview process, to perform the essential functions of the position, and/or to receive all other benefits and privileges of employment, please respond to this posting to connect with a company representative.
Job Requirements
Share This Job:
Related Jobs:
Login to save this search and get notified of similar positions.About Reston, VA
What to expect when working with Kavaliro
Just like with our clients, we build our process to meet each individual candidate s needs. Our recruiters take the time to listen to your career goals and ambitions, then work one-on-one with you to help place you in a company that provides the best professional fit.
01
Call us with a detailed overview of your experience, skills, background, and goals. If you are local and prefer, we will set up a face-to-face interview.
02
You will be asked to complete an online assessment form to assess your skill level. At the same time, your references will be checked.
03
Your Kavaliro recruiter will discuss and review potential job opportunities.
04
When you and your recruiter agree on a potential match, you ll be briefed with helpful insight into the client s needs.
05
When you begin your employment tenure with the client, Kavaliro will continue to be there to support you in your career.
More From Kavaliro
About Us
We ve been in the staffing business for over 10 years because we receive great satisfaction helping both companies and job candidates find their perfect match.
Meet our teamLife at Kavaliro
We take culture seriously and believe true strength comes from a collaborative and open-minded environment where everyone is supported and empowered to succeed.
Learn moreCareers at Kavaliro
If you want to always have your finger on the pulse of the latest and newest trends in staffing and recruiting, join the Kavaliro team!
See internal opportunitiesCareer Advice
We offer guidance on resume revisions, clarifying your career objectives, and other advice to help you land your dream job.
Visit our blog