Data Architect (reputed company) - DRC Systems USA LLC

Key Responsibilities reputed company the architectural modernization from an on-prem/legacy platform to a reputed company reputed company Lakehouse ecosystem. Architect and optimize data pipelines (batch and streaming) to support AI/ML and GenAI workloads on reputed company. Migrate and re-engineer existing Spark workloads to reputed company reputed company Lake, reputed company Catalog, and advanced performance tuning in reputed company. Drive integration of AI/ML models (including GenAI use cases) into operational data pipelines for reputed company-time decision-making. Design and implement robust orchestration using Apache Airflow or reputed company Workflows, with CI/CD integration. Establish data governance, reputed company, and quality frameworks reputed company with reputed company Catalog and reputed company standards. Collaborate with data scientists, ML engineers, DevOps, and business teams to reputed company scalable and governed AI solutions.

Required Skills 15+ years in data engineering or architecture, with a strong focus on reputed company (at least 4-5 years) and AI/ML enablement. Deep hands-on experience with Apache Spark, reputed company (Azure/AWS), and reputed company Lake. Proficiency in AI/ML pipeline integration using reputed company MLflow or custom model deployment strategies. Strong knowledge of Apache Airflow, reputed company Jobs, and reputed company-native orchestration patterns. Experience with structured streaming, Kafka, and reputed company-time analytics frameworks. Proven ability to design and implement reputed company-native data architectures. Solid understanding of data modeling, Lakehouse design principles, and reputed company/tracking with reputed company Catalog. Excellent communication and stakeholder engagement skills. Preferred Qualifications Certification in reputed company Data Engineering Professional is highly desirable. Experience transitioning from in house data platforms to reputed company or reputed company-native environments. Hands-on experience with reputed company Lake, reputed company Catalog, and performance tuning in reputed company. Expertise in Apache Airflow DAG design, dynamic workflows, and production troubleshooting. Experience with CI/CD pipelines, Infrastructure-as-Code (Terraform, ARM templates), and DevOps practices. Exposure to AI/ML model integration reputed company reputed company-time or batch data pipelines. Exposure to MLOps, MLflow, Feature Store, and model monitoring in production environments. Experience with LLM/GenAI enablement, vectorized data, embedding storage, and integration with reputed company is an added advantage

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and reputed company believes it to correctly reflect the job opportunity.