Job Title: Senior Data Engineer
Key Skills: Databricks, Microsoft Fabric, Python (PySpark), SQL, Azure, LLM
Location: Brazil
Mode: Remote
We at Coforge are hiring Senior Data Engineer with the following skill set.
Key Responsibilities
- Design and implement scalable data pipelines using Databricks and Microsoft Fabric.
- Build and maintain a Medallion Architecture (Bronze, Silver, Gold layers) to organize and process data across the organization.
- Collaborate with the AI team to ensure high-quality data availability for RAG patterns and LLM components.
- Develop and optimize data models that feed directly into the Microsoft Power Platform (Power BI).
- Ensure data platform performance and reliability while maintaining a platform-agnostic approach where possible.
Required Skills & Qualifications
- Experience with Databricks: Proficiency with Spark, Delta Lake, and workspace management.
- Knowledge of Microsoft Fabric: Experience navigating and implementing solutions within the Fabric ecosystem.
- Architecture Design: Solid experience implementing Medallion Architecture.
- Data Programming: Proficiency in Python (PySpark) and SQL for data transformation and engineering.
Preferred Skills:
- Cloud Ecosystem: Experience with the Azure platform and Azure Data Factory.
- AI Integration: Familiarity with Vector Databases (e.g., ChromaDB) for LLM support.
- Power Platform: Experience preparing data for Power BI and Power Apps consumption.
- Domain Knowledge: Familiarity with industrial data or engineering calculations.
- DevOps for Data: Experience with CI/CD for data pipelines and version control (Git).
- Data Governance: Knowledge of data quality standards and metadata management.
Posted On: 14-05-2026
At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.