Role: Lead Data Engineer
Location: San Francisco, CA (1-2 days a week onsite is must)
Job Type: W2 Contract
Contract Length: 9 months with possible extension
Experience Level: Senior/Lead
Main Skills:
SQL, Databricks, ADF, DataStage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, Thoughtspot/other
Required Experience:
- 8-10 years of software development and deployment experience
- At least 7 years of hands-on experience with:
- SQL
- Databricks
- Azure Data Factory (ADF)
- Datastage (or other ETL tools)
- SSAS cubes
- BI tools (Cognos, Tableau, ThoughtSpot, etc.)
- Strong Database knowledge (SQL & No-SQL preferred)
- Advanced SQL and Python skills
- Experience working with APIs for data collection/ingestion
Additional Skills & Requirements:
- Experience building data ingestion pipelines and data warehouse architecture
- Ability to write design documentation, source-to-target mapping documentation, and manage Confluence pages
- Experience converting business functionalities into technical Jira stories
- Strong experience with data modeling, design patterns, and building scalable BI solutions
- Knowledge of cloud platforms (Azure, AWS or equivalent)