Data Engineer - Azure Databricks

Data Engineer - Azure Databricks (Corporate Data Platform)

We are hiring a Data Engineer with strong Azure Databricks and Azure Data Engineering experience to build and scale enterprise data pipelines across corporate functions including Finance, Compliance, Facilities, RESO, and HCG.

This role focuses on modern cloud data engineering, ETL/ELT pipelines, and enterprise system integration within a large-scale Azure data ecosystem.

NYC area (Hybrid - 3 days onsite per week)

Responsibilities

• Design, build, and maintain Azure Databricks + Azure Data Factory pipelines
• Develop ETL/ELT workflows for structured and unstructured data
• Build scalable data models and lakehouse architectures
• Integrate enterprise systems (ServiceNow, Workday, Dataverse, APIs)
• Optimize SQL queries, Spark jobs, and data processing performance
• Ensure data governance, security, and data quality standards
• Support monitoring, troubleshooting, and pipeline reliability
• Collaborate across business and technical teams

Required Skills

• 5+ years in Data Engineering / Cloud Data Engineering
• Strong hands-on experience with Azure, Databricks, Spark
• Advanced SQL and large-scale data processing
• Experience with Azure Data Factory
• Strong programming in Python or Scala
• Experience with Azure SQL Database
• Familiarity with APIs, event-driven architecture, and system integration
• Experience with Azure Functions
• Working knowledge of C# and/or PowerShell
• Strong communication and stakeholder management skills

Nice to Have

• Delta Lake / Lakehouse architecture
• Azure DevOps / CI-CD pipelines
• Data governance / catalog tools (e.g., Purview)
• Agile/Scrum environment experience
• Microsoft or Databricks certifications

Why This Role

• High-impact enterprise data platform work
• Exposure across multiple business domains
• Opportunity to shape modern Azure Databricks architecture
• Strong focus on scalability, engineering excellence, and innovation

Compensation: $70.00 - $90.00 per hour

Who We Are High Bridge is a bottom-up consulting firm with more than two decades of experience creating innovative solutions for the technology industry.

• We connect thoughtfully curated talent with reputable employers in our field.
• We partner with like-minded companies to bolster mutual success and understanding.
• We deliver results through strategic planning and meticulous project management.

At High Bridge, we believe that success is a measure of results and process, product and person. We are proud to bring integrity and humanity to the work that we do each day. Whether we're interviewing prospective associates, brainstorming with partners, or troubleshooting with vendors, we pledge our commitment to honesty, transparency, and good humor at every junction.

Careers Are you passionate about technology? Do you believe in no finish lines? Are people and process the heel in your stride? High Bridge Consulting may be the next journey for you.

Here at High Bridge, our island is technology, but our village is human. We value a culture of authenticity, integrity, and creativity. We work smart, not hard, we look forward, not backward, and we love coming to work on Monday.

If you aren't afraid of heights, join us on our bridge.

Apply here. * required fields

First Name*

Last Name*

Email*

Phone*

Yes, Text Me! I consent to receiving text messages about this hiring process and, if hired, future job related information from HIGH BRIDGE CONSULTING LLC.

Message and data rates may apply. Message frequency varies. Reply STOP to opt out. Reply HELP for help. See our User Terms of Service and Privacy Policy for details.

Get faster updates with texting!Message and data rates may apply. Message frequency varies. Reply STOP to opt out. Reply HELP for help. See our User Terms of Service and Privacy Policy for details.

Location Address

City

StatesState Alabama Alaska American Samoa Arizona Arkansas California Colorado Connecticut Delaware Dist. of Columbia Florida Georgia Guam Hawaii Idaho Illinois Indiana Iowa Kansas Kentucky Louisiana Maine Maryland Marshall Islands Massachusetts Michigan Micronesia Minnesota Mississippi Missouri Montana Nebraska Nevada New Hampshire New Jersey New Mexico New York North Carolina North Dakota Northern Marianas Ohio Oklahoma Oregon Palau Pennsylvania Puerto Rico Rhode Island South Carolina South Dakota Tennessee Texas Utah Vermont Virginia Virgin Islands Washington West Virginia Wisconsin Wyoming

ZIP Code

Resume/CV *

Upload File

Or

Type/Paste Text

Cover Letter

Upload File

Or

Type/Paste Text

Recent Job Title

Recent Employer

How many years of previous experience do you have as a Data Manager?* None Less than 1 year 1 - 2 years 3 - 4 years 5+ years

Referral code from a current employeeIf no code provided, add their name instead.