The primary focus areas include data analysis for improving agency operations, making Open Data accessible, and advancing citywide data infrastructure. We are currently seeking a Senior Data Engineer to play a key role in implementing and supporting complex data engineering solutions.
Support the implementation of a new Master Data Management (MDM) Business Domain integrating multiple data sources and associated web services and APIs.
Develop architectural blueprints utilizing MDM as a foundational service, supporting the creation of unified profiles for business transactions.
Coordinate senior-level data engineers in building pipelines to MDM and selected data platforms under the guidance of Technical Leads.
Develop analytics tools utilizing data pipelines for actionable insights into customer engagement, operational efficiency, and key business performance metrics.
Review Extraction, Transformation, Load strategies (ETL) for data from various sources using SQL, cloud, and ‘big data’ technologies.
Create, update, and maintain system documentation.
Manage the development of APIs for data access or landing data for downstream consumption in the appropriate target data store.
Coordinate security scan accreditations.
Perform special projects and initiatives as assigned.
8+ years managing the development and implementation of large technology projects, with at least 3+ years involving MDM implementation.
8+ years of experience in writing SQL.
8+ years of experience in copying, transferring, manipulating, and automating data operations.
Experience with data architecture tools like Informatica Power Center, IICS, SSIS, or similar ETL tools.
Experience with Amazon Web Services or Microsoft Azure cloud computing platforms.
In-depth knowledge of SQL and other database solutions.
Knowledge of modeling database schemas for large datasets.
Experience developing cloud-ready applications.
Experience with programming languages like Python, Java, and Perl.
5+ years hands-on experience in development with Informatica PowerCenter and B2B Data Transformation.
Experience with Oracle 10g/11g, SQL Server, and/or a database appliance.
Knowledge of metadata-driven enterprise reporting platforms.
Strong hands-on experience with Master Data Management (MDM) implementation for a large enterprise.
Prior experience working on complex data integration projects for the City of New York.
Note: Candidates lacking mandatory skills/experience will not be considered.