JOB DESCRIPTION
We are seeking a meticulous Data Analyst (Data Quality & Integration) to oversee our data ingestion pipeline. Your primary responsibility will be loading data extracts into our existing database while enforcing strict quality and integrity checks.
You will act as the first line of defense against bad data - proactively finding data anomalies, identifying corrupted records for deletion and cleanup, and generating outbound data extracts and manifest files using native database tools and standard queries. A critical component of this role involves working directly in a live database environment, requiring the utmost care and optimization to ensure operations do not impact active users.
REQUIRED SKILLS AND EXPERIENCE
· Compare and reconcile data sets to identify discrepancies, trends, and anomalies.
· Load and process data extracts from various internal and external sources into our staging systems.
· Review and audit incoming extracts for completeness, accuracy, and formatting compliance.
· Map and compare external extracts against existing production database schemas to ensure alignment before final ingestion.
· Enforce quality and integrity checks during the staging phase to prevent bad data from polluting production systems.
· Profile data to find hidden problems, such as formatting errors, orphaned records, duplicates, and missing constraints using pure SQL.
· Identify bad, redundant, or corrupted data to execute safe deletion and cleanup operations using optimized database commands while ensuring you do not impact production users.
· Generate outbound data extracts and compile accompanying manifest files to verify row counts, file structures, and data completeness for delivery packages.
· Document data reconciliation workflows and report systemic data quality issues to team members.
Required Skills & Qualifications
· Strong SQL skills with experience writing complex queries to join, filter, and compare large data tables.
· Advanced SQL functionality, specifically in writing safe, highly optimized queries to identify, update, and clean data within a live database environment.
· Proven experience managing production data safely, demonstrating the technical caution necessary to execute changes without disrupting system performance or end-user activity.
· Experience with data profiling and implementing data validation frameworks (e.g., handling primary/foreign key integrity, null checks).
· Proficiency with database export/import utilities and GUI tools (e.g., Oracle, SQL*Loader, SSMS) for loading and extracting flat files.
· Familiarity with creating flat file extracts and accompanying manifest files used to verify data integrity during transfers, ensuring completeness for down-stream processing by other team members.
· Strong understanding of database constraints, indexes, and schemas to ensure data migrations don't break dependencies.
· High attention to detail with a track record of identifying and resolving sensitive data issues without causing data loss.
NICE TO HAVE SKILLS AND EXPERIENCE
- Regulated data experience
- Certificate, Oracle 9i/10G/11G/12c DBA / OCA , MS SQL 10.5/11/12/13
