Position: Analyst Data Assurance
Experience: Minimum of 4 years
Role Summary
We are seeking for an experienced Operational Assurance Analyst to oversee and ensure smooth operations, reliability, compliance and performance of our enterprise-wide data lake infrastructure migration project. The ideal candidate must have a strong background in data operations, monitoring, governance, and data quality assurance within big data environments. The resource will work with internal teams to ensure all the relevant verification and controls are in place during the migration phase.
Key Responsibilities
? Validate data completeness, consistency and accuracy across ingestion and history data during migration phase
? Ensure that Operations impacts of new deployments are reviewed and verified in production
? Ensure data is fit for use by downstream consumers (Analytic, reporting, Validation of resolutions provided for recon breaks)
? Support the migration and ongoing operations of the Data Quality and Assurance team
? Monitor and enforce data access controls like Personal Data tagging and data retention policies
? Work closely with Data engineers and Production support /project teams to ensure the Operational KPI are met
? Provide timely update to stakeholders during the migration phase
Required Skills
? 4+ years in data operations, platform support or IT assurance roles.
? Working knowledge on data lake architecture and storage formats
? Understanding of data partitioning, schema evolution and reconciliation
? String proficiency in SQL for any Data quality checks verification
? Ability to write scripts for Data validation and verification during the migration
? Understanding of data governance principle, metadata management and regulatory principles
? Scripting and Automations skills (expertise in Spark, Hive using python)
? Excellent analytical, documentation and communication skills
Engagement Expectations
? Vendor resource will be expected to ramp up quickly and start contributing to active
? migration projects.
? Must coordinate with internal leads, product owners, and platform teams to ensure
? project timelines are met.
? Should be flexible to support multiple time zones (if required)