Role and Responsibility
• Design and implement architecture on Cloud to support big data processing as well as a business model for scale, resilience, and agility. Cloud architecture design must account for the unique needs of workloads, users, and operational costs
• Building big data pipeline for batch processing and streaming data based on frameworks
• Identifying and solving business challenges utilizing large structured and unstructured data from different sources
• Building data services to support data monetization and advanced analytics
• Make an impact doing foundational work on the data platform as an architect/lead
• Maintaining SLA of data service in the Big Data platform
Qualification
• 2-3 years of experience in Big Data Platform Engineer is a plus
• Experience with a large data processing platform, ETL pipelines, and data techs for ingesting, processing, etc
• Software Engineering mindset, including dealing with scalability and automation
• Experience design architecture and infrastructure on Cloud
• Experience with Azure ecosystem (Azure Synapse, Databrick), AWS ecosystem (MapReduce, EMR, or similar), Containers
• Ability to mentor and teach
Would be a plus:
• AWS Cloud Practitioner, AWS Solution Architecture, AWS Big Data Specialist are plus
• AZ900, AZ304, DP203 are plus
