Responsibilities

• Work with Product Owner, data architect, data analyst and business team to understand data requirements and

convert them into technical implementation solutions

• Design, develop and optimize ETL (data extraction, transformation, loading) processes according to actual business

needs to support large-scale data processing and integration

• Build and maintain stable and efficient data pipelines to import multi-source heterogeneous data into big data

platforms or data warehouses.

• Use big data technologies (such as spark, etc.) to develop and optimize batch and stream processing tasks

• Participate in and help the team's agile implementation and continuous improvement

• Actively learn and master insurance-related business and system knowledge

• Complete other tasks assigned by the supervisor.

Requirements

• Bachelor degree or above in computer-related majors, more than 3 years of experience in big data development

and implementation

• Familiar with Linux environment, proficient in at least one scripting language (such as Shell, Python, etc.)

• Familiar with ETL development process, master mainstream big data technologies, such as Hadoop, Spark, Hive,

etc.

• Familiar with Git and other code version control technologies

• Familiar with Azure platform, experience in large model development is preferred

• Strong analysis and problem-solving skills, and a strong interest in tackling difficult problems

• Good teamwork spirit, communication skills and learning ability

• Those with experience in big data platform construction are preferred

• Those with GenAI project experience are preferred

• Experience in the financial industry is preferred

• Ability to anticipate potential problems, decide and implement solutions

• Strong guidance ability, able to help guide other team members without being limited by the role

• Proficient in English reading and writing, can speak simply, and fluent oral English is preferred



Skills Requirements:

Primary:

• Proven work experience in big data testing

• Strong understanding of Azure technology stack, SQL, Python, Spark

• Solid knowledge of SQL, data warehousing concepts.

• Linux / java programming skill for automation of the test cases

Secondary:

• Experience with performance and/or security testing is a plus

• Knowledge in HP ALM defect management tool

Please refer to job description.