Data Engineer (Talend & Snowflake)

Insighture is a leading technology consultancy that drives digital transformation for businesses worldwide. With a team of over 85 expert consultants, the company delivers tailored, high-impact strategies and solutions, enabling scalable product engineering. As an AWS partner, Insighture excels in co-integrated cloud services. It has collaborated with more than 50 clients globally, guiding them through cloud adoption, DevOps transformation, enterprise modernisation, and more.

The team’s expertise spans Cloud-Native Development, Solutions Architecture, UI/UX, Quality Engineering, Data Engineering, AI/ML, and DevSecOps. These capabilities empower businesses to achieve impactful and innovative outcomes.

In 2024, Insighture achieved ISO certification and was recognised as a Great Place to Work, earning three prestigious awards: Best Workplace in Sri Lanka, Best Workplace for Technology, and Best Workplace for Young People. Insighture's technology and expertise are embedded in the work of internationally recognised care providers, global freight operations, child protection systems, and health tech platforms across Australia, the UK, and Singapore.

We are seeking a motivated and detail-oriented Data Engineer (Talend & Snowflake) for a 6 months contract to join our growing team.

Requirements:

• 6 - 7 years of experience in Data Engineering, preferably with Talend DI & Snowflake
• Experience with SQL, Power BI, Azure, Openflow, Snowpipe, Apache Airflow, GitHub experience
• Lead the design and development of data pipelines using Talend and Snowflake.
• Architect and optimize data warehousing solutions in Snowflake, leveraging features like Snowpipe for real-time data ingestion.
• Ensure data integrity, security, and governance across systems.
• Collaborate with data analysts, scientists, and business teams to define data strategies.
• Demonstrated expertise in Talend ETL tool and Snowflake data warehousing.
• Experience with data modeling, database management, and data pipeline optimization.
• Develop and maintain high-performance SQL queries for data extraction and transformation.
• Extract and integrate data from various APIs, ensuring seamless data flow.
• Implement ETL processes and ensure efficient data flow using tools like Apache Airflow for orchestration.
• Monitor and troubleshoot data pipeline performance.
• Guide and mentor junior data engineers.
• Utilize GitHub for version control and collaborative development.

Responsibilities

• Design and Implement Data Solutions - Develop scalable and efficient data solutions to support business intelligence and analytics needs.
• Performance Tuning - Optimize Snowflake queries and Talend jobs for performance and cost efficiency.
• Data Quality Management - Implement data quality checks and validation processes to ensure the accuracy and reliability of data.
• Automation - Automate repetitive data tasks and processes using tools like Openflow and Airflow to improve efficiency and reduce manual intervention.