Data Engineer

Insighture is a leading technology consultancy firm that drives digital transformation for businesses worldwide. With over 85 expert consultants, we have tailored high-impact strategies and solutions, enabling scalable product engineering. As an AWS partner, Insighture excels in co-integrated cloud services & has collaborated with more than 50 clients globally, guiding them through cloud adoption, DevOps transformation, enterprise modernisation, and more.

The team’s expertise spans Cloud-Native Development, Solutions Architecture, UI/UX, Quality Engineering, Data Engineering, AI/ML, and DevSecOps. These capabilities empower businesses to achieve impactful and innovative outcomes.

In 2024, Insighture achieved ISO certification and was recognised as a Great Place to Work, earning three prestigious awards: Best Workplace in Sri Lanka, Best Workplace for Technology, and Best Workplace for Young People. Insighture's technology and expertise are embedded in the work of internationally recognised care providers, global freight operations, child protection systems, and health tech platforms across Australia, the UK, and Singapore.

The Opportunity

We are looking for a skilled Data Engineer to join our team and help build scalable data solutions for our project. The ideal candidate will have experience working with ETL pipelines, cloud technologies, and both SQL and NoSQL databases. You will be responsible for designing, implementing, and optimizing data workflows while ensuring data integrity and performance.

Data Engineering Team

We are architects of data-driven success. Our high-performing team specialises in building scalable data platforms, optimizing pipelines, and transforming raw information into actionable insights. Passionate about performance and efficiency, we empower businesses with cutting-edge data solutions that fuel innovation. Let us help you unlock the full potential of your data.

The Role Will Include

• Develop and maintain ETL pipelines for processing large-scale data.
• Work with structured and unstructured data stored in Postgres, MongoDB, and other databases.
• Design and optimize data workflows using AWS services such as S3, Lambda, Kinesis, Redshift, and Glue/Airflow.
• Ensure data integrity, quality, and reliability across data pipelines.
• Build scalable and efficient data solutions using Python, Java, or Scala.
• Deploy and manage containerized applications using Docker.
• Collaborate with cross-functional teams to support analytics and business intelligence initiatives.

Requirements for the Role

• Bachelor's degree in Data Engineering or relevant qualification.
• 2 years of experience working as a Data Engineer with a similar exposure.
• Strong programming skills in Python, Java, or Scala.
• Hands-on experience with ETL processes and tools.
• Proficiency in working with SQL and NoSQL databases (Postgres, MongoDB).
• Experience with AWS services such as S3, Lambda, Kinesis, Redshift, and Glue/Airflow.
• Familiarity with containerization and orchestration tools (Docker and Kubernetes are a plus).
• Understanding of data modeling, data warehousing, and data pipeline optimisation.
• Strong problem-solving and analytical skills.
• Experience with big data technologies such as Spark.
• Familiarity with CI/CD pipelines for data workflows.
• Knowledge of data governance and security best practices.

Benefits

• Australian dollar-linked compensation.
• Performance-based annual bonus.
• Hybrid work arrangement.
• Comprehensive medical insurance.
• Opportunities for direct client interaction.
• Flexible hours for working parents.
• Upskilling programs to help you grow within the company.
• A well-balanced and supportive work culture.
• Opportunity to work in a high-performance team environment.