Particle41

Overview

As a Data Consultant, you will play a key role in designing, building, and maintaining robust data pipelines and infrastructure to support our clients' data needs, working on end-to-end data solutions and collaborating with cross-functional teams.

About Particle41

Particle41 is seeking a talented and versatile Data Consultant to join our innovative team, helping clients design, build, and maintain robust data pipelines and infrastructure.

Requirements & Eligibility

• Bachelor's degree in Computer Science, Engineering, or related field.
• Proven experience as a Data Engineering, with over of 3 years of experience.
• Proficiency in Python programming language.
• Experience with database technologies such as SQL (e.g., MySQL, PostgreSQL) and NoSQL (e.g., MongoDB) databases.
• Strong understanding of Programming Libraries/Frameworks and technologies such as Flask, API frameworks, datawarehousing/lakehouse, principles, database and ORM, data analysis databricks, panda's, Spark, Pyspark, Machine learning, OpenCV, scikit-lear
• Familiarity with at least one cloud data engineering stack (Azure, AWS, or GCP).

Key Responsibilities

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to process large volumes of data from diverse sources.
• Build and optimize data storage solutions, such as data lakes and data warehouses, to ensure efficient data retrieval and processing.
• Integrate structured and unstructured data from various internal and external systems to create a unified view for analysis.
• Ensure data accuracy, consistency, and completeness through rigorous validation, cleansing, and transformation processes.
• Collaborate with product managers and other stakeholders to gather requirements and translate them into technical solutions.
• Participate in Agile development processes, including sprint planning, daily stand-ups, and sprint reviews.
• Conduct thorough testing and debugging to ensure the reliability, security, and performance of applications.