Data Engineer

Data Engineer (Elasticsearch + Data warehousing)

Particle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infrastructure to support our clients' data needs. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure high-quality, scalable, and efficient data delivery. This is an exciting opportunity to contribute to impactful projects, solve complex data challenges, and grow your skills in a supportive and dynamic environment.

**In This Role, You Will:**Software Development

• Design, implement, and optimize Elasticsearch clusters for high-performance querying and data retrieval.
• Build and manage Elasticsearch indexes, ensuring data is stored, indexed, and queried efficiently.
• Build and optimize data storage solutions like data lakes and warehouses.
• Integrate structured and unstructured data from various internal and external systems to create a unified view for analysis.
• Ensure data accuracy, consistency, and completeness through rigorous validation, cleansing, and transformation processes.
• Maintain comprehensive documentation for data processes, tools, and systems while promoting best practices for efficient workflows.

Requirements Gathering and Analysis

• Collaborate with product managers, and other stakeholders to gather requirements and translate them into technical solutions.
• Participate in requirement analysis sessions to understand business needs and user requirements.
• Provide technical insights and recommendations during the requirements-gathering process.

Agile Development

• Participate in Agile development processes, including sprint planning, daily stand-ups, and sprint reviews.
• Work closely with Agile teams to deliver software solutions on time and within scope.
• Adapt to changing priorities and requirements in a fast-paced Agile environment.

Testing and Debugging

• Conduct thorough testing and debugging to ensure the reliability, security, and performance of applications.
• Write unit tests and validate the functionality of developed features and individual elements.
• Writing integration tests to ensure different elements within a given application function as intended and meet desired requirements.
• Identify and resolve software defects, code smells, and performance bottlenecks.

Continuous Learning and Innovation