Location: Remote
Job Type: Full-Time Contract (Paid)
We are looking for a highly skilled Data Engineer to join our team. In this role, you will be responsible for building, optimizing, and maintaining scalable data pipelines and infrastructure that support data analytics, business intelligence, and other key business functions. You will collaborate with data architects, analysts, and other stakeholders to ensure our data systems are reliable, secure, and efficient.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes to integrate data from multiple sources into a centralized data infrastructure.
- Collaborate with data architects and analysts to design data models that support reporting, analytics, and business intelligence.
- Optimize and improve the performance of existing data pipelines, ensuring efficiency and scalability.
- Implement data quality checks and ensure data integrity across the data lifecycle.
- Monitor and troubleshoot data pipeline issues, ensuring timely and reliable data availability for downstream processes.
- Work with cloud and on-premise data storage solutions to manage large-scale datasets and optimize database performance.
- Stay up-to-date with the latest trends in data engineering and continuously improve the data infrastructure.
- Ensure data security, governance, and privacy policies are implemented and adhered to within data pipelines and storage systems.
Qualifications:
- Proven experience as a Data Engineer or in a similar role, with expertise in building data pipelines, ETL processes, and data infrastructure.
- Strong knowledge of relational and non-relational databases, and experience working with large datasets.
- Proficiency in SQL and experience with data pipeline automation tools.
- Experience with cloud-based data platforms and big data technologies.
- Strong programming skills in programming languages for data processing and automation.
- Excellent problem-solving skills and the ability to optimize and scale data systems.
- Familiarity with data governance, data security, and compliance best practices.
- Ability to work effectively with cross-functional teams, translating business needs into data solutions.
Preferred Skills:
- Experience with real-time data processing and streaming platforms.
- Knowledge of data warehousing and data lake architectures.
- Familiarity with Agile development processes.
- Understanding of machine learning workflows and how data engineering supports advanced analytics.
Apply Here:
https://tinyurl.com/swarmauri-data-eng
Join Us:
Take a Look at our Website, Follow us on GitHub, Star our repository, Watch our Channel, and Say Hello in the Discord.
GitHub: https://github.com/swarmauri
Repository: https://github.com/swarmauri/swarmauri-sdk
YouTube: https://youtube.com/@swarmauri
Discord: https://discord.gg/nBKuZ36x9Q
Website: https://swarmauri.com