Job description
As data engineer you will play a crucial role within a data-driven organization, focusing on the creation and management of infrastructure and architecture that allow for effective data storage, processing, and analysis. You will work with various technologies to ensure that data is accessible, reliable, and optimized for performance, facilitating data-driven decision-making within the business. You will serve as the backbone of data operations, enabling teams to harness the power of data for insights and innovation.
Design, construct, install, and maintain large-scale processing systems and data pipelines.
Develop and optimize data pipelines for collecting, storing, and processing data from various sources.
Collaborate with data scientists, analysts, and other stakeholders to understand data needs and provide insights.
Ensure data integrity, quality, and availability for analysis and reporting.
Implement data security measures to protect sensitive information.
Monitor and troubleshoot data systems to resolve issues and enhance performance.
Job requirements
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
Proficiency in programming languages such as Python, Java, or Scala.
Experience with database management systems (SQL and NoSQL).
Knowledge of data warehousing solutions and technologies (e.g., Hadoop, Spark).
Familiarity with cloud services (e.g., AWS, GCP, Azure) for data storage and processing.
Strong analytical skills and attention to detail, with the ability to work independently and in a team environment.
Job Type: Remote
Salary: £experience
Benefits:
- Flexible Hours
- Hybrid working
Schedule:
Monday to Friday (unless dealing with an emergency event)