Career details
With a team of seasoned experts, we deliver innovative, data-driven solutions.
london
Big Data Engineer
A Big Data Engineer is a specialized IT professional responsible for designing, building, and maintaining large-scale data processing systems. They develop the architecture that enables organizations to collect, store, process, and analyze massive volumes of data efficiently and securely. These engineers are critical to turning raw data into actionable insights, fueling innovations in industries like finance, healthcare, retail, telecom, and technology.
About role
Customer Analytics: Track behavior in real time to personalize experiences.Fraud Detection: Process financial transactions in real-time for anomalies.Predictive Maintenance: Analyze IoT sensor data to prevent equipment failures.Operational Efficiency: Streamline supply chains through historical and real-time data insights.Healthcare: Manage massive volumes of patient data for diagnostics and research.
Responsibilities
Design, develop, and maintain data pipelines for real-time and batch processing.Build data lakes, data warehouses, and distributed systems.Integrate data from multiple sources including APIs, IoT devices, logs, and databases.Optimize ETL (Extract, Transform, Load) processes for performance and reliability.Collaborate with Data Scientists, Data Analysts, and DevOps teams.Ensure data quality, security, and governance compliance.Handle data storage architecture and implement data partitioning, compression, and caching.Monitor and troubleshoot data pipeline failures or latency issues.
What we are looking for:
- 11+ years of experience in UX/UI design, with a strong portfolio showcasing a deep understanding of design principles.
- Expertise in the full design cycle: from concept, research, and scoping to wireframing, prototyping, and user testing.
- Proven experience designing complex web applications and enterprise software, with a focus on creating scalable.
