Senior Monitoring & Data Integration Engineer
Summary
- We’re seeking a Senior Monitoring & Data Integration Engineer to support and integrate real-time data pipelines, handle customer ad-hoc data requests, and ensure system reliability.
- Ideal candidates are strong with PostgreSQL and Grafana, comfortable with networking fundamentals, and (bonus) familiar with oil & gas drilling data. You’ll own monitoring, integration, and production support for critical data systems.
- You will maintain, monitor, and integrate real-time data systems. The role blends pipeline monitoring, external data-source integrations, customer support, and ad-hoc troubleshooting.
- You’ll work closely with customers and developers to improve reliability and design integration enhancements that meet business and operational needs.
Contract
Staff
Experience
5+
Minimum Education
Degree Computer Science, Maths or Eng
Location
Kuala Lumpur
Posted
01/09/25
Responsibilities
Monitoring & Data Streaming
- Monitor and troubleshoot real-time pipelines and Grafana dashboards to ensure accurate, timely data flow.
- Resolve streaming issues (latency, gaps, anomalies) and optimize performance and scalability as data volume grows.
Integration & Customer Support
- Integrate new data sources and APIs (REST, SOAP) into existing monitoring and data workflows.
- Respond to customer data needs and requests (ad-hoc pulls, dashboard tweaks, exports) and communicate status clearly.
- Collaborate with stakeholders to prioritize integration and support requests.
Engineering Assistance
- Develop and optimize PostgreSQL queries for reporting, validation, and monitoring.
- Support automation and data-flow development using Node-RED, Python, or Bash.
- Improve monitoring and alerting, including definition and integration of new metrics.
- Contribute to cross-team efforts to ensure consistent, reliable integration practices.
Collaboration & Feedback
- Provide actionable feedback to the development team based on recurring alerts, integration challenges, and support cases to continually improve reliability and scalability.
Requirements
- Strong PostgreSQL/SQL skills; ability to write and debug complex queries.
- Experience with Grafana or similar monitoring/visualization tools.
- Experience with Node-RED for data flows and system automation.
- Proficiency in networking fundamentals (TCP/IP, firewalls, VPNs).
- Proven troubleshooting and problem-solving abilities.
- Strong communication skills for cross-functional collaboration and customer interaction.
Preferred
- Data streaming / industrial data exposure: Kafka, MQTT, WITSML, or SCADA.
- Python scripting for testing/automation.
- Familiarity with oil & gas drilling data and operational contexts.
- Git for version control and collaborative workflows.
- HTML/JavaScript/Node.js for lightweight dashboards and internal tools.
- Experience with modern data-engineering and monitoring frameworks.
Education
- Degree or diploma in Computer Science, Mathematics, or Engineering; or equivalent practical experience.
- Self-taught engineers with proven expertise in SQL, monitoring, or integrations are welcome.