Grafana Backend & Data Optimization Expertise

6-12 months

Remote

Inside ir35

Job Description

We are looking for a dynamic and versatile Enterprise Systems Engineer who will be responsible for managing multiple databases, caching solutions, and Back End services, with a special focus on Grafana Backend, object storage, and data optimization. The ideal candidate will have a broad understanding of how to manage and optimize large volumes of data, ensuring its efficient storage, transfer, and access. This role extends beyond database management into DevOps, system engineering, and performance optimization, supporting enterprise-scale environments.

In this role, the engineer will work with databases, object stores, and caching systems like memcached, and will focus on optimizing both data storage and transfer processes. Experience with logs management, monitoring solutions, and backends for Grafana, especially Mimir, is highly desirable. The ideal candidate should also be skilled in automation, leveraging tools like Chef, Scripting languages, and DevOps tools.

Key Responsibilities:

• Grafana Mimir Backend Management: Set up, configure, and maintain the Grafana Mimir Back End for high-performance monitoring and alerting.
• Data Optimization: Optimize the storage, movement, and transfer of large datasets across various systems, ensuring efficient resource utilization and performance.
• Cache Management: Deploy and manage caching solutions (eg, memcached) to optimize system performance and response times.
• Object Store Optimization: Work with and optimize object stores like Amazon S3, MinIO, or Ceph, ensuring they handle high volumes of data efficiently.
• Log Management & Monitoring: Configure logging systems, integrate solutions like Prometheus and Loki, and ensure logs are handled, stored, and monitored effectively.
• System Administration: Perform system engineering tasks, particularly on Unix-based systems (preferably Red Hat), including troubleshooting and performance tuning.
• Automation: Utilize automation tools (eg, Chef) and Scripting languages (eg, Python, Ruby, Bash) to automate system and database processes.
• DevOps & CI/CD: Build and manage CI/CD pipelines using Jenkins, ensuring continuous integration and efficient deployment processes.
• Proactive System Monitoring: Monitor database performance, system health, and logs, and implement proactive solutions to maintain system stability and performance.

Skill Set:

Technical Skills:

• Grafana & Mimir:
• Experience with configuring and managing Grafana Mimir backends and data sources.
• Expertise in setting up dashboards and monitoring solutions for enterprise-scale applications.
• Database & Data Management:
• Manage multiple databases: SQL (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra).
• Expertise in data optimization, ensuring that databases and storage solutions can handle large datasets effectively.
• Caching Solutions:
• Experience with memcached or similar caching technologies for improving data retrieval times and overall system performance.
• Object Store Management & Optimization:
• Optimize object storage systems such as Amazon S3, MinIO, or Ceph for high performance and efficient data storage.
• Log Management:
• Expertise in handling logs using tools like Prometheus, Loki, and ELK Stack for managing large volumes of logs and providing Real Time insights.
• Unix/Linux System Administration:
• Expertise in managing Red Hat Enterprise Linux or other Unix-based systems, including system performance tuning and service management.
• Automation & Scripting:
• Proficiency in automation using Chef or similar tools.