We’re always looking for the ones truly passionate about their work. If you are amongst them, you can rest assured there is a place for you in eMAG. We’ve grown very fast and are determined to keep doing so. What brought us here is our desire for continuous evolution and practical results. More than 6000 colleagues are part of eMAG Teams. We strongly believe in people's development and therefore every year we invest more and more energy and resources to remain an organization that is constantly learning. We want to ensure that you’ll have the most talented colleagues and the proper environment to grow and achieve great results, to become what you desire on a personal and professional level. Join us, grow faster! Data Platform Engineer (Data Platform Team) We’re looking for an enthusiastic Data Platform Engineer eager to tune and maintain our company's big data ecosystem built on the Cloudera Data Platform (CDP). This role is crucial for ensuring the platform is stable, performant, and secure. The ideal candidate will be responsible for the day-to-day operations of the platform, handling all upgrades and suggesting improvements to our data-related processes. What you’ll have to do: - Platform Maintenance and Operations: Maintain the operational health of our Cloudera Data Platform cluster. This involves daily monitoring, troubleshooting, and resolving issues related to services like HDFS, YARN, Spark, Hive, Impala, and Kudu; - Performance Tuning: Proactively identify and resolve performance bottlenecks. Tune resource allocations within YARN and suggest optimizations for Impala to ensure our data workloads run efficiently; - Hive Metastore Administration: Administer and optimize the relational database that serves as the Hive Metastore. This includes performance tuning of the database instance, analyzing slow queries, managing connection pooling, and ensuring the stability and responsiveness of the metadata service; - Upgrades and Lifecycle Management: Plan and execute all platform upgrades, including major CDP releases. This requires careful coordination and testing to ensure a smooth transition with minimal disruption; - Security and Governance: Implement and manage security policies using Apache Ranger and ensure data access is properly controlled; - Process Improvement: Continuously suggest and implement improvements to platform processes. This includes automating routine administrative tasks and developing best practices for platform usage and maintenance. What makes you a good fit: - Deep Technical Expertise: Solid experience with big data technologies and the Hadoop ecosystem. While direct Cloudera Data Platform experience is a plus, we value a strong background in distributed systems and open-source big data frameworks like Apache Hadoop and Apache Spark; - Database Administration & Tuning: Strong hands-on experience with relational databases such as PostgreSQL, MySQL, or Oracle. The ability to analyze and optimize database queries, manage indexes, and configure database parameters to prevent performance bottlenecks; - Hive Metastore Knowledge: A solid understanding of the Hive Metastore service, its function within the ecosystem, and how it interacts with the underlying relational database; - Scripting and Automation: Proficiency in scripting languages such as Bash is essential. Experience with Infrastructure as Code (IaC) and configuration management tools like Terraform, Ansible, or Puppet is highly valued for automating platform deployment and maintenance; - Operating Systems: Strong command-line skills in a Linux/Unix environment, including system administration, shell scripting, and network troubleshooting; - Problem-Solving: Exceptional analytical and troubleshooting skills. The ability to quickly diagnose and solve complex technical issues in a distributed environment, including database-related performance problems; - Cloud Experience: Experience with one or more major cloud platforms (AWS, Azure, or GCP) is a plus. What we’ve prepared for you: - Medical subscription: Medicover, MedLife or Regina Maria. - A flexible budget that you can invest in yourself as you wish: meal tickets, holiday tickets, cultural vouchers, private pension, foreign language classes, eMAG, Fashion Days, Therme & Genius, membership to different gyms or even professional development classes. - Different discounts from our partners: banking, mobile, dental medicine or wellness. - Access to the Bookster library and free credits on the Hilio psycho-emotional health platform. - An accelerated learning environment, with access to over 100.000 curated online resources and platforms, learning academies and development programs. - New headquarters, where sleek design, natural light, and versatile spaces create an energizing and comfortable environment for hybrid work. #midsenior #LI-remote Curious to find out more about the next step in your career? Apply now and if your experience is relevant for the role you wish, we will give you a call for more details! Also, here (https://teams.emag.ro/politica-de-confidentialitate/) you can find our confidentiality policy if you want to consult it.