Senior Big Data Engineer – Remote – arenaflex – Hadoop, Spark, Data Warehousing, Cloud & Machine Learning Solutions

About arenaflex

arenaflex is a global leader in innovative financial technology solutions, empowering millions of customers worldwide with secure, data‑driven services. Our mission is to harness the power of big data, artificial intelligence, and cloud computing to create seamless, personalized experiences across every touchpoint. As a forward‑thinking organization, arenaflex invests heavily in cutting‑edge infrastructure, fosters a culture of continuous learning, and encourages every employee to push the boundaries of what’s possible in the data domain.

Why This Role Matters

In today’s hyper‑connected economy, data is the lifeblood of strategic decision‑making. As a Senior Big Data Engineer at arenaflex, you will be at the heart of a high‑impact, fast‑moving team that designs, builds, and operates the data platforms that power critical business insights, fraud detection, real‑time analytics, and next‑generation product experiences. Your work will directly influence the scalability, reliability, and performance of systems that serve millions of transactions every day.

Key Responsibilities

Core Engineering Duties

• Design, develop, and maintain large‑scale data pipelines using Hadoop, Spark, Hive, and PySpark to ingest, transform, and store petabytes of structured and unstructured data.
• Collaborate with product owners, data scientists, and analytics teams to translate business requirements into robust, production‑ready data solutions.
• Write clean, modular, and well‑documented code in Python, Scala, and Java, adhering to best practices for readability, testability, and performance.
• Implement automated testing frameworks, continuous integration (CI) pipelines, and code review processes to ensure high‑quality releases.
• Optimize SQL and Spark queries, fine‑tune Hive tables, and manage data partitioning strategies to achieve sub‑second latency for critical analytics workloads.
• Lead the migration of legacy batch processes to real‑time streaming architectures using Kafka and other event‑driven technologies.
• Monitor, troubleshoot, and resolve production incidents, employing root‑cause analysis and proactive remediation to maintain 99.9% system uptime.
• Mentor junior engineers, conduct technical workshops, and champion a culture of continuous improvement and knowledge sharing.

Strategic Initiatives

• Drive the adoption of cloud platforms such as GCP and AWS, designing hybrid architectures that balance cost, security, and performance.
• Architect micro‑services and containerized data services using Docker and Kubernetes to enable scalable, reusable components.
• Explore emerging technologies—machine learning pipelines, graph databases, and serverless computing—to keep arenaflex at the forefront of data innovation.
• Partner with governance and compliance teams to embed data security, privacy, and regulatory controls directly into the data engineering workflow.

Essential Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related discipline (or equivalent professional experience).
• Minimum 2+ years of hands‑on experience developing large‑scale data processing solutions in a production environment.
• Proven expertise with Hadoop ecosystem tools (HDFS, Hive, Spark, Pig) and strong command of SQL/Hive/PySpark for data manipulation.
• Solid programming background in Java, Python, or Scala, with a track record of delivering clean, maintainable code.
• Experience building and maintaining data pipelines on UNIX/Linux platforms, including shell scripting for automation.
• Demonstrated ability to design, implement, and optimize data warehouses and data lakes, with a focus on performance tuning and cost efficiency.
• Strong analytical mindset, capable of translating complex business problems into elegant technical solutions.

Preferred Qualifications & Nice‑to‑Have Skills

• Hands‑on experience with cloud services (GCP BigQuery, AWS Redshift, Azure Data Lake) and infrastructure‑as‑code tools such as Terraform or CloudFormation.
• Familiarity with streaming platforms like Kafka, Kinesis, or Pulsar, and the ability to design end‑to‑end real‑time data flows.
• Exposure to container orchestration (Docker, Kubernetes) and micro‑service architecture patterns.
• Knowledge of NoSQL databases (HBase, Cassandra, MongoDB) and their appropriate use cases.
• Experience with version control systems (GitHub, Bitbucket) and CI/CD pipelines (Jenkins, GitLab CI, Azure DevOps).
• Understanding of data governance, security frameworks, and compliance standards (PCI‑DSS, GDPR, CCPA).
• Excellent communication and collaboration skills, with a proven ability to influence cross‑functional teams.

Core Skills & Competencies

• Technical Excellence: Deep knowledge of distributed computing, data modeling, and performance optimization.
• Problem‑Solving: Ability to diagnose complex system issues quickly and propose scalable, future‑proof solutions.
• Leadership: Experience guiding agile squads, conducting code reviews, and fostering a culture of mentorship.
• Adaptability: Comfort working in a fast‑paced environment where priorities shift based on business needs.
• Collaboration: Strong interpersonal skills to work effectively with data scientists, product managers, and operations teams.
• Continuous Learning: Passion for staying current with emerging data technologies and industry best practices.

Career Growth & Learning Opportunities

arenaflex invests heavily in the professional development of its engineers. In this role, you will have access to:

• Annual tuition reimbursement for certifications such as Cloudera Certified Professional, AWS Certified Big Data, or Google Cloud Professional Data Engineer.
• Internal tech talks, hackathons, and innovation labs where you can experiment with cutting‑edge tools and present your findings.
• Mentorship programs pairing you with senior architects and industry experts to accelerate your career trajectory.
• Opportunities to lead cross‑functional initiatives, influence product roadmaps, and shape the future data strategy of arenaflex.

Work Environment & Culture at arenaflex

Our remote‑first philosophy empowers you to work from anywhere in the United States while staying closely connected to a vibrant, inclusive community. arenaflex values:

• Innovation: A culture that rewards curiosity, experimentation, and bold ideas.
• Collaboration: Regular virtual coffee chats, team retrospectives, and cross‑team workshops to keep communication fluid.
• Well‑Being: Flexible work hours, generous paid time off, mental‑health resources, and a comprehensive wellness stipend.
• Diversity & Inclusion: Employee resource groups, inclusive hiring practices, and a commitment to equitable growth for all team members.

Compensation, Perks & Benefits

arenaflex offers a competitive hourly rate ranging from $20–$30 per hour, commensurate with experience and expertise. In addition to base compensation, you will receive:

• Performance‑based bonuses tied to project milestones and business outcomes.
• Health, dental, and vision insurance plans with low deductibles.
• 401(k) retirement plan with company matching.
• Paid parental leave, adoption assistance, and family‑friendly policies.
• Technology stipend for home office setup, high‑speed internet, and ergonomic equipment.
• Access to a curated library of technical courses, conferences, and industry events.

How to Apply

If you are a passionate data engineer who thrives on solving complex problems, loves to work with cutting‑edge technologies, and wants to make a tangible impact at a forward‑thinking organization, we want to hear from you. Join arenaflex and help shape the future of data‑driven finance.

Apply Now