About the role

As a Senior Software Engineer for this role, you will collaborate with the founding team to expand the integration of our Big Data processing acceleration technology with Apache Spark to drive new optimizations and broader SQL operation coverage. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed.

Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility.

What you will do

• Implement extensible optimizations in various query processing components such as batch processing code, data parsing, shuffling and data partitioning algorithms.
• Maintain the solution up to date and compatible with a variety of supported Apache Spark runtimes.
• Independently and diligently write, test and deploy production code driven by modern software engineering practices.
• Work with the internals of leading open-source software for Big Data analytics as part of our core product for the cloud.
• Collaborate with team members to drive new innovations on big data processing lying at the intersection of Big Data and compilers.

What you will bring

• 3+ years of experience working with performance optimization and complex codebases.
• Strong Java and C++ programming skills, as well as knowledge of GitHub workflows.
• Experience with profiling and debugging tools.
• Strong grasp of computer science fundamentals such as algorithms and data structures.
• Critical thinking and ability to work independently without direct supervision.

Nice-to-haves

• Entrepreneurial spirit and previous experience in early stage startups.
• Experience with Scala.
• Experience with query processing optimization.
• Understanding of Big Data file formats (e.g. Parquet, ORC, Avro).