Senior Software Engineer - Query Engine - Dremio

View Company Profile

Job Title

Senior Software Engineer - Query Engine

Job Location

Lisbon, Portugal

Job Listing URL

https://www.dremio.com/careers/job-postings/?gh_jid=6236879003

Job Description

Be Part of Building the Future

Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at www.dremio.com.

About the role

We are seeking a talented and motivated Senior Software Engineer to join our Datalake team within the Query Engine organization. In this role, you will focus on enhancing our query engine with a particular emphasis on the Iceberg table format and efficient scans of various file formats. This is an exciting opportunity to contribute to cutting-edge technology in the big data ecosystem.

What you’ll be doing

Designing and implementing features for Dremio’s query engine with a focus on the Iceberg table format
Optimizing file scan operations for various file formats, including Parquet, Avro and others
Collaborating with members of the query planning and query execution teams to ensure seamless integration of features across the code stack
Working with and contributing to open-source projects like Apache Iceberg, Parquet and Arrow
Maintaining and enhancing compliance with the Iceberg table format specification
Conducting performance tuning and benchmarking to enhance query execution speed
Understanding and reasoning about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment
Participating in code reviews and providing constructive feedback to peers

What we’re looking for

B.S., M.S. or PhD in Computer Science or in a related technical field
5+ years of software engineering experience, with a focus on database systems, query execution or related fields
Strong programming skills in an object oriented language such as Java or C++
Understanding of database internals, query planning, distributed systems, concurrency control, data replication, and storage systems
Familiarity with cloud object stores, such as AWS S3, ADLS or GCS.
Experience with Apache Iceberg, Parquet, AVRO and/or Delta
Interested and motivated to be part of a fast-moving startup with a fun and accomplished team
Desire to learn: You can stand your ground as well as be mentored by your teammates

Bonus points if you have

Experience working with and contributing to open source projects

Return to Office Philosophy

Workplace Wednesdays - to break down silos, build relationships and improve cross-team communication. Lunch catering / meal credits provided in the office and local socials align to Workplace Wednesdays. In general, Dremio will remain a hybrid work environment. We will not be implementing a 100% (5 days a week) return to office policy for all roles.

#LI-JF1 #LI-Remote

What we value

At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.

Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.

Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice.

Important Security Notice for Candidates

At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement here.

View Job Listing