Principal Software Engineer II - Distributed Systems - Elasticsearch

Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI.

What Is The Role

We are on the lookout for a Principal Software Engineer II to join our Elasticsearch - Distributed Systems team and focus on how Elasticsearch provides scale, performance, and resilience. This team owns how nodes in an Elasticsearch cluster communicate, and how data are indexed, allocated, and replicated across nodes.

What You Will Be Doing

Improving Elasticsearch’s components that support concurrent and consistent indexing across multiple machines.

Maintaining our cluster coordination system to keep performance high even though nodes come and go from the cluster and data moves around, while maintaining the safety and liveness properties of the system as a whole.

Pushing the limits on the number of shards, nodes, and petabytes that Elasticsearch can handle today

Looking into all kinds of issues, including performance or concurrency issues, and proposing solutions.

Supporting our support engineers with the harder problems.

What You Bring

A strong background in distributed systems and consensus algorithms.

You have strong skills in core Java and are conversant in the standard library of data structures and concurrency constructs, as well as newer language features.

You have a deep technical proficiency in algorithms.

You have shown your ability to understand and work on complex, highly distributed systems.

You demonstrate the ability to build and debug features with a broad impact, running on multiple machines.

You are able to own projects from beginning to end. This covers both technical design and working with others to develop needed components.

You have experience leading projects spanning multiple teams.

You have experience communicating with a variety of stakeholders.

Bonus Points

Data stores

Search, analytics, Lucene

Strong knowledge of the JDK

Asynchronous event-driven network frameworks such as Netty

Additional Information - We Take Care of Our People

As a distributed company, diversity drives our identity. Whether you’re looking to launch a new career or grow an existing one, Elastic is the type of company where you can balance great work with great life. Your age is only a number. It doesn’t matter if you’re just out of college or your children are; we need you for what you can do.

We strive to have parity of benefits across regions and while regulations differ from place to place, we believe taking care of our people is the right thing to do.

Competitive pay based on the work you do here and not your previous salary

Health coverage for you and your family in many locations

Ability to craft your calendar with flexible locations and schedules for many roles

Generous number of vacation days each year

Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service

Up to 40 hours each year to use toward volunteer projects you love

Embracing parenthood with minimum of 16 weeks of parental leave

Different people approach problems differently. We need that. Elastic is an equal opportunity employer and is committed to creating an inclusive culture that celebrates different perspectives, experiences, and backgrounds. Qualified applicants will receive consideration for employment without regard to race, ethnicity, color, religion, sex, pregnancy, sexual orientation, gender perception or identity, national or