Sr. Software Engineer, Pretraining Data

Engineering · Full-time · Palo Alto, CA

Apply

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

SR. SOFTWARE ENGINEER, PRETRAINING DATA

We're looking for Senior Software Engineers to build and own the data systems behind our frontier models' initial training. You'll work on large-scale crawling, data platform, and pipeline infrastructure, turning raw dumps into the datasets our models train on, and making iteration with researchers fast and reliable. As a senior engineer, you'll set technical direction for these systems, lead projects across teams, and mentor other engineers as our pretraining data scales.

RESPONSIBILITIES:

  • Data Platform: Design, build, and scale the distributed infrastructure that transforms raw web, code, multimodal, and acquired data into training-ready datasets for frontier model pretraining. Own high-throughput data pipelines, orchestration systems, and tooling that enable fast, reliable, observable, and reproducible data processing at massive scale, with end-to-end visibility into data lineage, freshness, and pipeline health.

  • Data Quality: Build and deploy high-performance models and algorithms to classify, rank, deduplicate, filter, and clean training data at extreme throughput. Design and execute rigorous experiments across data mixtures, sampling strategies, and quality thresholds to quantify their impact on training loss, downstream evaluations, and model capabilities, translating research findings into production systems.

  • Crawling: Build and optimize large-scale web crawling infrastructure spanning URL discovery, prioritization, host scheduling, fetching, parsing, and content extraction. Improve crawl coverage, efficiency, and reliability through intelligent scheduling, anti-bot resilience, robust extraction systems, and automated recovery, ensuring high-quality web data flows seamlessly into downstream training pipelines.

  • Technical Leadership & Collaboration: Lead complex engineering initiatives across Data Platform, Data Quality, Crawling, Acquisition, and model training teams. Influence technical direction, drive architectural decisions, mentor engineers, and translate improvements in data infrastructure, coverage, and quality into measurable gains in model performance.

BASIC QUALIFICATIONS:

  • 5+ years of professional software engineering experience building distributed systems and/or large-scale data infrastructure

PREFERRED SKILLS AND EXPERIENCE:

  • Strong infrastructure or data platform background, ideally with a spike of outlier depth

  • High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience

  • Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents

  • Strong intuitions about large-scale distributed systems, including running them reliably at frontier scale

  • Track record of leading technical projects across teams and mentoring other engineers

  • Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs

ADDITIONAL REQUIREMENTS:

  • Onsite role: must be able to work in person at the Palo Alto office

COMPENSATION AND BENEFITS:

The annual compensation range for this role is listed below.

Annual Salary:

$220,000 - $357,000 USD

Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.

Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.


Apply for this role

U.S. EQUAL EMPLOYMENT OPPORTUNITY INFORMATION   (Completion is voluntary and will not subject you to adverse treatment)

Anysphere, Inc. provides equal employment opportunities to applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other classification protected by applicable law.

We invite all applicants to voluntarily self-identify their race, ethnicity, and gender. Submission of the information on this form is strictly voluntary and refusal to provide it will not subject you to any adverse treatment. Information obtained will be retained in a confidential file and separate from personnel records. This information may only be used in accordance with the provision of applicable federal laws, executive orders, and regulations. If you want more information about any of the sections, please check with a company representative.

SELF-IDENTIFICATION OF VETERAN STATUS  (Completion is voluntary and will not subject you to adverse treatment)

If you believe that you belong to any of the following categories of protected veterans, please indicate by making the appropriate selection

  • Disabled veteran – A veteran who served on active duty in the U.S. military and is entitled to disability compensation (or who but for the receipt of military retired pay would be entitled to disability compensation) under laws administered by the Secretary of Veterans Affairs, or was discharged or released from active duty because of a service-connected disability

  • Recently separated veteran – A veteran separated during the three-year period beginning on the date of the veteran's discharge or release from active duty in the U.S military, ground, naval, or air service

  • Active duty wartime or campaign badge veteran – A veteran who served on active duty in the U.S. military during a war, or in a campaign or expedition for which a campaign badge was authorized under the laws administered by the Department of Defense

  • Armed forces service medal veteran – A veteran who, while serving on active duty in the U.S. military, ground, naval, or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985 (61 Fed. Reg. 1209).