Software Engineer (AI Systems)

Purpose of Position

The Software Engineer (AI Systems), equivalent in scope to a Software Engineer with 5-7 years of experience, will be the primary engineer on a newly-formed Review Process Innovation (RPI) team working on EdReports' AI-powered products. This role will spend the majority of their time developing systems to support EdReports’ review process and it emphasizes hands-on coding, implementation, and technical ownership of solutions, while also contributing to full-stack systems as a member of our engineering team. Working closely with product managers, designers, and subject matter experts, this role translates user and organization needs into high-quality, accessible, and scalable systems.

As the primary engineer working on our AI-powered products, this person will focus on integrating and operationalizing AI capabilities within production systems, rather than developing or training machine learning models.

Key Responsibilities & Outcomes

Key Responsibilities:

• Partner closely with product managers and subject matter experts to deeply understand the review process, user needs and pain points, and translate them into technical solutions.
• Design and implement AI-powered system components, including building data ingestion pipelines, implementing retrieval systems to surface relevant content, designing prompt workflows, and coordinating multi-step interactions between LLMs and external tools.
• Build internal tools and interfaces that enable users to interact with AI-generated outputs, including reviewing evidence, refining results, and contributing to final output.
• Develop and optimize data pipelines and storage systems to support large, multi-modal curriculum datasets (e.g., long-form PDFs, web content, and embedded media), including metadata tagging and efficient retrieval.
• Define and implement evaluation approaches (e.g., human-in-the-loop review, benchmarking, and output validation) to assess the quality, accuracy, and bias of AI-generated outputs.
• Rapidly prototype and iterate on AI-driven features, balancing experimentation with production-grade engineering.
• Develop and maintain systems, ensuring robust performance and adherence to web accessibility standards, security best practices, data privacy standards, and ethical technology use, especially when exploring AI applications.
• Contribute high-quality, maintainable code, including documentation, to ensure code quality across the organization’s systems.
• Provide strategic technical recommendations to leadership, aligning innovations with organizational goals.
• Contribute to evolving team priorities and organizational needs, adapting approaches while maintaining clear ownership of outcomes and responsibilities.

Outcomes:

First 30 days

• Gain a strong understanding of the company’s mission, product, architecture, and engineering practices.
• Develop a clear understanding of the system architecture, including data flow, retrieval approach, and prompt design strategy.
• Full participant in the Review Process Innovation (RPI) product team, contributing code to regular releases aligned with team sprints.

First 60 days

• Demonstrate a deep understanding of EdReport’s product (reports) by taking ownership of a product feature through the entire lifecycle, from participation in product team design through release, including testing and documentation.
• Deliver an end-to-end feature that incorporates AI functionality (e.g., retrieval + prompt + output workflow), including evaluation of output quality.
• Demonstrate code quality through participation in peer code reviews.

First 90 days

• Independently identify and implement improvements to system performance or output quality through iteration (e.g., prompt refinement, retrieval tuning, or pipeline optimization).
• Receive positive feedback from product partners and subject-matter experts on collaboration and technical leadership.

Travel

This is a fully remote role based anywhere in the US. National travel (likely 10%) will occur related to organizational needs and for professional learning, as needed. The amount of travel will be monitored to ensure it is appropriate for both the organization and the Software Engineer (AI Systems).

Qualifications

Required:

• Passion for EdReports’ mission and vision, our core values, and our commitment to Diversity, Belonging, Inclusion, and Equity.
• 5-7 years of professional experience in software development or AI systems development; a related advanced degree (e.g., MS or PhD in Computer Science or a related field) may substitute for up to 2 years of experience.
• Experience building production systems using LLM APIs, including retrieval-augmented generation (RAG), prompt design, and orchestration frameworks.
• Experience working with data retrieval systems, search infrastructure, or information retrieval concepts.
• Expertise in scalable, secure web systems, with significant experience in cloud platforms such as Google Cloud or AWS.
• Experience with automated testing frameworks and CI/CD pipelines.
• Strong product mindset, with experience delivering user-centered features in collaboration with product and design teams.
• Exceptional communication skills, with a proven ability to convey complex technical concepts to non-technical stakeholders.
• Bachelor’s degree.

Preferred:

• Experience designing systems that incorporate human review or feedback loops into automated workflows.
• Experience working with large document sets (e.g., parsing, chunking, indexing PDFs or web content).
• Experience building inclusive digital experiences that meet or exceed accessibility standards (e.g., WCAG, ARIA).
• Experience in nonprofit or education sectors, with a focus on technology-driven equity initiatives.
• Experience with analytics and experimentation platforms to inform data-driven decision-making.
• Experience in a startup or fast-paced environment, demonstrating resourcefulness and innovation.

Salary

The salary for this position is $119,981 - $179,971 annually. At EdReports, we determine final salaries based on the role's requirements and the candidate's experience and skills, while maintaining equity within our compensation bands. To support fairness and provide opportunities for growth, we typically offer salaries at or below the midpoint of the range. All salary offers are non-negotiable to ensure consistency and equity across the organization.

Benefits

We know the importance of living a fulfilling, healthy life–both professionally and personally. That’s why some of the benefits we offer include:

• Unlimited Discretionary Time Off (DTO) and Sick Time,
• 21 days of paid holidays and office closure days in 2026,
• Monthly Communications Reimbursement,
• Initial home office and technology setup stipend,
• EdReports pays for 90% of health care for both the employee and their immediate family, and
• 401k that new hires become eligible for after six months of employment (includes safe harbor, employer match, etc.).

Work Authorization Requirements

All EdReports employees must reside in and be authorized to work in the United States. EdReports does not sponsor employment visas, and we are unable to consider candidates residing outside the U.S.

Physical Requirements

Work is normally performed in a remote office environment including, but not limited to standing and sitting for long periods of time; and fine-finger and hand manipulation to operate a computer and keyboard. Employee is required to have close visual acuity to perform an activity such as preparing and analyzing electronic information, transcribing, viewing a computer terminal, and extensive reading. This person will travel by car, air, or other transportation (as indicated in the Travel section) and should be able to physically withstand the demands of such travel. Employee may be required to walk for long distances at retreat venues or other relevant sites.