Skip to content

Prompt manager snapshot test is environment-dependent with local skill pollution #8484

@sunilkumarvalmiki

Description

@sunilkumarvalmiki

Summary

agents::prompt_manager::tests::test_all_platform_extensions is environment-dependent and fails when extra local skills/plugins are installed.

Environment

  • Repo: aaif-goose/goose
  • Commit tested: 3f5277538d5f6df1a88faca5e77cecc0ee208ae1 (origin/main)
  • Host: macOS 26.4.1 (arm64)
  • Date tested: 2026-04-11

Reproduction

source bin/activate-hermit
cargo test -p goose --lib

Expected

Snapshot test should be deterministic across machines and only include project-controlled platform extension skill text.

Actual

Test fails with snapshot diff because machine-local skills are injected into the prompt (e.g. capacity, customize, deploy-model, microsoft-foundry, preset).

Impact

  • Failing CI/local tests depending on developer environment
  • Non-deterministic prompt content for platform extensions
  • Snapshot churn and noisy diffs

Evidence

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions