41 lines
1.4 KiB
YAML
41 lines
1.4 KiB
YAML
|
|
prompts:
|
||
|
|
- id: p1
|
||
|
|
prompt: "What is AtoCore's architecture?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should mention layered architecture, SQLite, vector DB"
|
||
|
|
|
||
|
|
- id: p2
|
||
|
|
prompt: "What chunking strategy does AtoCore use?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should mention heading-aware splitting, 800 char max"
|
||
|
|
|
||
|
|
- id: p3
|
||
|
|
prompt: "What is the trust precedence order?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should list: Trusted Project State > AtoDrive > validated memory"
|
||
|
|
|
||
|
|
- id: p4
|
||
|
|
prompt: "How does AtoCore handle conflicts between sources?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should mention conflict resolution rules, no silent merging"
|
||
|
|
|
||
|
|
- id: p5
|
||
|
|
prompt: "What are the different memory types?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should list: Identity, Preferences, Project, Episodic, Knowledge, Adaptation, Trusted Project State"
|
||
|
|
|
||
|
|
- id: p6
|
||
|
|
prompt: "What is the context budget allocation?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should mention percentages: identity 5%, preferences 5%, project 20%, episodic 10%, retrieval 60%"
|
||
|
|
|
||
|
|
- id: p7
|
||
|
|
prompt: "What is a trivial prompt in AtoCore?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should mention: no project ref, no proper nouns, no past context dependency"
|
||
|
|
|
||
|
|
- id: p8
|
||
|
|
prompt: "What are the success criteria for the first win?"
|
||
|
|
project: atocore
|
||
|
|
expected: "Should mention: saves >=5 min lookup, >=80-90% accuracy, >=10 test prompts"
|