base모델 비교

 

입력한 xml형식

context = "<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.\n <</SYS>>"
task = "Please take out an apple from the refrigerator."

# One-shot example
example_task = """The refrigerator is in the kitchen, and the apple is on the third shelf of the refrigerator."""
example_output = """
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <WaterPlants location="Flower Beds"/>
            <MowLawn location="Lawn"/>
        </Sequence>
    </BehaviorTree>
</root>
"""

base

Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The refrigerator is in the kitchen, and the apple is on the third shelf of the refrigerator.[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <WaterPlants location="Flower Beds"/>
            <MowLawn location="Lawn"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]Please take out an apple from the refrigerator.[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <OpenRefrigerator door_location="Kitchen"/>
            <GrabApple location="Third Shelf" />
        </Sequence>
    </BehaviorTree>
</root>

fine-tuned model

<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The refrigerator is in the kitchen, and the apple is on the third shelf of the refrigerator.[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <WaterPlants location="Flower Beds"/>
            <MowLawn location="Lawn"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]Please take out an apple from the refrigerator.[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <OpenRefrigerator door_location="Kitchen"/>
            <GrabApple location="Third Shelf" />
        </Sequence>
    </BehaviorTree>
</root>