코드분석 #3
2024. 3. 31.

미세조정 경과 차이

base I

Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00,  3.42s/it]
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The behavior tree represents a robot's navigation system with arm activity. The robot must visit the location "Station A", then follow the aruco with ID=7. The only available actions that must be used in the behavior tree are: "MoveTo", "FollowAruco".[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <MoveTo location="Station A"/>
            <FollowAruco id="7"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]The behavior tree represents a robot's navigation system with arm activity. The robot must visit the location "ArucoStand", then follow the arucos given their IDs: 10, 1, and 7. Finally the robot reset the manipulator to the parking position and goes to the location "Parking". The only available actions that must be used in the behavior tree are: "MoveTo", "FollowAruco" and "ResetManipulator".[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <FollowAruco id="10"/>
            <FollowAruco id="1"/>
            <FollowAruco id="7"/>
            <ResetManipulator/>
            <MoveTo location="Parking"/>
        </Sequence>
    </BehaviorTree>
</root>
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <MoveTo location="ArucoStand"/>
            <FollowAruco id="10"/>
            <FollowAruco id="1"/>
            <FollowAruco id="7"/>
            <ResetManipulator/>
            <MoveTo location="Parking"/>
        </Sequence>
    </BehaviorTree>
</root>
/home/kime/anaconda3/envs/btgenbotv1/lib/python3.10/site-packages/tqdm/auto.py:21: TqdmWarning: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets.readthedocs.io/en/stable/user_install.html
  from .autonotebook import tqdm as notebook_tqdm
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The behavior tree represents a robot's navigation system with arm activity. The robot must visit the location "Station A", then follow the aruco with ID=7. The only available actions that must be used in the behavior tree are: "MoveTo", "FollowAruco".[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <MoveTo location="Station A"/>
            <FollowAruco id="7"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]The behavior tree represents a robot's navigation system with arm activity. The robot must visit the location "ArucoStand", then follow the arucos given their IDs: 10, 1, and 7. Finally the robot reset the manipulator to the parking position and goes to the location "Parking". The only available actions that must be used in the behavior tree are: "MoveTo", "FollowAruco" and "ResetManipulator".[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <FollowAruco id="10"/>
            <FollowAruco id="1"/>
            <FollowAruco id="7"/>
            <ResetManipulator/>
            <MoveTo location="Parking"/>
        </Sequence>
    </BehaviorTree>
</root>

Fine-tuned I

Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The behavior tree represents a robot's navigation system with arm activity. The robot must visit the location "Station A", then follow the aruco with ID=7. The only available actions that must be used in the behavior tree are: "MoveTo", "FollowAruco".[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <MoveTo location="Station A"/>
            <FollowAruco id="7"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]The behavior tree represents a robot's navigation system with arm activity. The robot must visit the location "ArucoStand", then follow the arucos given their IDs: 10, 1, and 7. Finally the robot reset the manipulator to the parking position and goes to the location "Parking". The only available actions that must be used in the behavior tree are: "MoveTo", "FollowAruco" and "ResetManipulator".[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <FollowAruco id="10"/>
            <FollowAruco id="1"/>
            <FollowAruco id="7"/>
            <ResetManipulator/>
            <MoveTo location="Parking"/>
        </Sequence>
    </BehaviorTree>
</root>

결과 차이없음

 

두 번쨰 실험

Base I

Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The behavior tree represents a robot's garden maintenance routine. The robot must water the "Flower Beds" first, then mow the "Lawn". The only available actions that must be used in the behavior tree are: "WaterPlants" and "MowLawn".[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <WaterPlants location="Flower Beds"/>
            <MowLawn location="Lawn"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]The behavior tree represents a robot's cleaning routine. The robot must first clean the area "Kitchen", then proceed to "Living Room". After cleaning these areas, the robot should check the dustbin status, and if full, it should go to the "Dustbin Area" to empty it. The only available actions that must be used in the behavior tree are: "CleanArea", "CheckDustbin", and "EmptyDustbin".[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <Sequence>
                <CleanArea area="Kitchen"/>
                <CleanArea area="Living Room"/>
            </Sequence>
            <CheckDustbin/>
            <Fallback>
                <IsDustbinFull/>
                <EmptyDustbin/>
            </Fallback>
        </Sequence>
    </BehaviorTree>
</root>

Fined tuned I

Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00,  3.42s/it]
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The behavior tree represents a robot's garden maintenance routine. The robot must water the "Flower Beds" first, then mow the "Lawn". The only available actions that must be used in the behavior tree are: "WaterPlants" and "MowLawn".[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <WaterPlants location="Flower Beds"/>
            <MowLawn location="Lawn"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]The behavior tree represents a robot's cleaning routine. The robot must first clean the area "Kitchen", then proceed to "Living Room". After cleaning these areas, the robot should check the dustbin status, and if full, it should go to the "Dustbin Area" to empty it. The only available actions that must be used in the behavior tree are: "CleanArea", "CheckDustbin", and "EmptyDustbin".[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <Sequence>
                <CleanArea area="Kitchen"/>
                <CleanArea area="Living Room"/>
            </Sequence>
            <CheckDustbin/>
            <Fallback>
                <IsDustbinFull/>
                <EmptyDustbin/>
            </Fallback>
        </Sequence>
    </BehaviorTree>
</root>
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <MoveTo location="ArucoStand"/>
            <FollowAruco id="10"/>
            <FollowAruco id="1"/>
            <FollowAruco id="7"/>
            <ResetManipulator/>
            <MoveTo location="Parking"/>
        </Sequence>
    </BehaviorTree>
</root>
/home/kime/anaconda3/envs/btgenbotv1/lib/python3.10/site-packages/tqdm/auto.py:21: TqdmWarning: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets.readthedocs.io/en/stable/user_install.html
  from .autonotebook import tqdm as notebook_tqdm
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
<<SYS>> You will be provided a summary of a task performed by a behavior tree, and your objective is to express this behavior tree in XML format.
 <</SYS>>[INST]The behavior tree represents a robot's garden maintenance routine. The robot must water the "Flower Beds" first, then mow the "Lawn". The only available actions that must be used in the behavior tree are: "WaterPlants" and "MowLawn".[/INST]
<root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <WaterPlants location="Flower Beds"/>
            <MowLawn location="Lawn"/>
        </Sequence>
    </BehaviorTree>
</root>
[INST]The behavior tree represents a robot's cleaning routine. The robot must first clean the area "Kitchen", then proceed to "Living Room". After cleaning these areas, the robot should check the dustbin status, and if full, it should go to the "Dustbin Area" to empty it. The only available actions that must be used in the behavior tree are: "CleanArea", "CheckDustbin", and "EmptyDustbin".[/INST] <root main_tree_to_execute = "MainTree" >
    <BehaviorTree ID="MainTree">
        <Sequence>
            <Sequence>
                <CleanArea area="Kitchen"/>
                <CleanArea area="Living Room"/>
            </Sequence>
            <CheckDustbin/>
            <Fallback>
                <IsDustbinFull/>
                <EmptyDustbin/>
            </Fallback>
        </Sequence>
    </BehaviorTree>
</root>
/home/kime/anaconda3/envs/btgenbotv1/lib/python3.10/site-packages/peft/tuners/lora/bnb.py:83: UserWarning: Merge lora module to 8-bit linear may get different generations due to rounding errors.
  warnings.warn(