Are the implementation of the anonymous functions provided to LLMs?

[shizhl]

Hi, thank you for this amazing work!

I have looked through the released dataset and notice a problem. As shown below, the input 'prompt' contains a anonymous function 'func_13'. But no specific implmentation details of func_13 are provided. How does the LLM infer the functionality of the func_13 in its response?

[chenweize1998]

Hi! When collecting responses for Stage 1 training, we provide the model with function definitions. However, when converting these into training data, we remove the definitions so the model learns the "new" atomic skill in isolation. This approach ensures the model cannot solve level 2 problems without first learning this skill through Stage 1 training, allowing us to focus specifically on the injected atomic skill without interference from the model's pre-existing knowledge or ability.