Document Type

Assignment

Abstract

The basic mechanics of this activity are simple: choose a reading from class and try to manipulate the LLM to recreate it as close to the original as possible. As a rule, I generally try to produce and run activities that are modular, interchangeable, and adaptable. This activity is no different. In one course, we used the prompt and only the prompt—no scaffolding. In other courses, we scaffolded LLMs, understood how prompt engineering might work, and worked as a class to construct the prompt we thought would produce a suitable outcome.

For students, the limitations of the LLMs become clear almost immediately. With non-scaffolded classes, students will often attempt to put in the name of a text and instruct the LLM to recreate it—often to some hilarious results. Even with the scaffolded and carefully crafted prompts students begin to recognize the limitations. This might come in the form of length, depth, or even understanding of an abstract concept.

The most unexpected outcome was how deeply the students had to re-engage with content from the class. Of course, we have had discussions about voice, style, tone, message, etc. But, in this case, they felt compelled to clearly articulate these ideas to the LLM.

Publication Date

1-2024

Creative Commons License

Creative Commons Attribution-NonCommercial 4.0 International License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License

Share

COinS