htmlImproving LLM-Driven Data Annotation Through Structured Instruction Engineering — Maria Molchanova
Maria Molchanova
← Back

Research Paper

Improving LLM-Driven Data Annotation Through Structured Instruction Engineering

5th IEEE International Conference on Human-Machine Systems (ICHMS 2025)

IEEE · ICHMS 20252025

Published in the IEEE ICHMS 2025 proceedings, pp. 168–173.

This paper studies how formal instruction structure affects an LLM's ability to perform complex data annotation. Instead of focusing solely on model selection, it addresses task engineering: decomposing requirements, clearly defining classes, context, and constraints, and improving reproducibility and quality.

This research builds on earlier dialogue-annotation studies and treats instruction engineering as a controllable mechanism for LLM-assisted annotation.

About the venue

The 5th IEEE International Conference on Human-Machine Systems

ICHMS is an international conference of the IEEE Systems, Man, and Cybernetics Society on human-machine systems. Its 2025 theme directly addressed AI and LLMs and their influence on human-machine interaction.

Talk

Presented at a conference

See photographs and the full story behind the presentation.

Open the talk page ↗

Links

Official resources