🔍 Evaluation of AI Quality
Background
In this task, you will evaluate the quality of image edits based on a textual instruction and two input images regarding three aspects: Instruction-Edit Alignment, Visual Quality and Consistency.
Each aspect should be rated on a scale from 1 to 10, where 1 indicates 'very poor' and 10 represents 'excellent'.
Please ensure you have read the detailed instructions provided in this document before starting the labeling process.
Dataset Source
This project uses the MagicBrush dataset (dev split), released under the CC-BY-4.0 license.
Labeling
Please enter a nickname to avoid repeating image pairs. Make sure to remember this nickname for future sessions. If you choose not to enter a nickname, your ratings will not be saved.