[EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code
-
Updated
Jun 16, 2024 - Python
#
automatic-evaluation
Here are 8 public repositories matching this topic...
Accepted at ISCSLP 2026 · Target-level benchmark for raw-input Chinese news TTS pronunciation
nlp benchmark text-to-speech leaderboard pronunciation tts speech-synthesis speech-recognition asr spoken-language-processing text-normalization chinese-tts automatic-evaluation chinese-news
-
Updated
Sep 3, 2026 - Python
MONSERRATE is a dataset specifically created to evaluate Question Generation systems. It has, on average, 26 questions associated to each source sentence, attempting to be an “exhaustive” reference.
-
Updated
Oct 28, 2022 - Python
Success and Failure Linguistic Simplification Annotation 💃
-
Updated
May 11, 2024 - Python
Multidimensional Evaluation for Text Style Transfer Using ChatGPT. Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer (HumEval 2022)
-
Updated
Apr 27, 2023 - Python
[TMLR 2026] Savaal: Scalable, Concept-Driven Question Generation
-
Updated
Jul 27, 2026 - Python
Requirements-to-Running-Code benchmark for AI/LLM systems and frameworks—builds, runs, and auto-scores apps across functional and non-functional metrics.
testing docker kubernetes security devops benchmark ai mutation-testing integration-testing owasp software-engineering code-quality reproducibility lighthouse requirements-engineering e2e-testing opentelemetry semgrep automatic-evaluation llm
-
Updated
Sep 8, 2025 - Python
Fully automated, reproducible protocol (no paid API, no human annotation) for generating and evaluating LLM-generated STEM teaching analogies on a single consumer GPU: prompting strategies, a multi-model judge panel with a validated rubric (SAQR), comprehension and Hindi cross-lingual studies, and the limits of automated evaluation.
nlp reproducible-research cross-lingual automatic-evaluation stem-education educational-nlp large-language-models llm prompt-engineering ollama llm-as-a-judge analogy-generation
-
Updated
Sep 9, 2026 - Python
Add this topic to your repo
To associate your repository with the automatic-evaluation topic, visit your repo's landing page and select "manage topics."