CodeBERTScore: an automatic metric for code generation, based on BERTScore
-
Updated
Mar 1, 2024 - Jupyter Notebook
#
bertscore
Here are 57 public repositories matching this topic...
EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
natural-language-processing deep-learning text-generation fairness-ai fairness-ml pretrained-language-model bertscore metric-bias
-
Updated
Oct 19, 2022 - Jupyter Notebook
LLM Evaluation and Observability System for Football Content
python mongodb pre-commit openai cosine-similarity evaluation-metrics comet-ml hallucination huggingface-transformers zenml bertscore
-
Updated
Jun 19, 2025 - Python
MAchine Translation Evaluation Online (MATEO)
machine-translation comet ter bleu clarin machine-translation-metrics streamlit bertscore bleurt machine-translation-evaluation chrf
-
Updated
May 8, 2026 - Python
Domain-specialized Gemma 2 27B + Gemma 4 31B for SEC filings — fine-tuned on TPU v6e-8 with PyTorch/XLA FSDPv2, plus a Vertex AI Vector Search RAG demo (69 tickers × 381 filings). Same LoRA recipe, +3.5% / +5.8% BERTScore F1.
finance lora knowledge-distillation gemma tpu peft sec-filings rag streamlit pytorch-xla vertex-ai bertscore gemma-2 gemma-4
-
Updated
Apr 26, 2026 - Python
ViAG: A Novel Framework for Fine-tuning Answer Generation models ultilizing Encoder-Decoder and Decoder-only Transformers's architecture
meteor question-answering bart llama rouge bleu-score encoder-decoder fine-tuning answer-generation t5 plms bartpho llm bertscore instruction-tuning qlora qwen decoder-only vit5
-
Updated
May 26, 2025 - Python
Fine-tuning GPT-3.5 and Llama3 LLMs for enhanced persona consistency in chatbots using Google's Synthetic Persona Chat dataset
-
Updated
May 3, 2025 - Jupyter Notebook
Domain-specific adaptation of CodeT5 for Python docstring generation. Compares pre-trained vs fine-tuned performance using NLP metrics (ROUGE, METEOR, BERTScore), showing significant improvements after targeted training.
nlp machine-learning deep-learning transformers code-generation rouge fine-tuning code-summarization bertscore code-comments-generator codet5
-
Updated
Sep 22, 2025 - Jupyter Notebook
Agent Orchestration - LLM for Legal Metadata Extraction: A Comparative Analysis of Efficiency and Precision (paper 161 PROPOR)
-
Updated
Jul 26, 2026 - Python
Medical Question Answering System using on PubMed dataset.
-
Updated
May 29, 2025 - Jupyter Notebook
[radscore] Evaluation metrics for radiology report generation — BLEU, ROUGE, BERTScore, F1-RadGraph, CheXbert F1 & GREEN in one `pip install`.
machine-learning tutorial deep-learning medical-imaging rouge radiology evaluation-metrics bleu-score multilabel-classification medical-natural-language-processing chexpert report-generation healthcare-ai bertscore radiology-report-generation vision-language-model chexbert radgraph green-metric
-
Updated
Jun 16, 2026 - Python
Comprendre les Transformers : de « Attention Is All You Need » à un résumé automatique de texte en français avec BARThez, analyse de la cross-attention et évaluation ROUGE / BERTScore.
nlp deep-learning jupyter-notebook transformers pytorch bart text-summarization rouge attention-mechanism french-nlp huggingface bertscore barthez
-
Updated
Oct 26, 2026 - Jupyter Notebook
Model-agnostic toolkit to evaluate text-summarization models — ROUGE/BLEU/BERTScore + perplexity + LLM-as-judge, MLflow tracking, CLI + library with unit-tested metrics.
python nlp cli evaluation transformers text-summarization rouge bleu perplexity mlflow huggingface bertscore llm-evaluation llm-as-judge
-
Updated
Jul 25, 2026 - Python
Hallucination-resistant multi-hop QA using hybrid BM25+FAISS retrieval, cross-encoder reranking, citation selection, and NLI-based verification. Evaluated on HotpotQA (7,405 examples), zero-shot.
nlp question-answering bm25 zero-shot-learning reranking nli faiss rag multi-hop-reasoning hotpotqa cross-encoder llm bertscore ollama hallucination-detection gemma-4
-
Updated
May 26, 2026 - Python
Benchmarking Vector RAG vs Graph RAG vs Hybrid Graph-Vector fusion RAG for cybersecurity question answering on SMEs, across 6 local LLMs (LLaMA 3.1, Mistral 7B, Qwen3, Qwen3.5, Ministral 3, Olmo 3) with ChromaDB and Neo4j
nlp neo4j evaluation transformers knowledge-graph cybersecurity rag vector-search huggingface bertscore hybrid-retrieval chromadb llm-evaluation mistral-7b graph-rag llama3 qwen3 olmo3 ministral3 qwen3-5
-
Updated
Oct 19, 2026 - Python
Implementation of a task-specific QLoRA supervised fine-tuning pipeline for LLaMA-2-7B-Chat, developed for an independent study on structured cover letter generation.
nlp natural-language-processing transformers text-generation pytorch rouge lora model-evaluation fine-tuning peft huggingface llm bertscore supervised-finetuning qlora llama2 parameter-efficient-fine-tuning structured-generation
-
Updated
Aug 6, 2026 - Python
The work presented was developed during the internship, as researchers in the field of Natural Language Generation, at the Insid&s Lab laboratory in Milan-Bicocca. The work carried out deals with the creation of a framework for the correct assessment of the impact of the quality of the input datasets on the quality of the text generated by the N…
python natural-language-processing deep-learning torch artificial-intelligence lstm rdf-triples natural-language-generation nlg rouge-metric bleu-score transformer-architecture bertscore
-
Updated
Mar 30, 2026 - Jupyter Notebook
An LLM-powered application that summarizes scientific research papers, extracts tables, and provides real-time evaluation using BERTScore (F1) and ROUGE. Built using Meta’s LLaMA 3–8B via Groq, with table extraction powered by pdfplumber and pandas.
-
Updated
Jul 23, 2025 - Python
Add this topic to your repo
To associate your repository with the bertscore topic, visit your repo's landing page and select "manage topics."