Skip to content

Issues: embeddings-benchmark/mteb

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

111 Open 402 Closed
111 Open 402 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add minishlab models good first issue Good for newcomers new-model Questions related to adding a new model to the benchmark
#1503 opened Nov 26, 2024 by KennethEnevoldsen
Add mixedbread-ai/mxbai-embed-xsmall-v1 and mixedbread-ai/mxbai-embed-2d-large-v1
#1502 opened Nov 26, 2024 by KennethEnevoldsen
Add voyage-3 and voyage-3-lite new-model Questions related to adding a new model to the benchmark
#1501 opened Nov 26, 2024 by KennethEnevoldsen
Merge main into v2.0.0
#1500 opened Nov 26, 2024 by KennethEnevoldsen
@KennethEnevoldsen @Samoed
1
Investigate/Fix ClimateFever
#1498 opened Nov 25, 2024 by Muennighoff
Expose get_model in README.md
#1497 opened Nov 25, 2024 by Muennighoff
1
Confused embed_dim across different implementation
#1495 opened Nov 25, 2024 by tsWen0309
2
Cannot reproduce results on text classification benchmark.
#1490 opened Nov 23, 2024 by tsWen0309
14
Add Language Families
#1485 opened Nov 22, 2024 by isaac-chung
1
@isaac-chung
Add text-embedding-005 new-model Questions related to adding a new model to the benchmark
#1480 opened Nov 21, 2024 by emerzon
Add descriptive_stats to all tasks help wanted Extra attention is needed
#1475 opened Nov 19, 2024 by Samoed
@imenelydiaker
12
add google/siglip-so400m-patch16-256-i18n
#1474 opened Nov 19, 2024 by SaitejaUtpala
1
Can't load some datasets because of datasets 3.0 bug Something isn't working
#1465 opened Nov 16, 2024 by Samoed
2
Add NanoBEIR new-dataset
#1464 opened Nov 16, 2024 by Muennighoff
1
Importing mteb is slow good first issue Good for newcomers
#1463 opened Nov 16, 2024 by Muennighoff
@Napuh
7
[mieb] add support for LLM2CLIP mieb The image extension of MTEB
#1458 opened Nov 14, 2024 by SaitejaUtpala
[mieb] royokong/e5-v on EDIST2ITRetrieval 'NoneType' object has no attribute 'dtype' mieb The image extension of MTEB
#1455 opened Nov 14, 2024 by Muennighoff
[mieb] add support for voyage-multimodal-3: mieb The image extension of MTEB
#1446 opened Nov 14, 2024 by Muennighoff
"KeyError: 'document' not found and no similar keys were found.
#1445 opened Nov 13, 2024 by LeMoussel
5
Leaderboard: Add radar chart leaderboard issues related to the leaderboard
#1443 opened Nov 13, 2024 by KennethEnevoldsen
Model metas: E5 instruct not listed as sbert compatible
#1442 opened Nov 12, 2024 by x-tabdeveloping
Leaderboard: Add query parameters to link leaderboard issues related to the leaderboard
#1440 opened Nov 12, 2024 by x-tabdeveloping
[MIEB] Flickr30K not matching openAI ViT B32 results mieb The image extension of MTEB
#1434 opened Nov 11, 2024 by isaac-chung
2
Leaderboard: Add an Overview leaderboard leaderboard issues related to the leaderboard
#1432 opened Nov 11, 2024 by KennethEnevoldsen
2
Add new benchmark MAIR
#1426 opened Nov 10, 2024 by sunnweiwei
1
ProTip! Exclude everything labeled bug with -label:bug.