You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for the kind words! Unfortunately, I may not have enough bandwidth to finish it recently. (Maybe later if needed)
Here is a short description of the difference between these two benchmarks: almost all task-evaluating processes are similar except for summarization. The summarization is based on the text and summary instead of the "human summary vs the machine summary". For other tasks, simply copying the task dataset metadata is fine.
Extremely nice benchmark that we should definitely integrate and add a leaderboard tab for: https://github.com/yixuantt/FinMTEB
It should be pretty easy to integrate as the code structure is very similar!
The text was updated successfully, but these errors were encountered: