Move FFHT to the external folder
#87
Comments
A-Guldborg
pushed a commit
to duckth/FOENNIX
that referenced
this issue
May 12, 2024
* added some private query sets * added paths to heldout queries and GT100 for all datasets except msspacev * added spacev private queries * updates * isolating pqs changes for merge * need to update main with the baseline config and algo from T3 for testing * fix issue with failed extraction of search times * using hyphens in cmd flags * undoing/commenting the deep1b incorrect header HACK * adding a priv run script for testing * removed debug print Co-authored-by: Harsha Vardhan Simhadri <[email protected]>
A-Guldborg
pushed a commit
to duckth/FOENNIX
that referenced
this issue
May 12, 2024
* first commit * final version * add ssnpp-1B in benchmarks * fix no new line in algo.yaml * modify benchmark * modify new line * Update algos.yaml add missing "}" to make msturing-1B work * modify algos.yaml to make all CI test pass * remove new line in algos.yaml * add new line in algo.yaml * modify new line * algo.yaml new line * fix bigann * fix comma problem in ssnpp-1B * Count ties using extended ground truth list (FALCONN-LIB#59) * Count ties using extended ground truth list * added credit to ann-benchmarks.com * added diskann-v0.3 and medoids to component list * Bump pyyaml from 5.3.1 to 5.4 Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.3.1 to 5.4. - [Release notes](https://github.com/yaml/pyyaml/releases) - [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES) - [Commits](yaml/pyyaml@5.3.1...5.4) --- updated-dependencies: - dependency-name: pyyaml dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> * Change default search radius for SSNPP-1B to 96237 * Update metrics.py * a proposed recall-with-ties impl with related unit tests (FALCONN-LIB#74) * a new impl of recall-with-ties with careful attention determining true_ids subset and inner product distance; unit tests adjusted accordingly. * more compact and readable code based on martin's suggestion * validated on existing recall unit tests, in addition approved by T3 participants who noticed the ties issue. * First T3 track leaderboard (FALCONN-LIB#75) * adding latest leaderboard and all readme's that link to it * sync tasks from gw/T3 branch * syncing from gw/T3 * The markdown rel paths didnt work with the last PR to main. Switching to absolute paths which is not ideal, but should be ok for now. (FALCONN-LIB#76) * updated leaderboard with cuanns updates (FALCONN-LIB#77) * cumulative updates forcing new LEADERBOARD;updated TASKS as well (FALCONN-LIB#78) * added float32 coercion to data before faiss range search call; locked python version to 369 for docker build (FALCONN-LIB#79) * new leaderboard based on eval of new gemini indexes for ssnpp and text2image (FALCONN-LIB#80) * Store individual search times and extend CSV export capability for search times and power metrics. (FALCONN-LIB#81) * storing the list of search times as h5py attr during query evaluation * support for power sensor and search_times extraction to CSV in data_export.py * added --detect_caching and --sensor_times flags * added simple logic to detect possible response caching * added leaderboard history directory with first snapshot (FALCONN-LIB#82) * Update the last LB rankings and TASKs for public query set (FALCONN-LIB#83) * updated the last LB rankings and TASK for public query set * fixing a few typos * added logic to generate a leaderboard version that rejects anomalous query sets * T1/T2 public query set results * T1/T2 public query set results * T1/T2 public query set results * T1/T2 public query set results * refactored LM into multi LB READMEs and new navigation logic (FALCONN-LIB#86) * Adding more private_query functionality and fixes (FALCONN-LIB#87) * added some private query sets * added paths to heldout queries and GT100 for all datasets except msspacev * added spacev private queries * updates * isolating pqs changes for merge * need to update main with the baseline config and algo from T3 for testing * fix issue with failed extraction of search times * using hyphens in cmd flags * undoing/commenting the deep1b incorrect header HACK * adding a priv run script for testing * removed debug print Co-authored-by: Harsha Vardhan Simhadri <[email protected]> * Fix T1/T2 results * Fix typo in T1/T2 readme * Adding winners to the T3 public data leaderboard (FALCONN-LIB#88) * adding co-winner announcements * synced LB that fixed wording * synced LB changes from gw/T3 * synced LB fix with missing msspacev * synced LB with public link fix * updated both T3 LBs (FALCONN-LIB#89) --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: qiaoyu <[email protected]> Co-authored-by: Harsha Vardhan Simhadri <[email protected]> Co-authored-by: Martin Aumueller <[email protected]> Co-authored-by: Harsha Vardhan Simhadri <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: C. George Williams <[email protected]> Co-authored-by: Harsha Vardhan Simhadri <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
No description provided.
The text was updated successfully, but these errors were encountered: