mirrors/zed
1
0
Fork 0
mirror of https://github.com/zed-industries/zed.git synced 2024-12-26 18:41:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 8
zed/crates/evals/Cargo.toml

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

40 lines
832 B
TOML
Raw Permalink Normal View History

Add an `eval` binary that evaluates our semantic index against CodeSearchNet (#17375) This PR is the beginning of an evaluation framework for our AI features. Right now, we're evaluating our semantic search feature against the [CodeSearchNet](https://github.com/github/CodeSearchNet) code search dataset. This dataset is very limited (for the most part, only 1 known good search result per repo) but it has surfaced some problems with our search already. Release Notes: - N/A --------- Co-authored-by: Jason <jason@zed.dev> Co-authored-by: Jason Mancuso <7891333+jvmncs@users.noreply.github.com> Co-authored-by: Nathan <nathan@zed.dev> Co-authored-by: Richard <richard@zed.dev>
2024-09-17 19:44:33 +00:00
[package]
name = "evals"
description = "Evaluations for Zed's AI features"
version = "0.1.0"
edition = "2021"
publish = false
license = "GPL-3.0-or-later"
[lints]
workspace = true
[[bin]]
name = "eval"
path = "src/eval.rs"
[dependencies]
anyhow.workspace = true
Sort dependencies in `Cargo.toml` files (#18657) This PR sorts the dependencies in various `Cargo.toml` files after #18414. Release Notes: - N/A
2024-10-02 20:26:48 +00:00
clap.workspace = true
Add an `eval` binary that evaluates our semantic index against CodeSearchNet (#17375) This PR is the beginning of an evaluation framework for our AI features. Right now, we're evaluating our semantic search feature against the [CodeSearchNet](https://github.com/github/CodeSearchNet) code search dataset. This dataset is very limited (for the most part, only 1 known good search result per repo) but it has surfaced some problems with our search already. Release Notes: - N/A --------- Co-authored-by: Jason <jason@zed.dev> Co-authored-by: Jason Mancuso <7891333+jvmncs@users.noreply.github.com> Co-authored-by: Nathan <nathan@zed.dev> Co-authored-by: Richard <richard@zed.dev>
2024-09-17 19:44:33 +00:00
client.workspace = true
clock.workspace = true
collections.workspace = true
env_logger.workspace = true
feature_flags.workspace = true
fs.workspace = true
git.workspace = true
gpui.workspace = true
Sort dependencies in `Cargo.toml` files (#18657) This PR sorts the dependencies in various `Cargo.toml` files after #18414. Release Notes: - N/A
2024-10-02 20:26:48 +00:00
http_client.workspace = true
Add an `eval` binary that evaluates our semantic index against CodeSearchNet (#17375) This PR is the beginning of an evaluation framework for our AI features. Right now, we're evaluating our semantic search feature against the [CodeSearchNet](https://github.com/github/CodeSearchNet) code search dataset. This dataset is very limited (for the most part, only 1 known good search result per repo) but it has surfaced some problems with our search already. Release Notes: - N/A --------- Co-authored-by: Jason <jason@zed.dev> Co-authored-by: Jason Mancuso <7891333+jvmncs@users.noreply.github.com> Co-authored-by: Nathan <nathan@zed.dev> Co-authored-by: Richard <richard@zed.dev>
2024-09-17 19:44:33 +00:00
language.workspace = true
languages.workspace = true
Sort dependencies in `Cargo.toml` files (#18657) This PR sorts the dependencies in various `Cargo.toml` files after #18414. Release Notes: - N/A
2024-10-02 20:26:48 +00:00
node_runtime.workspace = true
Add an `eval` binary that evaluates our semantic index against CodeSearchNet (#17375) This PR is the beginning of an evaluation framework for our AI features. Right now, we're evaluating our semantic search feature against the [CodeSearchNet](https://github.com/github/CodeSearchNet) code search dataset. This dataset is very limited (for the most part, only 1 known good search result per repo) but it has surfaced some problems with our search already. Release Notes: - N/A --------- Co-authored-by: Jason <jason@zed.dev> Co-authored-by: Jason Mancuso <7891333+jvmncs@users.noreply.github.com> Co-authored-by: Nathan <nathan@zed.dev> Co-authored-by: Richard <richard@zed.dev>
2024-09-17 19:44:33 +00:00
open_ai.workspace = true
project.workspace = true
windows: Set `CREATE_NO_WINDOW` for commands (#18447) - Closes: #18371 Release Notes: - N/A
2024-11-21 00:52:38 +00:00
reqwest_client.workspace = true
Sort dependencies in `Cargo.toml` files (#18657) This PR sorts the dependencies in various `Cargo.toml` files after #18414. Release Notes: - N/A
2024-10-02 20:26:48 +00:00
semantic_index.workspace = true
Add an `eval` binary that evaluates our semantic index against CodeSearchNet (#17375) This PR is the beginning of an evaluation framework for our AI features. Right now, we're evaluating our semantic search feature against the [CodeSearchNet](https://github.com/github/CodeSearchNet) code search dataset. This dataset is very limited (for the most part, only 1 known good search result per repo) but it has surfaced some problems with our search already. Release Notes: - N/A --------- Co-authored-by: Jason <jason@zed.dev> Co-authored-by: Jason Mancuso <7891333+jvmncs@users.noreply.github.com> Co-authored-by: Nathan <nathan@zed.dev> Co-authored-by: Richard <richard@zed.dev>
2024-09-17 19:44:33 +00:00
serde.workspace = true
serde_json.workspace = true
Sort dependencies in `Cargo.toml` files (#18657) This PR sorts the dependencies in various `Cargo.toml` files after #18414. Release Notes: - N/A
2024-10-02 20:26:48 +00:00
settings.workspace = true
Add an `eval` binary that evaluates our semantic index against CodeSearchNet (#17375) This PR is the beginning of an evaluation framework for our AI features. Right now, we're evaluating our semantic search feature against the [CodeSearchNet](https://github.com/github/CodeSearchNet) code search dataset. This dataset is very limited (for the most part, only 1 known good search result per repo) but it has surfaced some problems with our search already. Release Notes: - N/A --------- Co-authored-by: Jason <jason@zed.dev> Co-authored-by: Jason Mancuso <7891333+jvmncs@users.noreply.github.com> Co-authored-by: Nathan <nathan@zed.dev> Co-authored-by: Richard <richard@zed.dev>
2024-09-17 19:44:33 +00:00
smol.workspace = true
windows: Set `CREATE_NO_WINDOW` for commands (#18447) - Closes: #18371 Release Notes: - N/A
2024-11-21 00:52:38 +00:00
util.workspace = true
Reference in a new issue Copy permalink