Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Text-to-SQL progress (Dialogue) #534

Open
willyspinner opened this issue Feb 17, 2021 · 1 comment
Open

Add Text-to-SQL progress (Dialogue) #534

willyspinner opened this issue Feb 17, 2021 · 1 comment

Comments

@willyspinner
Copy link

willyspinner commented Feb 17, 2021

I've been reading up on Text-to-SQL problems (given natural language question & DB schema, generate a legal SQL query) and they seem to be an interesting subfield of Dialogue Answering Systems.

There are multiple datasets/ challenges that track their SOTAs, for example:

  1. The spider challenge
  2. The CoSQL challenge
  3. The SparC challenge

all of which have interesting tasks besides the standard Text-to-SQL problem, like Natural Language Response Generation given SQL and Query execution Results.

I realize that the spider dataset is under the semantic-parsing part, but SParC and CoSQL are more challenging datasets that incorporate multi-turns, context, as well as ambiguous and unanswerable questions that may present to be harder than the spider challenge.

I was wondering if we could add them?

@willyspinner willyspinner changed the title Add Text-to-SQL problems (Dialogue) Add Text-to-SQL progress (Dialogue) Feb 17, 2021
@sebastianruder
Copy link
Owner

That's a great idea! I think it may be potentially clearer to add them to the Semantic Parsing area as they are conceptually more similar to the Spider dataset than the standard dialogue setting. What do you think?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants