Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate Examples: memtable.rs and parquet_multiple_files.rs #13912

Open
Tracked by #11172
alamb opened this issue Dec 26, 2024 · 0 comments · May be fixed by #13913
Open
Tracked by #11172

Consolidate Examples: memtable.rs and parquet_multiple_files.rs #13912

alamb opened this issue Dec 26, 2024 · 0 comments · May be fixed by #13913
Assignees
Labels
enhancement New feature or request

Comments

@alamb
Copy link
Contributor

alamb commented Dec 26, 2024

Is your feature request related to a problem or challenge?

The large number of small examples in DataFusion leads to multiple problems:

  • Makes it harder to find the relevant examples
  • Unnecessarily large amounts of disk space on a full build (each example binary takes 100+ MB)
  • Larger cargo t time (each binary must be linked / created)

Thus I think the fewer examples we have the

  1. easier it will be to find the relevant examples
  2. faster our dev experience will be

Describe the solution you'd like

I would like a single file with common SQL based examples where we can consolidate other files (like to_date.rs, etc)

Then update the readme page:

Describe alternatives you've considered

No response

Additional context

I think this is a good first issue as the task is straightforward and doesn't require deep understanding of the DataFusion codebase

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant