Package: summarisebig 0.1.0
summarisebig: Grouped Summaries for Large 'arrow' Datasets
Provides a 'dplyr'-like interface for grouped summaries on large 'arrow' datasets. Complete summaries are attempted in 'arrow' first. When a result can be reconstructed from 'arrow'-computable sufficient statistics, an explicit MapReduce-style reduction and 'R' finalization strategy is available. For arbitrary 'R' functions that require raw group observations, complete groups are materialized in bounded chunks, with optional parallel execution and shared-memory processing. The MapReduce strategy follows the programming model described by Dean and Ghemawat (2008) <doi:10.1145/1327452.1327492>.
Authors:
summarisebig_0.1.0.tar.gz
summarisebig_0.1.0.zip(r-4.7-any)summarisebig_0.1.0.zip(r-4.6-any)summarisebig_0.1.0.zip(r-4.5-any)
summarisebig_0.1.0.tgz(r-4.6-any)summarisebig_0.1.0.tgz(r-4.5-any)
summarisebig_0.1.0.tar.gz(r-4.7-any)summarisebig_0.1.0.tar.gz(r-4.6-any)
summarisebig_0.1.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
summarisebig/json (API)
| # Install 'summarisebig' in R: |
| install.packages('summarisebig', repos = c('https://larry77.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/larry77/summarisebig/issues
Pkgdown/docs site:https://larry77.github.io
Last updated from:d365622602. Checks:9 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel | OK | 156 | ||
| source / vignettes | OK | 245 | ||
| linux-release | OK | 154 | ||
| macos-release | OK | 119 | ||
| macos-oldrel | OK | 107 | ||
| windows-devel | OK | 92 | ||
| windows-release | OK | 94 | ||
| windows-oldrel | OK | 86 | ||
| wasm-release | OK | 121 |
Exports:summarise_big
Dependencies:arrowassertthatbitbit64clicodetoolscpp11digestdplyrfurrrfuturefuture.miraifuturizegenericsglobalsgluelifecyclelistenvmagrittrmirainanonextparallellypillarpkgconfigpurrrR6rlangtibbletidyselectutf8vctrswithr
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Summarise a large Arrow dataset by group | summarise_big |