Skip to content

Commit

Permalink
[data][tests] Update image processing benchmarks to use ImageNet (ray…
Browse files Browse the repository at this point in the history 
…-project#39207)

Updates to some image processing nightly benchmarks:

    Use ImageNet dataset - unlike the current test dataset, has images of all different sizes, some in grayscale (instead of RGB), and on average smaller
    Consolidate "preprocessed_image_loader" and "image_loader" microbenchmarks
    Add microbenchmark for reading from parquet files
    Add S3 Dataset for MosaicML streaming
---------

Signed-off-by: Stephanie Wang <[email protected]>
  • Loading branch information
@stephanie-wang
stephanie-wang committed Sep 5, 2023
1 parent 3c9e253 commit bb23051
Show file tree
Hide file tree
Showing 6 changed files with 436 additions and 533 deletions.
Loading

0 comments on commit bb23051

Please sign in to comment.