What's Changed

• S3

  • Fix S3 deletion in deep folders, and names with empty spaces, fix #5748
  • add s3test for sql by @kmlebedev in #5718
  • [s3] revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function by @kmlebedev in #5760

• Master

  • Detect underflow when calculating unused space by @danfoster in #5758
  • Different disk labels should not use the same DiskUsages instance while master received volume heatbeat by @chocotan in #5770
  • Fix "no more writable volumes" error when volume grows and master leader changed at the same time by @chocotan in #5771
  • fix: avoid timeout if datacenter does not exist in topology by @kmlebedev in #5772
  • metrics stats of volume layout depends on the data center by @kmlebedev in #5775
  • [master] refactor HasGrowRequest to atomic bool by @kmlebedev in #5782
  • [master] Do Automatic Volume Grow in background by @kmlebedev in #5781

• Helm Charts

  • helm: restart filer when the s3-configuration changes by @gtudan in #5768

• FUSE Mount

  • Fix mmap write fail by @wusongANKANG in #5791

• Filer.remote.sync and Filer.sync

  • Azure sink: avoid overwriting existing file
  • Filer sink: avoid overwriting existing file

• Filer

  • ensure metadata follow a specific folder, fix #5774

• Volume Server

  • always copy ecj files during ec encoding

• Shell

  • volume.tier.upload: Fix deleting replicated volumes by @rhysm in #5743
  • Add warning with hints to why a EC shard cant be moved by @danfoster in #5790

• Minor

  • Added tls for http handlers by @vadimartynov in #5764
  • refactor all methods strings to const by @kmlebedev in #5726
  • -metricsIp cmd flag by @vadimartynov in #5773
  • Added loadSecurityConfigOnce by @vadimartynov in #5792
  • Added tls for http clients by @vadimartynov in #5766

New Contributors

• @rhysm made their first contribution in #5743
• @danfoster made their first contribution in #5758
• @chocotan made their first contribution in #5770

Full Changelog: 3.69...3.71

What's Changed

• Filer

  • Fixed bootstrapping new filer from existing filer peer.
  • fix issue: sometimes volume.fsck report 'volume not found' by @ehooi in #5537

• Misc

  • Added context for the MasterClient's methods to avoid endless loops by @vadimartynov in #5628

• Helm Charts

  • fix #5681 convert all resources parameters to maps instead of strings by @jessebot in #5689
  • Helm-Chart: clean up image handling by @gtudan in #5720
  • Move cluster role to a separate template. by @gtudan in #5721
  • [Helm chart] Remove createClusterRole dependency from serviceAccount usage from filer statefulset by @rgaduput in #5724

• Admin Shell

  • [fs.verify] getmeta data from filer log by @kmlebedev in #5678
  • [fs.verify] skip failed files if entry not found on filerStore by @kmlebedev in #5693
  • chore: hot fix panic fs.verify by @kmlebedev in #5696

• Volume Server

  • bugfix: unregister ec shards when volume server disconnected by @Numblgw in #5697
  • fixed fail to initialize existing ec volume when volume server has separate index dictory by @ehooi in #5723

• Master

  • fix: correct command flag for master.raftBootstrap option in server.go by @sample in #5701

• S3

  • check bucket name in sql backend #5710

• filer.backup, filer.meta.backup, filer.remote.gateway, filer.remote.sync

  • adjust error handling to keep retrying to fix #5677

New Contributors

• @MeenakshiSachdeva made their first contribution in #5663
• @ehooi made their first contribution in #5537
• @vadimartynov made their first contribution in #5628
• @Numblgw made their first contribution in #5697
• @rgaduput made their first contribution in #5724

Full Changelog: 3.68...3.69

What's Changed

• Helm Chart

  • Helm-Chart: Make MySQL credentials optional by @gtudan in #5583
  • Helm: Allow adding additional labels to the service monitors by @gtudan in #5593
  • Helm: Fix warning when rendering with secretExtraEnvVars set by @gtudan in #5594
  • helm chart - add support for emptyDir storage type by @tomeresk in #5610
  • Helm: Fix warning when providing resource requests/limits for S3 by @johnnycederholm in #5611
  • increase helm chart version to include the emptyDir storage feature by @tomeresk in #5613
  • Allow using a PVC to store filer and master logs by @sgalsaleh in #5653
  • Allow defining labels and annotations per component by @sgalsaleh in #5657

• Misc

  • Add support for OpenBSD by @davestgermain in #5578
  • Replace hardcoded datasource uids in the grafana dashboard by @gtudan in #5590
  • Allow selecting the namespace visualized by the grafana dashboard by @gtudan in #5591
  • Update the Grafana panels using the to the new time series by @gtudan in #5595
  • Add ability to configure security context for the different components by @johnnycederholm in #5600
  • Solaris disk support by @dspearson in #5638

• Volume Server

  • fix: recreate index include deleted files by @kmlebedev in #5579
  • Fix sorted needle file's write mode for (*SortedFileNeedleMap).Delete() by @NyaMisty in #5633
  • Ignore remote volume when selecting volumes in operation (ec.encode/volume.tier.upload) by @NyaMisty in #5635

• Filer

  • add filer configuration options for username/password and tls by @baursn in #5601
  • Feature/mongodb security by @baursn in #5602

• S3

  • [s3] Fixed s3 replication by sending content-md as base64 by @stibi in #5596
  • added s3 iam DeleteBucket permission management by @rikigigi in #5599
  • fix(s3api): make post api upload object default return 204 by @lehoangnam040 in #5648

• Shell

  • chore: add missing concurrency help in fs.meta.load command by @negezor in #5609
  • Replaces volume.unmount in the help of the volumeServer.leave by @negezor in #5619
  • Fix volume.tier.upload nil pointer panic by @NyaMisty in #5634
  • Support concurrent volume.fsck & support disabling -cutoffTimeAgo to improve speed by @NyaMisty in #5636

• Master

  • fix deadlock caused by message chan blocked by @shichanglin5 in #5639
  • Set the capacity of clientChan to 10000 by @CodeRusher in #5647
  • fix: Ensure that the clientAddress is unique by @CodeRusher in #5655

• Mount

  • Fix Issue #5649 by @Dando-Real-ITA in #5652
  • Fix panic by @Dando-Real-ITA in #5654

New Contributors

• @davestgermain made their first contribution in #5578
• @gtudan made their first contribution in #5583
• @stibi made their first contribution in #5596
• @rikigigi made their first contribution in #5599
• @johnnycederholm made their first contribution in #5600
• @baursn made their first contribution in #5601
• @negezor made their first contribution in #5609
• @NyaMisty made their first contribution in #5633
• @dspearson made their first contribution in #5638
• @lehoangnam040 made their first contribution in #5648
• @Dando-Real-ITA made their first contribution in #5652
• @sgalsaleh made their first contribution in #5653

Full Changelog: 3.67...3.68

What's Changed

• S3
  • Fix regression in 3.56: S3 didn't delete empty folder when delete all files in folder after upgrade to 3.66 #5565
• FUSE Mount
  • Fix deadlock in lock table locks by @Woellchen in #5566

Full Changelog: 3.66...3.67

This version has a regression on S3 deleting empty folder. Fixed in 3.67.

What's Changed

• Volume Server

  • rename VolumeServerVolumeGauge by @CodeRusher in #5504
  • fix: skip file size checking for volume with TTL by @kmlebedev in #5541

• Shell

  • fix "volume.fix.replication" move many replications only to one volumeServer by @kungf in #5522

• Filer

  • filer read chunk retry if status code 499 by @kmlebedev in #5528
  • feat: upload files directly without multipart/form-data by @KevinBLT in #5539

• S3

  • [s3] Put bucket lifecycle configuration by @kmlebedev in #5510

• Helm Charts

  • helm: Fix annotations parameters to be standard maps by @jessebot in #5543

• Minor

  • Migrates from disintegration/imaging c2019 to cognusion/imaging c2024. by @cognusion in #5533
  • Fixes race with unlocked setter. by @cognusion in #5532
  • Fixes unlocked read from logBuffer.LastTsNs that is racey. by @cognusion in #5536
  • Move file deletion logging to v2 verbisity by @sample in #5538
  • reduce ambiguity about use memory_sequencer by @shenxingwuying in #5555

New Contributors

• @cognusion made their first contribution in #5533
• @KevinBLT made their first contribution in #5539
• @shenxingwuying made their first contribution in #5555

Full Changelog: 3.65...3.66

What's Changed

• Helm Chart

  • Helm chart readme - clarify details about multiple filers and datastore by @tomeresk in #5384
  • helm chart: make s3 ingress annotations consistent by @mergwyn in #5463

• Filer

  • fix get file metadata bug by @jerebear12 in #5394
  • Add TLS support, initial etcd connection check, fix key_prefix handling for etcd backend meta storage by @sample in #5403
  • fix filer address parsing by @doc-sheet in #5415
  • Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta storage backend by @sample in #5416
  • fix: adjust condition in prefixFilterEntries prevent infinite loop by @sample in #5440
  • fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. by @sample in #5441
  • fix: filer authenticate with with volume server by @hencoappel in #5480
  • fix append disorder by @kungf in #5492

• Filer Sync

  • fix: sync without dir /buckets/some/.uploads/hash_hash by @kmlebedev in #5402

• Filer Replication

  • fix: panic: assignment to entry in nil map on S3Sink.CreateEntry by @kmlebedev in #5406

• S3

  • Fix iam service response 500 by @zuzuviewer in #5405
  • fix s3api: delimeter properly takes prefixes into account by @adasauce in #5411
  • [tests] add action s3 tests by @kmlebedev in #5427
  • fix completed multiupload lost data by @kungf in #5460
  • fix: correctly form partNumber from new entry.Name format in "listObjectParts" by @sample in #5470
  • [s3] fix s3 test_multipart_resend_first_finishes_last by @kmlebedev in #5471
  • [s3] add s3 pass test_multipart_upload by @kmlebedev in #5474
  • [s3] add s3 pass test_multipart_upload_size_too_small by @kmlebedev in #5475
  • [s3] fix s3 test_multipart_get_part by @kmlebedev in #5476

• Mount

  • fix GetAttr blocks count by @wusongANKANG in #5409
  • fix git clone into fuse mount fails with inflate: data stream error #5412

• Misc

  • add basic support for sentry error reporting by @doc-sheet in #5410
  • chore: fix function names in comment by @clonefetch in #5478
  • chore: fix some typos in comments by @yudrywet in #5497

• Master

  • [master] add test for PickForWrite add metrics for volume layout by @kmlebedev in #5413
  • fix panic 5435 by @kmlebedev in #5436
  • [master] grow volumes if no writable volumes in current dataCenter by @kmlebedev in #5434
  • fix panic at isAllWritable by @kmlebedev in #5457

• Volume Server

  • fix: always close volume file (#4530) by @hencoappel in #5459
  • Correct type for volume logs and idx values by @mergwyn in #5462
  • fix(volume.fix.replication): adjust volume count, not free volume count by @CodeRusher in #5479
  • [volume] Reduce the number of buffers for uploading one chunk by @kmlebedev in #5458

New Contributors

• @tomeresk made their first contribution in #5384
• @zuzuviewer made their first contribution in #5405
• @doc-sheet made their first contribution in #5410
• @sample made their first contribution in #5403
• @mergwyn made their first contribution in #5462
• @clonefetch made their first contribution in #5478
• @CodeRusher made their first contribution in #5479
• @yudrywet made their first contribution in #5497

Full Changelog: 3.64...3.65

What's Changed

• Filer
  • Disable filer UI in configuration by @jerebear12 in #5297
  • [filer] replace an invalid methods in a metric with an invalid one by @kmlebedev in #5378
• Mount
  • Moved noapplexattr under runtime.GOARCH == "amd64" to resolve the fin… by @Bia3 in #5351
• Shell
  • [shell] fs log purge by @kmlebedev in #5344
• S3 API
  • feat: add support for S3 ListObjects and ListObjectsV2 by @adasauce in #5350
• Volume
  • Add deleted bytes to total_disk_size by @SmsS4 in #5161
• Filer Backup
  • [filer.backup] add param uploader_part_size for S3sink by @kmlebedev in #5352
• Minor
  • remove repetitive words by @rustrover in #5364
  • Document default method used by compact by @SystemZ in #5379

New Contributors

• @Bia3 made their first contribution in #5351
• @adasauce made their first contribution in #5350
• @rustrover made their first contribution in #5364
• @SystemZ made their first contribution in #5379

Full Changelog: 3.63...3.64

What's Changed

• Filer

  • [filer] avoid return http ok for not allowed methods by @kmlebedev in #5209
  • chore: filer healthz handler check filer store by @kmlebedev in #5208
  • Update the solution when a file cannot be located. by @LuuucasChen in #5223
  • filer: reduce delete entry ErrNotFound logs by @sberthier in #5301
  • fix: http range request return status 500 by @sberthier in #5251

• Helm Chart

  • Fix(k8s-chart-helm): helm upgrade statefulset error by @sberthier in #5207
  • fix: publish helm chart at new release by @sberthier in #5265
  • fix helm install error for No such file or directory by @cuisongliu in #5250
  • helm enable resource for template by @cuisongliu in #5268
  • helm using external master address by @cuisongliu in #5267
  • k8s-chart-helm: unify extraEnvironmentVars by @sberthier in #5327

• Shell

  • weed/shell: Fix volume.balance logic by @BenoitKnecht in #5238
  • weed/shell: Cleanup volume balance logic by @BenoitKnecht in #5241
  • weed/shell: Cluster check other disk types by @BenoitKnecht in #5245
  • fix: fs verify error counter by @kmlebedev in #5261

• S3

  • fix: skip s3 .uploads by @bernardx in #5216
  • fix: s3tests test_get_object_ifnonematch_good by @kmlebedev in #5237
  • Adapt S3 POST ContentType by @sxlehua in #5275
  • Add s3 postpolicy support header by @sxlehua in #5280
  • Fix/s3 config secret by @spastorclovr in #5302
  • fix: only admin auth can delete S3 bucket by @7y-9 in #5312
  • refactor: put the auth outside by @7y-9 in #5313

• Volume Server

  • Enable multiple disks per volume server. Also streamline the use of /logs & /idx by @spastorclovr in #5236
  • [volume] requests that were canceled by the client are not an internal server problem(500 => 499) by @kmlebedev in #5304
  • weed/storage: Fix volume info file permissions by @BenoitKnecht in #5246
  • avoid unexpected compact size by @kmlebedev in #5272

• Master

  • fix: clean metric MasterReplicaPlacementMismatch for unregister volume by @kmlebedev in #5239

• Mount

  • Fix/bad mount path better default value by @spastorclovr in #5253
  • fix unaligned 64-bit atomic operation in weed mount on arm when readi… by @chrislusf in #5308

• Minor

  • chore: fix typos in scaffold help output by @andrewazores in #5211
  • Update README.md by @eltociear in #5282
  • Fix Broken Links by @justindhillon in #5287

New Contributors

• @andrewazores made their first contribution in #5211
• @LuuucasChen made their first contribution in #5223
• @spastorclovr made their first contribution in #5236
• @BenoitKnecht made their first contribution in #5238
• @cuisongliu made their first contribution in #5250
• @sxlehua made their first contribution in #5275
• @eltociear made their first contribution in #5282
• @justindhillon made their first contribution in #5287
• @7y-9 made their first contribution in #5312

Full Changelog: 3.62...3.63

What's Changed

• Filer
  • Removed problematic if statement by @jerebear12 in #5180
  • chore: add status code for request_total metrics by @kmlebedev in #5188
• Volume Server
  • fix write volume over size MaxPossibleVolumeSize by @kungf in #5190
  • can vacuum volume when size mismatch by @kungf in #5200
  • factor in existing ec volume count when estimating max volume count #5191
• Filer.sync
  • Fix filer sync set offset by @kmlebedev in #5197
  • Fix doDeleteFiles deletes files by @kmlebedev in #5198

New Contributors

• @kungf made their first contribution in #5190

Full Changelog: 3.61...3.62

What's Changed

• Filer

  • Fix v3.60 bug : panic: runtime error: invalid memory address or nil pointer dereference #5153

• WebDAV

  • fix: return etag with md5 in webdav responses by @kmlebedev in #5158
  • fix: webdav avoid create empty files by @kmlebedev in #5160
  • chore: add maxMB option for webdav by @kmlebedev in #5165

• S3 API

  • Fix missing VersionConfiguration node in get-bucket-versioning response by @kmlebedev in #5162

• Filer Sync

  • chore: filer sync add doDeleteFiles option for create only mode by @kmlebedev in #5166

Full Changelog: 3.60...3.61