Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8450

Update hbase-default.xml and general recommendations to better suit current hw, h2, experience, etc.

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 0.95.1, 2.0.0
    • Usability
    • None
    • Reviewed
    • Hide
      Changed defaults:

      + max versions now 1 instead of 3
      + row blooms on by default (except on .META. table)
      + handlers 30 instead of 10
      + upped memstore lower limit from .35 to .38
      + zookeeper timeout default is 90seconds instead of 180
      + client pause is 100ms instead of 1000ms
      + retries are now 20 instead of 10 (so overall we still wait same amount of time)
      + bulkload retries is 10 instead of infinite
      + major compactions are now once a week instead of once every 24 hours; they are staggered so all regionservers do not start compacting at the same time
      + blockingstorefiles is 10 instead of 7
      + block cache is 0.4 instead of 0.25
      + Previous, default for hbase.rootdir was /tmp/hbase-${user.name}. Now it is ${java.io.tmpdir}/hbase-${user.name} which is usually the same location but may not be (on macos, it points to /var/tmp....).

      Show
      Changed defaults: + max versions now 1 instead of 3 + row blooms on by default (except on .META. table) + handlers 30 instead of 10 + upped memstore lower limit from .35 to .38 + zookeeper timeout default is 90seconds instead of 180 + client pause is 100ms instead of 1000ms + retries are now 20 instead of 10 (so overall we still wait same amount of time) + bulkload retries is 10 instead of infinite + major compactions are now once a week instead of once every 24 hours; they are staggered so all regionservers do not start compacting at the same time + blockingstorefiles is 10 instead of 7 + block cache is 0.4 instead of 0.25 + Previous, default for hbase.rootdir was /tmp/hbase-${user.name}. Now it is ${java.io.tmpdir}/hbase-${user.name} which is usually the same location but may not be (on macos, it points to /var/tmp....).
    • 0.96notable

    Description

      This is a critical task we need to do before we release; review our defaults.

      On cursory review, there are configs in hbase-default.xml that no longer have matching code; there are some that should be changed because we know better now and others that should be amended because hardware and deploys are bigger than they used to be.

      We could also move stuff around so that the must-edit stuff is near the top (zk quorum config. is mid-way down the page) and beef up the descriptions – especially since these descriptions shine through in the refguide.

      Lastly, I notice that our tgz does not "include" an hbase-default.xml other than the one bundled up in the jar. Maybe we should make it more accessible.

      Attachments

        1. 8450.txt
          3 kB
          Michael Stack
        2. 8450v2.txt
          46 kB
          Michael Stack
        3. 8450v3.txt
          46 kB
          Michael Stack
        4. 8450v5.txt
          66 kB
          Michael Stack
        5. 8450v5.txt
          52 kB
          Michael Stack

        Activity

          People

            stack Michael Stack
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            17 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: