Skip to content
This repository has been archived by the owner on Mar 30, 2023. It is now read-only.

Latest commit

 

History

History
1185 lines (1104 loc) · 154 KB

CHANGES.md

File metadata and controls

1185 lines (1104 loc) · 154 KB

HBASE Changelog

Release 2.2.3 - Unreleased (as of 2020-01-10)

NEW FEATURES:

JIRA Summary Priority Component
HBASE-22280 Separate read/write handler for priority request(especially for meta). Major Scheduler
HBASE-22969 A new binary component comparator(BinaryComponentComparator) to perform comparison of arbitrary length and position Minor Filters

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-23654 Please add Apache Trafodion and EsgynDB to "Powered by Apache HBase" page Major documentation
HBASE-23651 Region balance throttling can be disabled Major .
HBASE-23645 Fix remaining Checkstyle violations in tests of hbase-common Minor .
HBASE-23635 Reduce number of Checkstyle violations in hbase-mapreduce Minor mapreduce
HBASE-23333 Include simple Call.toShortString() in sendCall exceptions Minor Client, Operability
HBASE-23629 Addition to Supporting projects page Minor .
HBASE-23623 Reduce number of Checkstyle violations in hbase-rest Minor REST
HBASE-23627 Resolve remaining Checkstyle violations in hbase-thrift Minor Thrift
HBASE-23615 Use a dedicated thread for executing WorkerMonitor in ProcedureExecutor. Major amv2
HBASE-23626 Reduce number of Checkstyle violations in tests of hbase-common Minor .
HBASE-23622 Reduce number of Checkstyle violations in hbase-common Minor .
HBASE-23621 Reduce number of Checkstyle violations in tests of hbase-common Minor .
HBASE-23619 Use built-in formatting for logging in hbase-zookeeper Trivial Zookeeper
HBASE-23238 Additional test and checks for null references on ScannerCallableWithReplicas Minor .
HBASE-23613 ProcedureExecutor check StuckWorkers blocked by DeadServerMetricRegionChore Major .
HBASE-23239 Reporting on status of backing MOB files from client-facing cells Major mapreduce, mob, Operability
HBASE-23549 Document steps to disable MOB for a column family Minor documentation, mob
HBASE-23380 General Cleanup of FSUtil Minor Filesystem Integration
HBASE-23379 Clean Up FSUtil getRegionLocalityMappingFromFS Minor .
HBASE-23377 Balancer should skip disabled tables's regions Major Balancer
HBASE-23373 Log `RetriesExhaustedException` context with full time precision Minor asyncclient, Client
HBASE-23303 Add security headers to REST server/info page Major REST
HBASE-23361 [UI] Limit two decimals even for total average load Minor UI
HBASE-23365 Minor change MemStoreFlusher's log Trivial .
HBASE-23362 WalPrettyPrinter should include the table name Minor tooling
HBASE-23352 Allow chaos monkeys to access cmd line params, and improve FillDiskCommandAction Minor integration tests
HBASE-23293 [REPLICATION] make ship edits timeout configurable Minor Replication
HBASE-23334 The table-lock node of zk is not needed since HBASE-16786 Minor .
HBASE-23325 [UI]rsgoup average load keep two decimals Minor .
HBASE-23321 [hbck2] fixHoles of fixMeta doesn't update in-memory state Minor hbck2
HBASE-23315 Miscellaneous HBCK Report page cleanup Minor .
HBASE-23278 Add a table-level compaction progress display on the UI Minor UI
HBASE-19450 Add log about average execution time for ScheduledChore Minor Operability
HBASE-23283 Provide clear and consistent logging about the period of enabled chores Minor Operability
HBASE-23245 All MutableHistogram implementations should remove maxExpected Major metrics
HBASE-23228 Allow for jdk8 specific modules on branch-1 in precommit/nightly testing Critical build, test
HBASE-23082 Backport low-latency snapshot tracking for space quotas to 2.x Major Quotas
HBASE-23221 Polish the WAL interface after HBASE-23181 Major regionserver, wal
HBASE-23191 Log spams on Replication Trivial Replication
HBASE-23207 Log a region open journal Minor .
HBASE-23172 HBase Canary region success count metrics reflect column family successes, not region successes Minor canary
HBASE-23170 Admin#getRegionServers use ClusterMetrics.Option.SERVERS_NAME Major .
HBASE-23038 Provide consistent and clear logging about disabling chores Minor master, regionserver

BUG FIXES:

JIRA Summary Priority Component
HBASE-23658 Fix flaky TestSnapshotFromMaster Major .
HBASE-23659 BaseLoadBalancer#wouldLowerAvailability should consider region replicas Major .
HBASE-23655 Fix flaky TestRSGroupsKillRS: should wait the SCP to finish Major .
HBASE-23663 Allow dot and hyphen in Profiler's URL Minor profiler
HBASE-23666 Backport "HBASE-23660 hbase:meta's table.jsp ref to wrong rs address" to branch-2 Major master
HBASE-23636 Disable table may hang when regionserver stop or abort. Major amv2
HBASE-23175 Yarn unable to acquire delegation token for HBase Spark jobs Major security, spark
HBASE-23553 Snapshot referenced data files are deleted in some case Major .
HBASE-23587 The FSYNC_WAL flag does not work on branch-2.x Major wal
HBASE-23596 HBCKServerCrashProcedure can double assign Major proc-v2
HBASE-23589 FlushDescriptor contains non-matching family/output combinations Critical read replicas
HBASE-23581 Creating table gets stuck when specifying an invalid split policy as METADATA Major .
HBASE-23572 In 'HBCK Report', distinguish between live, dead, and unknown servers Trivial .
HBASE-23564 RegionStates may has some expired serverinfo and make regions do not balance. Major .
HBASE-23594 Procedure stuck due to region happen to recorded on two servers. Critical amv2, Region Assignment
HBASE-23376 NPE happens while replica region is moving Minor read replicas
HBASE-23582 Unbalanced braces in string representation of table descriptor Minor .
HBASE-23566 Fix package/packet terminology problem in chaos monkeys Minor integration tests
HBASE-23360 [CLI] Fix help command "set_quota" to explain removing quota Minor shell
HBASE-23554 Encoded regionname to regionname utility Major shell
HBASE-22096 /storeFile.jsp shows CorruptHFileException when the storeFile is a reference file Major UI
HBASE-22529 Sanity check for in-memory compaction policy Minor .
HBASE-23337 Several modules missing in nexus for Apache HBase 2.2.2 Blocker build, community, scripts
HBASE-23345 Table need to replication unless all of cfs are excluded Minor Replication
HBASE-23356 When construct StoreScanner throw exceptions it is possible to left some KeyValueScanner not closed. Major .
HBASE-23117 Bad enum in hbase:meta info:state column can fail loadMeta and stop startup Minor .
HBASE-23312 HBase Thrift SPNEGO configs (HBASE-19852) should be backwards compatible Major Thrift
HBASE-23197 "IllegalArgumentException: Wrong FS" on edits replay when WALs on different file system and hbase.region.archive.recovered.edits is enabled. Major .
HBASE-23336 [CLI] Incorrect row(s) count "clear_deadservers" Minor shell
HBASE-23237 Negative 'Requests per Second' counts in UI Major UI
HBASE-23328 info:regioninfo goes wrong when region replicas enabled Major read replicas
HBASE-22607 TestExportSnapshotNoCluster::testSnapshotWithRefsExportFileSystemState() fails intermittently Major test
HBASE-23318 LoadTestTool doesn't start Minor .
HBASE-23282 HBCKServerCrashProcedure for 'Unknown Servers' Major hbck2, proc-v2
HBASE-23294 ReplicationBarrierCleaner should delete all the barriers for a removed region which does not belong to any serial replication peer Major master, Replication
HBASE-23290 shell processlist command is broken Major shell
HBASE-18439 Subclasses of o.a.h.h.chaos.actions.Action all use the same logger Minor integration tests
HBASE-23262 Cannot load Master UI Major master, UI
HBASE-23263 NPE in Quotas.jsp Major UI
HBASE-22980 HRegionPartioner getPartition() method incorrectly partitions the regions of the table. Major mapreduce
HBASE-21458 Error: Could not find or load main class org.apache.hadoop.hbase.util.GetJavaProperty Minor build, Client
HBASE-23243 [pv2] Filter out SUCCESS procedures; on decent-sized cluster, plethora overwhelms problems Major proc-v2, UI
HBASE-23247 [hbck2] Schedule SCPs for 'Unknown Servers' Major hbck2
HBASE-23241 TestExecutorService sometimes fail Major test
HBASE-23244 NPEs running Canary Major canary
HBASE-23231 ReplicationSource do not update metrics after refresh Major wal
HBASE-22739 ArrayIndexOutOfBoundsException when balance Major Balancer
HBASE-23192 CatalogJanitor consistencyCheck does not log problematic row on exception Minor hbck2
HBASE-20827 Add pause when retrying after CallQueueTooBigException for reportRegionStateTransition Major Region Assignment
HBASE-23187 Update parent region state to SPLIT in meta Major master
HBASE-23199 Error populating Table-Attribute fields Major master, UI
HBASE-23222 Better logging and mitigation for MOB compaction failures Critical mob
HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us" Major regionserver, wal
HBASE-23193 ConnectionImplementation.isTableAvailable can not deal with meta table on branch-2.x Major rsgroup, test
HBASE-23177 If fail to open reference because FNFE, make it plain it is a Reference Major Operability
HBASE-23042 Parameters are incorrect in procedures jsp Major .

SUB-TASKS:

JIRA Summary Priority Component
HBASE-23320 Upgrade surefire plugin to 3.0.0-M4 Major dependencies, test
HBASE-20461 Implement fsync for AsyncFSWAL Major wal
HBASE-23085 Network and Data related Actions Minor integration tests
HBASE-23307 Add running of ReplicationBarrierCleaner to hbck2 fixMeta invocation Major hbck2
HBASE-23322 [hbck2] Simplification on HBCKSCP scheduling Minor hbck2
HBASE-22480 Get block from BlockCache once and return this block to BlockCache twice make ref count error. Major .
HBASE-23136 PartionedMobFileCompactor bulkloaded files shouldn't get replicated (addressing buklload replication related issue raised in HBASE-22380) Critical .
HBASE-23217 Set version as 2.2.3-SNAPSHOT in branch-2.2 Major .
HBASE-22982 Send SIGSTOP to hang or SIGCONT to resume rs and add graceful rolling restart Minor integration tests

OTHER:

JIRA Summary Priority Component
HBASE-23642 Reintroduce ReplicationUtils.contains as deprecated Major Replication
HBASE-23575 Remove dead code from AsyncRegistry interface Minor Client
HBASE-23236 Upgrade to yetus 0.11.1 Major build
HBASE-23250 Log message about CleanerChore delegate initialization should be at INFO Minor master, Operability
HBASE-23227 Upgrade jackson-databind to 2.9.10.1 to avoid recent CVEs Blocker dependencies, REST, security

Release 2.2.2 - Unreleased (as of 2019-10-16)

NEW FEATURES:

JIRA Summary Priority Component
HBASE-11062 hbtop Major hbtop

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-20626 Change the value of "Requests Per Second" on WEBUI Major metrics, UI
HBASE-23093 Avoid Optional Anti-Pattern where possible Minor .
HBASE-23114 Use archiveArtifacts in Jenkinsfiles Trivial .
HBASE-23140 Remove unknown table error Minor .
HBASE-23095 Reuse FileStatus in StoreFileInfo Major mob, snapshots
HBASE-23116 LoadBalancer should log table name when balancing per table Minor .
HBASE-22874 Define a public interface for Canary and move existing implementation to LimitedPrivate Critical canary
HBASE-22930 Set unique name to longCompactions/shortCompactions threads Minor .
HBASE-23035 Retain region to the last RegionServer make the failover slower Major .
HBASE-23075 Upgrade jackson to version 2.9.10 due to CVE-2019-16335 and CVE-2019-14540 Major dependencies, hbase-connectors, REST, security
HBASE-22975 Add read and write QPS metrics at server level and table level Minor metrics
HBASE-23058 Should be "Column Family Name" in table.jsp Minor .
HBASE-23049 TableDescriptors#getAll should return the tables ordering by the name which contain namespace Minor .
HBASE-23041 Should not show split parent regions in HBCK report's unknown server part Major .
HBASE-23044 CatalogJanitor#cleanMergeQualifier may clean wrong parent regions Critical .
HBASE-23037 Make the split WAL related log more readable Minor .
HBASE-22846 Internal Error 500 when Using HBASE REST API to Create Namespace. Major hbase-connectors
HBASE-22804 Provide an API to get list of successful regions and total expected regions in Canary Minor canary
HBASE-22899 logging improvements for snapshot operations w/large manifests Minor snapshots
HBASE-22701 Better handle invalid local directory for DynamicClassLoader Major regionserver

BUG FIXES:

JIRA Summary Priority Component
HBASE-22370 ByteBuf LEAK ERROR Major rpc, wal
HBASE-23078 BaseLoadBalancer should consider region replicas when randomAssignment and roundRobinAssignment Major .
HBASE-23155 May NPE when concurrent AsyncNonMetaRegionLocator#updateCachedLocationOnError Major asyncclient
HBASE-21540 when set property "hbase.systemtables.compacting.memstore.type" to "basic" or "eager" will cause an exception Major conf
HBASE-23153 PrimaryRegionCountSkewCostFunction SLB function should implement CostFunction#isNeeded Major .
HBASE-23154 list_deadservers return incorrect no of rows Minor shell
HBASE-23152 Compaction_switch does not work by RegionServer name Major Client, Compaction
HBASE-23115 Unit change for StoreFileSize and MemStoreSize Minor metrics, UI
HBASE-23138 Drop_all table by regex fail from Shell - Similar to HBASE-23134 Major shell
HBASE-23139 MapReduce jobs lauched from convenience distribution are nonfunctional Blocker mapreduce
HBASE-22767 System table RIT STUCK if their RSGroup has no highest version RSes Major rsgroup
HBASE-23134 Enable_all and Disable_all table by Regex fail from Shell Major shell
HBASE-22903 alter_status command is broken Major metrics, shell
HBASE-23094 Wrong log message in simpleRegionNormaliser while checking if merge is enabled. Minor .
HBASE-23125 TestRSGroupsAdmin2 is flaky Major test
HBASE-23119 ArrayIndexOutOfBoundsException in PrivateCellUtil#qualifierStartsWith Major .
HBASE-23054 Remove synchronization block from MetaTableMetrics and fix LossyCounting algorithm Major metrics
HBASE-22380 break circle replication when doing bulkload Critical Replication
HBASE-23079 RegionRemoteProcedureBase should override setTimeoutFailure Blocker amv2
HBASE-22965 RS Crash due to DBE reference to an reused ByteBuff Major .
HBASE-22012 SpaceQuota DisableTableViolationPolicy will cause cycles of enable/disable table Major .
HBASE-22944 TableNotFoundException: hbase:quota is thrown when region server is restarted. Minor Quotas
HBASE-22142 Space quota: If table inside namespace having space quota is dropped, data size usage is still considered for the drop table. Minor .
HBASE-22649 Encode StoreFile path URLs in the UI to handle scenarios where CF contains special characters (like # etc.) Major UI
HBASE-23051 Remove unneeded Mockito.mock invocations Major test
HBASE-23005 Table UI showed exception message when table is disabled Minor .
HBASE-23040 region mover gives NullPointerException instead of saying a host isn't in the cluster Minor .
HBASE-23043 TestWALEntryStream times out Major wal
HBASE-22955 Branches-1 precommit and nightly yetus jobs are using jdk8 for jdk7 jobs Major .
HBASE-22929 MemStoreLAB ChunkCreator may memory leak Major .
HBASE-23006 RSGroupBasedLoadBalancer should also try to place replicas for the same region to different region servers Major Region Assignment, rsgroup
HBASE-23007 UnsatisfiedLinkError when using hbase-shaded packages under linux Critical shading
HBASE-22013 SpaceQuotas - getNumRegions() returning wrong number of regions due to region replicas Major .
HBASE-22979 Call ChunkCreator.initialize in TestHRegionWithInMemoryFlush Critical .
HBASE-22964 Fix flaky TestClusterRestartFailover and TestClusterRestartFailoverSplitWithoutZk Major .
HBASE-22963 Netty ByteBuf leak in rpc client implementation Major rpc
HBASE-22981 Remove unused flags for Yetus Critical build

SUB-TASKS:

JIRA Summary Priority Component
HBASE-23168 Generate CHANGES.md and RELEASENOTES.md for 2.2.2 Major documentation
HBASE-23167 Set version as 2.2.2 in branch-2.2 in prep for first RC of 2.2.2 Major build
HBASE-23163 Refactor HStore.getStorefilesSize related methods Major regionserver
HBASE-22927 Upgrade mockito version for Java 11 compatibility Major .
HBASE-23027 Set version to 2.2.2-SNAPSHOT in branch-2.2 Major .
HBASE-22796 [HBCK2] Add fix of overlaps to fixMeta hbck Service Major .
HBASE-22993 HBCK report UI showed -1 if hbck chore not running Minor .
HBASE-23014 Should not show split parent regions in hbck report UI Major .
HBASE-22859 [HBCK2] Fix the orphan regions on filesystem Major documentation, hbck2

OTHER:

JIRA Summary Priority Component
HBASE-21745 Make HBCK2 be able to fix issues other than region assignment Critical hbase-operator-tools, hbck2
HBASE-23053 Disable concurrent nightly builds Minor build
HBASE-23023 upgrade shellcheck used to test in nightly and precommit Major build

Release 2.2.1 - Unreleased (as of 2019-09-04)

INCOMPATIBLE CHANGES:

JIRA Summary Priority Component
HBASE-22690 Deprecate / Remove OfflineMetaRepair in hbase-2+ Major hbck2

NEW FEATURES:

JIRA Summary Priority Component
HBASE-15666 shaded dependencies for hbase-testing-util Critical test

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-22724 Add a emoji on the vote table for pre commit result on github Major build, test
HBASE-22954 Whitelist net.java.dev.jna which got pulled in through Hadoop 3.3.0 Minor community, hadoop3
HBASE-22905 Avoid temp ByteBuffer allocation in BlockingRpcConnection#writeRequest Major .
HBASE-22962 Fix typo in javadoc description Minor documentation
HBASE-22933 Do not need to kick reassign for rs group change any more Major rsgroup
HBASE-22872 Don't create normalization plan unnecesarily when split and merge both are disabled Minor .
HBASE-20509 Put List in HashSet directly without using addAll function to improve performance Trivial Performance
HBASE-21996 Set locale for javadoc Major documentation
HBASE-22464 Improvements to hbase-vote script Trivial scripts
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot Major .
HBASE-22844 Fix Checkstyle issues in client snapshot exceptions Minor Client
HBASE-22871 Move the DirScanPool out and do not use static field Major master
HBASE-22841 TimeRange's factory functions do not support ranges, only `allTime` and `at` Major Client
HBASE-22828 Log a region close journal Minor .
HBASE-22812 InterfaceAudience annotation in CatalogJanitor uses fully-qualified name Minor .
HBASE-22800 Add mapreduce dependencies to hbase-shaded-testing-util Major .
HBASE-22731 ReplicationSource and HBaseInterClusterReplicationEndpoint log messages should include a target Peer identifier Minor Replication
HBASE-22759 Add user info to AUDITLOG events when doing grant/revoke Major logging, security
HBASE-22785 Reduce number of Checkstyle issues in client exceptions Minor Client
HBASE-22786 Fix Checkstyle issues in tests of hbase-client Minor Client
HBASE-22677 Add unit tests for org.apache.hadoop.hbase.util.ByteRangeUtils and org.apache.hadoop.hbase.util.Classes Major java, test
HBASE-22787 Clean up of tests in hbase-zookeeper Minor Zookeeper
HBASE-22363 Remove hardcoded number of read cache block buckets Trivial BlockCache, BucketCache
HBASE-22764 Fix remaining Checkstyle issues in hbase-rsgroup Trivial rsgroup
HBASE-22763 Fix remaining Checkstyle issue in hbase-procedure Trivial .
HBASE-22743 ClientUtils for hbase-examples Minor .
HBASE-22750 Correct @throws in comment Trivial Client, rpc
HBASE-22702 [Log] 'Group not found for table' is chatty Trivial .
HBASE-22721 Refactor HBaseFsck: move the inner class out Major .
HBASE-22692 Rubocop definition is not used in the /bin directory Minor .
HBASE-22610 [BucketCache] Rename "hbase.offheapcache.minblocksize" Trivial .
HBASE-22704 Avoid NPE when access table.jsp and snapshot.jsp but master not finish initialization Minor .
HBASE-22643 Delete region without archiving only if regiondir is present Major HFile
HBASE-22689 Line break for fix version in documentation Trivial documentation
HBASE-22638 Zookeeper Utility enhancements Minor Zookeeper
HBASE-22669 Add unit tests for org.apache.hadoop.hbase.util.Strings Major java
HBASE-22403 Balance in RSGroup should consider throttling and a failure affects the whole Major rsgroup
HBASE-22604 fix the link in the docs to "Understanding HBase and BigTable" by Jim R. Wilson Trivial documentation
HBASE-22624 Should sanity check table configuration when clone snapshot to a new table Major .
HBASE-22633 Remove redundant call to substring for ZKReplicationQueueStorage Minor .
HBASE-22595 Use full qualified name in Checkstyle suppressions Trivial .
HBASE-22454 refactor WALSplitter Major wal
HBASE-22616 responseTooXXX logging for Multi should characterize the component ops Minor .
HBASE-22596 [Chore] Separate the execution period between CompactionChecker and PeriodicMemStoreFlusher Minor Compaction
HBASE-22561 modify HFilePrettyPrinter to accept non-hbase.rootdir directories Minor .
HBASE-22344 Document deprecated public APIs Major API, community, documentation
HBASE-22593 Add local Jenv file to gitignore Trivial .
HBASE-22116 HttpDoAsClient to support keytab and principal in command line argument. Major .
HBASE-22160 Add sorting functionality in regionserver web UI for user regions Minor monitoring, regionserver, UI, Usability

BUG FIXES:

JIRA Summary Priority Component
HBASE-22970 split parents show as overlaps in the HBCK Report Major .
HBASE-22961 Deprecate hbck1 in core Major hbck
HBASE-22896 TestHRegion.testFlushMarkersWALFail is flaky Minor .
HBASE-22943 Various procedures should not cache log trace level Minor proc-v2
HBASE-22881 Fix non-daemon threads in hbase server implementation Major master
HBASE-22893 Change the comment in HBaseClassTestRule to reflect change in default test timeouts Trivial .
HBASE-22928 ScanMetrics counter update may not happen in case of exception in TableRecordReaderImpl Minor mapreduce
HBASE-22941 MetaTableAccessor.getMergeRegions() returns parent regions in random order Major .
HBASE-22935 TaskMonitor warns MonitoredRPCHandler task may be stuck when it recently started Minor logging
HBASE-22857 Fix the failed ut TestHRegion and TestHRegionWithInMemoryFlush Major .
HBASE-22922 Only the two first regions are locked in MergeTableRegionsProcedure Major .
HBASE-22852 hbase nightlies leaking gpg-agents Minor build
HBASE-22867 The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table Critical master
HBASE-22904 NPE occurs when RS send space quota usage report during HMaster init Minor .
HBASE-22806 Deleted CF are not cleared if memstore contain entries Major API
HBASE-22601 Misconfigured addition of peers leads to cluster shutdown. Major .
HBASE-22863 Avoid Jackson versions and dependencies with known CVEs Major dependencies
HBASE-22879 user_permission command failed to show global permission Major .
HBASE-22882 TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was written flakey) Major test
HBASE-22870 reflection fails to access a private nested class Major master
HBASE-22860 Master's webui returns NPE/HTTP 500 under maintenance mode Major master, UI
HBASE-22856 HBASE-Find-Flaky-Tests fails with pip error Major build, test
HBASE-22632 SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store files for unknown column families Major proc-v2
HBASE-22838 assembly:single failure: user id or group id 'xxxxx' is too big Major build
HBASE-22417 DeleteTableProcedure.deleteFromMeta method should remove table from Master's table descriptors cache Major .
HBASE-22539 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used Blocker rpc, wal
HBASE-22801 Maven build issue on Github PRs Major build
HBASE-22793 RPC server connection is logging user as NULL principal Minor rpc
HBASE-22778 Upgrade jasckson databind to 2.9.9.2 Blocker dependencies
HBASE-22773 when set blockSize option in Performance Evaluation tool, error occurs:ERROR: Unrecognized option/command: --blockSize=131072 Minor mapreduce
HBASE-22735 list_regions may throw an error if a region is RIT Minor shell
HBASE-22145 windows hbase-env causes hbase cli/etc to ignore HBASE_OPTS Major .
HBASE-22408 add a metric for regions OPEN on non-live servers Major .
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta Major .
HBASE-22751 table.jsp fails if ugly regions in table Major UI
HBASE-22733 TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakey Major .
HBASE-22715 All scan requests should be handled by scan handler threads in RWQueueRpcExecutor Minor .
HBASE-22722 Upgrade jackson databind dependencies to 2.9.9.1 Blocker dependencies
HBASE-22603 Javadoc Warnings related to @link tag Trivial documentation
HBASE-22720 Incorrect link for hbase.unittests Trivial documentation
HBASE-21426 TestEncryptionKeyRotation.testCFKeyRotation is flaky Major .
HBASE-20368 Fix RIT stuck when a rsgroup has no online servers but AM's pendingAssginQueue is cleared Major rsgroup
HBASE-22700 Incorrect timeout in recommended ZooKeeper configuration Minor documentation
HBASE-22661 list_regions command in hbase shell is broken Major shell
HBASE-22684 The log rolling request maybe canceled immediately in LogRoller due to a race Major wal
HBASE-22586 Javadoc Warnings related to @param tag Trivial documentation
HBASE-22571 Javadoc Warnings related to @return tag Trivial documentation
HBASE-22681 The 'assert highestUnsyncedTxid < entry.getTxid();' in AbstractFWAL.append may fail when using AsyncFSWAL Critical wal
HBASE-22686 ZkSplitLogWorkerCoordination doesn't allow a regionserver to pick up all of the split work it is capable of Major .
HBASE-22656 [Metrics] Tabe metrics 'BatchPut' and 'BatchDelete' are never updated Minor metrics
HBASE-22582 The Compaction writer may access the lastCell whose memory has been released when appending fileInfo in the final Major Compaction
HBASE-22652 Flakey TestLockManager; test timed out after 780 seconds Major proc-v2
HBASE-22637 fix flaky TestMetaTableMetrics test Major metrics, test
HBASE-13798 TestFromClientSide* don't close the Table Trivial test
HBASE-21751 WAL creation fails during region open may cause region assign forever fail Major .
HBASE-22477 Throwing exception when meta region is not in OPEN state in client registry may crash a master Major Client, master, meta
HBASE-22169 Open region failed cause memory leak Critical .
HBASE-22617 Recovered WAL directories not getting cleaned up Blocker wal
HBASE-22605 Ref guide includes dev guidance only applicable to EOM versions Trivial documentation
HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation Trivial documentation
HBASE-22562 PressureAwareThroughputController#skipControl never invoked Trivial Operability
HBASE-22559 [RPC] set guard against CALL_QUEUE_HANDLER_FACTOR_CONF_KEY Minor rpc
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly Minor metrics, regionserver
HBASE-22458 TestClassFinder fails when run on JDK11 Minor java, test
HBASE-22520 Avoid possible NPE in HalfStoreFileReader seekBefore() Major .

TESTS:

JIRA Summary Priority Component
HBASE-22886 Code Coverage Improvement: Create Unit Tests for ConnectionId Trivial test
HBASE-22766 Code Coverage Improvement: Create Unit Tests for ResultStatsUtil Trivial test
HBASE-22894 Move testOpenRegionFailedMemoryLeak to dedicated class Major test
HBASE-22725 Remove all remaining javadoc warnings Trivial test
HBASE-22615 Make TestChoreService more robust to timing Minor test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-22851 Preparing HBase release 2.2.1RC0: set version to 2.2.1 in branch-2.2 Major .
HBASE-22878 Show table throttle quotas in table jsp Major .
HBASE-22946 Fix TableNotFound when grant/revoke if AccessController is not loaded Major .
HBASE-22945 Show quota infos in master UI Major master, UI
HBASE-22858 Add HBCK Report to master's header.jsp Minor master
HBASE-22891 Use HBaseQA in HBase-PreCommit-GitHub-PR job Major build, scripts
HBASE-22771 [HBCK2] fixMeta method and server-side support Major hbck2
HBASE-22845 Revert MetaTableAccessor#makePutFromTableState access to public Blocker .
HBASE-22777 Add a multi-region merge (for fixing overlaps, etc.) Major hbck2, proc-v2
HBASE-22803 Modify config value range to enable turning off of the hbck chore Major .
HBASE-22824 Show filesystem path for the orphans regions on filesystem Major .
HBASE-22808 HBCK Report showed the offline regions which belong to disabled table Major .
HBASE-22807 HBCK Report showed wrong orphans regions on FileSystem Major .
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run Major .
HBASE-22741 Show catalogjanitor consistency complaints in new 'HBCK Report' page Major hbck2, UI
HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta Major .
HBASE-22709 Add a chore thread in master to do hbck checking and display results in 'HBCK Report' page Major .
HBASE-22742 [HBCK2] Add more log for hbck operations at master side Minor .
HBASE-22527 [hbck2] Add a master web ui to show the problematic regions Major hbase-operator-tools, hbck2
HBASE-22719 Add debug support for github PR pre commit job Major build
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface Major hbck2
HBASE-7191 HBCK - Add offline create/fix hbase.version and hbase.id Major hbck
HBASE-22600 Document that LoadIncrementalHFiles will be removed in 3.0.0 Major .
HBASE-22569 Should treat null consistency as Consistency.STRONG in ConnectionUtils.timelineConsistentRead Major .

OTHER:

JIRA Summary Priority Component
HBASE-22833 MultiRowRangeFilter should provide a method for creating a filter which is functionally equivalent to multiple prefix filters Minor Client
HBASE-22895 Fix the flakey TestSpaceQuotas Major Quotas, test
HBASE-22914 Backport HBASE-20662 to branch-2.2 Major .
HBASE-22910 Enable TestMultiVersionConcurrencyControl Major test
HBASE-22913 Use Hadoop label for nightly builds Major build
HBASE-22911 fewer concurrent github PR builds Critical build
HBASE-21400 correct spelling error of 'initilize' in comment Trivial documentation
HBASE-22382 Refactor tests in TestFromClientSide Major test
HBASE-21606 Document use of the meta table load metrics added in HBASE-19722 Critical documentation, meta, metrics, Operability
HBASE-19230 Write up fixVersion policy from dev discussion in refguide Major documentation
HBASE-22566 Call out default compaction throttling for 2.x in Book Major documentation
HBASE-22560 Upgrade to Jetty 9.3.latest and Jackson 2.9.latest Major dependencies

Release 2.2.0 - Unreleased (as of 2019-06-11)

INCOMPATIBLE CHANGES:

JIRA Summary Priority Component
HBASE-21991 Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements Major Coprocessors, metrics
HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks Major build, hadoop2
HBASE-21082 Reimplement assign/unassign related procedure metrics Critical amv2, metrics
HBASE-20587 Replace Jackson with shaded thirdparty gson Major dependencies
HBASE-21727 Simplify documentation around client timeout Minor .
HBASE-21684 Throw DNRIOE when connection or rpc client is closed Major asyncclient, Client
HBASE-21792 Mark HTableMultiplexer as deprecated and remove it in 3.0.0 Major Client
HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case. Major Performance
HBASE-21560 Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptor Major Coprocessors
HBASE-21492 CellCodec Written To WAL Before It's Verified Critical wal
HBASE-21452 Illegal character in hbase counters group name Major spark
HBASE-21158 Empty qualifier cell should not be returned if it does not match QualifierFilter Critical Filters
HBASE-21223 [amv2] Remove abort_procedure from shell Critical amv2, hbck2, shell
HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region Major amv2, proc-v2
HBASE-20884 Replace usage of our Base64 implementation with java.util.Base64 Major .

NEW FEATURES:

JIRA Summary Priority Component
HBASE-22148 Provide an alternative to CellUtil.setTimestamp Blocker API, Coprocessors
HBASE-21815 Make isTrackingMetrics and getMetrics of ScannerContext public Minor .
HBASE-21926 Profiler servlet Major master, Operability, regionserver
HBASE-20886 [Auth] Support keytab login in hbase client Critical asyncclient, Client, security
HBASE-17942 Disable region splits and merges per table Major .
HBASE-21753 Support getting the locations for all the replicas of a region Major Client
HBASE-20636 Introduce two bloom filter type : ROWPREFIX_FIXED_LENGTH and ROWPREFIX_DELIMITED Major HFile, regionserver, Scanners
HBASE-20649 Validate HFiles do not have PREFIX_TREE DataBlockEncoding Minor Operability, tooling

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-22284 optimization StringBuilder.append of AbstractMemStore.toString Trivial .
HBASE-22523 Refactor RegionStates#getAssignmentsByTable to make it easy to understand Major .
HBASE-22511 More missing /rs-status links Minor UI
HBASE-22496 UnsafeAccess.unsafeCopy should not copy more than UNSAFE_COPY_THRESHOLD on each iteration Major .
HBASE-22488 Cleanup the explicit timeout value for test methods Major .
HBASE-22411 Refactor codes of moving reigons in RSGroup Major rsgroup
HBASE-22467 WebUI changes to enable Apache Knox UI proxying Major UI
HBASE-22474 Add --mvn-custom-repo parameter to yetus calls Minor .
HBASE-20305 Add option to SyncTable that skip deletes on target cluster Minor mapreduce
HBASE-21784 Dump replication queue should show list of wal files ordered chronologically Major Replication, tooling
HBASE-22384 Formatting issues in administration section of book Minor community, documentation
HBASE-21658 Should get the meta replica number from zk instead of config at client side Critical Client
HBASE-22365 Region may be opened on two RegionServers Blocker amv2
HBASE-22392 Remove extra/useless + Trivial .
HBASE-20494 Upgrade com.yammer.metrics dependency Major dependencies
HBASE-22358 Change rubocop configuration for method length Minor community, shell
HBASE-22379 Fix Markdown for "Voting on Release Candidates" in book Minor community, documentation
HBASE-22109 Update hbase shaded content checker after guava update in hadoop branch-3.0 to 27.0-jre Minor .
HBASE-22087 Update LICENSE/shading for the dependencies from the latest Hadoop trunk Minor hadoop3
HBASE-22341 Add explicit guidelines for removing deprecations in book Major API, community, documentation
HBASE-22225 Profiler tab on Master/RS UI not working w/o comprehensive message Minor UI
HBASE-22291 Fix recovery of recovered.edits files under root dir Major .
HBASE-22283 Print row and table information when failed to get region location Major Client, logging
HBASE-22296 Remove TestFromClientSide.testGetStartEndKeysWithRegionReplicas Major test
HBASE-22250 The same constants used in many places should be placed in constant classes Minor Client, conf, regionserver
HBASE-20586 SyncTable tool: Add support for cross-realm remote clusters Major mapreduce, Operability, Replication
HBASE-21257 misspelled words.[occured -> occurred] Trivial .
HBASE-22193 Add backoff when region failed open too many times Major .
HBASE-22188 Make TestSplitMerge more stable Major test
HBASE-22097 Modify the description of split command in shell Trivial shell
HBASE-21964 unset Quota by Throttle Type Major master
HBASE-22093 Combine TestRestoreSnapshotFromClientWithRegionReplicas to CloneSnapshotFromClientAfterSplittingRegionTestBase#testCloneSnapshotAfterSplittingRegion Major .
HBASE-22009 Improve RSGroupInfoManagerImpl#getDefaultServers() Minor rsgroup
HBASE-22032 KeyValue validation should check for null byte array Major .
HBASE-21667 Move to latest ASF Parent POM Minor build
HBASE-21810 bulkload support set hfile compression on client Major mapreduce
HBASE-21987 Simplify RSGroupInfoManagerImpl#flushConfig() for offline mode Minor rsgroup
HBASE-21871 Support to specify a peer table name in VerifyReplication tool Major .
HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table) Major .
HBASE-21410 A helper page that help find all problematic regions and procedures Major .
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir Major MTTR, Recovery, wal
HBASE-20401 Make `MAX_WAIT` and `waitIfNotFinished` in CleanerContext configurable Minor master
HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin Major .
HBASE-21967 Split TestServerCrashProcedure and TestServerCrashProcedureWithReplicas Major .
HBASE-21867 Support multi-threads in HFileArchiver Major .
HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout Major .
HBASE-21875 Change the retry logic in RSProcedureDispatcher to 'retry by default, only if xxx' Major proc-v2
HBASE-21780 Avoid a wide line on the RegionServer webUI for many ZooKeeper servers Minor UI, Usability
HBASE-21636 Enhance the shell scan command to support missing scanner specifications like ReadType, IsolationLevel etc. Major shell
HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer Major .
HBASE-21201 Support to run VerifyReplication MR tool without peerid Major hbase-operator-tools
HBASE-21816 Print source cluster replication config directory Trivial Replication
HBASE-19616 Review of LogCleaner Class Minor .
HBASE-21830 Backport HBASE-20577 (Make Log Level page design consistent with the design of other pages in UI) to branch-2 Major UI, Usability
HBASE-21833 Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegion Minor test
HBASE-21634 Print error message when user uses unacceptable values for LIMIT while setting quotas. Minor .
HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService Major Client, Coprocessors
HBASE-21689 Make table/namespace specific current quota info available in shell(describe_namespace & describe) Minor .
HBASE-20215 Rename CollectionUtils to ConcurrentMapUtils Trivial .
HBASE-21720 metric to measure how actions are distributed to servers within a MultiAction Minor Client, metrics, monitoring
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly Minor regionserver
HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink Trivial Replication
HBASE-21712 Make submit-patch.py python3 compatible Minor tooling
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit Critical Performance, Scanners
HBASE-21297 ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION change Minor .
HBASE-21700 Simplify the implementation of RSGroupInfoManagerImpl Major rsgroup
HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands Major .
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1 Minor .
HBASE-21360 Disable printing of stack-trace in shell for quotas Minor shell
HBASE-21662 Add append_peer_exclude_namespaces and remove_peer_exclude_namespaces shell commands Major .
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor Minor .
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time. Major .
HBASE-21643 Introduce two new region coprocessor method and deprecated postMutationBeforeWAL Major .
HBASE-21640 Remove the TODO when increment zero Major .
HBASE-21631 list_quotas should print human readable values for LIMIT Minor shell
HBASE-21635 Use maven enforcer to ban imports from illegal packages Major build
HBASE-21514 Refactor CacheConfig Major .
HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type Major test
HBASE-21554 Show replication endpoint classname for replication peer on master web UI Minor UI
HBASE-21549 Add shell command for serial replication peer Major .
HBASE-21283 Add new shell command 'rit' for listing regions in transition Minor Operability, shell
HBASE-21567 Allow overriding configs starting up the shell Major shell
HBASE-21413 Empty meta log doesn't get split when restart whole cluster Major .
HBASE-21524 Unnecessary DEBUG log in ConnectionImplementation#isTableEnabled Major Client
HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles Minor snapshots
HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online Major snapshots
HBASE-21485 Add more debug logs for remote procedure execution Major proc-v2
HBASE-21328 add HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP switch to hbase-env.sh Minor documentation, Operability
HBASE-19682 Use Collections.emptyList() For Empty List Values Minor .
HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table Major .
HBASE-21325 Force to terminate regionserver when abort hang in somewhere Major .
HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess Major .
HBASE-21318 Make RefreshHFilesClient runnable Minor HFile
HBASE-21263 Mention compression algorithm along with other storefile details Minor .
HBASE-21290 No need to instantiate BlockCache for master which not carry table Major .
HBASE-21256 Improve IntegrationTestBigLinkedList for testing huge data Major integration tests
HBASE-21251 Refactor RegionMover Major Operability
HBASE-21303 [shell] clear_deadservers with no args fails Major .
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3 Major .
HBASE-21299 List counts of actual region states in master UI tables section Major UI
HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL Minor .
HBASE-21185 WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes Minor Operability
HBASE-21103 nightly test cache of yetus install needs to be more thorough in verification Major test
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details. Minor master, monitoring, UI, Usability
HBASE-20857 JMX - add Balancer status = enabled / disabled Major API, master, metrics, REST, tooling, Usability
HBASE-21164 reportForDuty to spew less log if master is initializing Minor regionserver
HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set Major .
HBASE-20307 LoadTestTool prints too much zookeeper logging Minor tooling
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir Trivial .
HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter Minor Filters
HBASE-21157 Split TableInputFormatScan to individual tests Minor test
HBASE-21107 add a metrics for netty direct memory Minor IPC/RPC
HBASE-21153 Shaded client jars should always build in relevant phase to avoid confusion Major build
HBASE-21126 Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes Minor canary, Zookeeper
HBASE-20749 Upgrade our use of checkstyle to 8.6+ Minor build, community
HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern Major test
HBASE-20387 flaky infrastructure should work for all branches Critical test
HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable Minor .
HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors Minor test
HBASE-20985 add two attributes when we do normalization Major .
HBASE-20965 Separate region server report requests to new handlers Major Performance
HBASE-20845 Support set the consistency for Gets and Scans in thrift2 Major Thrift
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog Major .
HBASE-19036 Add action in Chaos Monkey to restart Active Namenode Minor .
HBASE-20856 PITA having to set WAL provider in two places Minor Operability, wal
HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file Minor .
HBASE-20873 Update doc for Endpoint-based Export Minor documentation
HBASE-20672 New metrics ReadRequestRate and WriteRequestRate Minor metrics
HBASE-20617 Upgrade/remove jetty-jsp Minor .
HBASE-20396 Remove redundant MBean from thrift JMX Major Thrift
HBASE-20357 AccessControlClient API Enhancement Major security

BUG FIXES:

JIRA Summary Priority Component
HBASE-22563 Reduce retained jobs for Jenkins pipelines Major .
HBASE-22552 Rewrite TestEndToEndSplitTransaction.testCanSplitJustAfterASplit Major test
HBASE-22551 TestMasterOperationsForRegionReplicas is flakey Major read replicas, test
HBASE-22481 Javadoc Warnings: reference not found Trivial documentation
HBASE-22546 TestRegionServerHostname#testRegionServerHostname fails reliably for me Major .
HBASE-22534 TestCellUtil fails when run on JDK11 Minor java, test
HBASE-22536 TestForeignExceptionSerialization fails when run on JDK11 Minor java
HBASE-22535 TestShellRSGroups fails when run on JDK11 Minor java, shell
HBASE-22518 yetus personality is treating branch-1.4 like earlier branches for hadoopcheck Major test
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set Major Quotas
HBASE-22522 The integration test in master branch's nightly job has error "ERROR: Only found 1050 rows." Major .
HBASE-22490 Nightly client integration test fails with hadoop-3 Major build
HBASE-22502 Purge the logs when we reach the EOF for the last wal file when replication Major .
HBASE-22503 Failed to upgrade to 2.2+ as the global permission which storaged in zk is not right Blocker .
HBASE-22487 getMostLoadedRegions is unused Trivial regionserver
HBASE-22485 Fix failed ut TestClusterRestartFailover Major .
HBASE-22486 Fix flaky test TestLockManager Major .
HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test Major build
HBASE-22003 Fix flaky test TestVerifyReplication.testHBase14905 Major .
HBASE-22441 BucketCache NullPointerException in cacheBlock Major BucketCache
HBASE-22473 Split TestSCP Major Recovery, test
HBASE-22456 Polish TestSplitTransitionOnCluster Major test
HBASE-21800 RegionServer aborted due to NPE from MetaTableMetrics coprocessor Critical Coprocessors, meta, metrics, Operability
HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job Major build
HBASE-22440 HRegionServer#getWalGroupsReplicationStatus() throws NPE Major regionserver, Replication
HBASE-22226 Incorrect level for headings in asciidoc Trivial documentation
HBASE-22442 Nightly build is failing with hadoop 3.x Major build, hadoop3
HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality Major build
HBASE-22424 Interactions in RSGroup test classes will cause TestRSGroupsAdmin2.testMoveServersAndTables and TestRSGroupsBalance.testGroupBalance flaky Major rsgroup
HBASE-22404 Open/Close region request may be executed twice when master restart Major .
HBASE-22274 Cell size limit check on append should consider cell's previous size. Minor .
HBASE-22072 High read/write intensive regions may cause long crash recovery Major Performance, Recovery
HBASE-22324 loss a mass of data when the sequenceId of cells greater than Integer.Max, because MemStoreMergerSegmentsIterator can not merge segments Blocker in-memory-compaction
HBASE-21777 "Tune compaction throughput" debug messages even when nothing has changed Trivial Compaction
HBASE-22360 Abort timer doesn't set when abort is called during graceful shutdown process Major regionserver
HBASE-20851 Change rubocop config for max line length of 100 Minor community, shell
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars Minor .
HBASE-22312 Hadoop 3 profile for hbase-shaded-mapreduce should like mapreduce as a provided dependency Major mapreduce, shading
HBASE-22314 shaded byo-hadoop client should list needed hadoop modules as provided scope to avoid inclusion of unnecessary transitive depednencies Major hadoop2, hadoop3, shading
HBASE-22047 LeaseException in Scan should be retired Major Client, Scanners
HBASE-22343 Make procedure retry interval configurable in test Major amv2, test
HBASE-22190 SnapshotFileCache may fail to load the correct snapshot file list when there is an on-going snapshot operation Blocker snapshots
HBASE-22354 master never sets abortRequested, and thus abort timeout doesn't work for it Major .
HBASE-22350 Rewrite TestClientOperationTimeout so we do not timeout when creating table Major test
HBASE-22340 Corrupt KeyValue is silently ignored Critical wal
HBASE-22054 Space Quota: Compaction is not working for super user in case of NO_WRITES_COMPACTIONS Minor .
HBASE-22236 AsyncNonMetaRegionLocator should not cache HRegionLocation with null location Major asyncclient
HBASE-22086 space quota issue: deleting snapshot doesn't update the usage of table Minor .
HBASE-22298 branch-2.2 nightly fails "[ForOverride] Method annotated @ForOverride must have protected or package-private visibility" Major .
HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue Blocker .
HBASE-22230 REST Server drops connection on long scans Major .
HBASE-22200 WALSplitter.hasRecoveredEdits should use same FS instance from WAL region dir Major wal
HBASE-22286 License handling incorrectly lists CDDL/GPLv2+CE as safe to not aggregate Critical build, community
HBASE-22282 Should deal with error in the callback of RawAsyncHBaseAdmin.splitRegion methods Major Admin, asyncclient
HBASE-22278 RawAsyncHBaseAdmin should not use cached region location Major Admin, asyncclient
HBASE-22222 Site build fails after hbase-thirdparty upgrade Blocker website
HBASE-22249 Rest Server throws NoClassDefFoundError with Java 11 (run-time) Major .
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors Major Coprocessors
HBASE-22207 Fix flakey TestAssignmentManager.testAssignSocketTimeout Major test
HBASE-22202 Fix new findbugs issues after we upgrade hbase-thirdparty dependencies Major findbugs
HBASE-22144 MultiRowRangeFilter does not work with reversed scans Critical Filters, Scanners
HBASE-22198 Fix flakey TestAsyncTableGetMultiThreaded Major test
HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block Major .
HBASE-22163 Should not archive the compacted store files when region warmup Blocker .
HBASE-22178 Introduce a createTableAsync with TableDescriptor method in Admin Major Admin
HBASE-22180 Make TestBlockEvictionFromClient.testBlockRefCountAfterSplits more stable Major test
HBASE-22179 Fix RawAsyncHBaseAdmin.getCompactionState Major Admin, asyncclient
HBASE-22177 Do not recreate IOException in RawAsyncHBaseAdmin.adminCall Major Admin, asyncclient
HBASE-22070 Checking restoreDir in RestoreSnapshotHelper Minor snapshots
HBASE-20912 Add import order config in dev support for eclipse Major .
HBASE-22133 Forward port HBASE-22073 "/rits.jsp throws an exception if no procedure" to branch-2.2+ Major UI
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse Major .
HBASE-21688 Address WAL filesystem issues Major Filesystem Integration, wal
HBASE-22121 AsyncAdmin can not deal with non default meta replica Major Admin, asyncclient, Client
HBASE-22115 HBase RPC aspires to grow an infinite tree of trace scopes; some other places are also unsafe Critical .
HBASE-22123 REST gateway reports Insufficient permissions exceptions as 404 Not Found Minor REST
HBASE-21135 Build fails on windows as it fails to parse windows path during license check Major build
HBASE-21781 list_deadservers elapsed time is incorrect Major shell
HBASE-22100 False positive for error prone warnings in pre commit job Minor build
HBASE-22098 Backport HBASE-18667 "Disable error-prone for hbase-protocol-shaded" to branch-2 Major build
HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement Major .
HBASE-22057 Impose upper-bound on size of ZK ops sent in a single multi() Major .
HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition Blocker amv2, proc-v2
HBASE-21619 Fix warning message caused by incorrect ternary operator evaluation Trivial .
HBASE-22095 Taking a snapshot fails in local mode Major .
HBASE-22061 SplitTableRegionProcedure should hold the lock of its daughter regions Major .
HBASE-22045 Mutable range histogram reports incorrect outliers Major .
HBASE-21736 Remove the server from online servers before scheduling SCP for it in hbck Major hbck2, test
HBASE-22011 ThriftUtilities.getFromThrift should set filter when not set columns Major .
HBASE-21990 puppycrawl checkstyle dtds 404... moved to sourceforge Major build
HBASE-22010 docs on upgrade from 2.0,2.1 -> 2.2 renders incorrectly Minor documentation
HBASE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed. Major .
HBASE-21960 RESTServletContainer not configured for REST Jetty server Blocker REST
HBASE-21915 FileLink$FileLinkInputStream doesn't implement CanUnbuffer Major Filesystem Integration
HBASE-21565 Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same server Critical .
HBASE-21740 NPE happens while shutdown the RS Major .
HBASE-21866 Do not move the table to null rsgroup when creating an existing table Major proc-v2, rsgroup
HBASE-21983 Should track the scan metrics in AsyncScanSingleRegionRpcRetryingCaller if scan metrics is enabled Major asyncclient, Client
HBASE-21980 Fix typo in AbstractTestAsyncTableRegionReplicasRead Major test
HBASE-21487 Concurrent modify table ops can lead to unexpected results Major .
HBASE-20724 Sometimes some compacted storefiles are still opened after region failover Critical .
HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row Critical asyncclient, Client
HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client Critical asyncclient, Client
HBASE-21947 TestShell is broken after we remove the jackson dependencies Major dependencies, shell
HBASE-21942 [UI] requests per second is incorrect in rsgroup page(rsgroup.jsp) Minor .
HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter Major .
HBASE-21929 The checks at the end of TestRpcClientLeaks are not executed Major test
HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics Major .
HBASE-21928 Deprecated HConstants.META_QOS Major Client, rpc
HBASE-21899 Fix missing variables in slf4j Logger Trivial logging
HBASE-21910 The nonce implementation is wrong for AsyncTable Critical asyncclient, Client
HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta Major asyncclient, Client
HBASE-21890 Use execute instead of submit to submit a task in RemoteProcedureDispatcher Critical proc-v2
HBASE-21889 Use thrift 0.12.0 when build thrift by compile-thrift profile Major .
HBASE-21785 master reports open regions as RITs and also messes up rit age metric Major .
HBASE-21854 Race condition in TestProcedureSkipPersistence Minor proc-v2
HBASE-21862 IPCUtil.wrapException should keep the original exception types for all the connection exceptions Blocker .
HBASE-18484 VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters Major Replication
HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Major Client
HBASE-21843 RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta region Blocker wal
HBASE-21795 Client application may get stuck (time bound) if a table modify op is called immediately after split op Critical amv2
HBASE-21840 TestHRegionWithInMemoryFlush fails with NPE Blocker test
HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports Blocker amv2
HBASE-21644 Modify table procedure runs infinitely for a table having region replication > 1 Critical Admin
HBASE-21733 SnapshotQuotaObserverChore should only fetch space quotas Major .
HBASE-21699 Create table failed when using SPLITS_FILE => 'splits.txt' Blocker Client, shell
HBASE-21535 Zombie Master detector is not working Critical master
HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations Major Client
HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor Major .
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires Major Coprocessors
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication Major Replication, UI
HBASE-21746 Fix two concern cases in RegionMover Major .
HBASE-21732 Should call toUpperCase before using Enum.valueOf in some methods for ColumnFamilyDescriptor Critical Client
HBASE-21704 The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect Major .
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region Major meta, metrics
HBASE-21639 maxHeapUsage value not read properly from config during EntryBuffers initialization Minor .
HBASE-21225 Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE' Major .
HBASE-21707 Fix warnings in hbase-rsgroup module and also make the UTs more stable Major Region Assignment, rsgroup
HBASE-20220 [RSGroup] Check if table exists in the cluster before moving it to the specified regionserver group Major rsgroup
HBASE-21691 Fix flaky test TestRecoveredEdits Major .
HBASE-21695 Fix flaky test TestRegionServerAbortTimeout Major .
HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions Critical amv2
HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result Critical Client
HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region Critical read replicas
HBASE-21630 [shell] Define ENDKEY == STOPROW (we have ENDROW) Trivial shell
HBASE-21547 Precommit uses master flaky list for other branches Major test
HBASE-21660 Apply the cell to right memstore for increment/append operation Major .
HBASE-21646 Flakey TestTableSnapshotInputFormat; DisableTable not completing... Major test
HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns Major API
HBASE-21629 draining_servers.rb is broken Major scripts
HBASE-21621 Reversed scan does not return expected number of rows Critical Scanners
HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases. Major Scanners
HBASE-21610 numOpenConnections metric is set to -1 when zero server channel exist Minor metrics
HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache Major .
HBASE-21592 quota.addGetResult(r) throw NPE Major .
HBASE-21589 TestCleanupMetaWAL fails Blocker test, wal
HBASE-21575 memstore above high watermark message is logged too much Minor logging, regionserver
HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time Major .
HBASE-21568 Disable use of BlockCache for LoadIncrementalHFiles Major Client
HBASE-21453 Convert ReadOnlyZKClient to DEBUG instead of INFO Major logging, Zookeeper
HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky Major .
HBASE-21551 Memory leak when use scan with STREAM at server side Blocker regionserver
HBASE-21550 Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptor Major Coprocessors
HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing Major .
HBASE-21518 TestMasterFailoverWithProcedures is flaky Major .
HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. Critical Compaction
HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns Major .
HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method Major Compaction, regionserver
HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files Major snapshots
HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads. Blocker Replication
HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir Major .
HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS Major mapreduce
HBASE-21437 Bypassed procedure throw IllegalArgumentException when its state is WAITING_TIMEOUT Major .
HBASE-21439 StochasticLoadBalancer RegionLoads aren’t being used in RegionLoad cost functions Major Balancer
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled Critical Replication, wal
HBASE-21247 Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers Major wal
HBASE-21430 [hbase-connectors] Move hbase-spark* modules to hbase-connectors repo Major hbase-connectors, spark
HBASE-21438 TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible Major .
HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned Critical amv2
HBASE-21407 Resolve NPE in backup Master UI Minor UI
HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR Major proc-v2, test
HBASE-21424 Change flakies and nightlies so scheduled less often Major build
HBASE-21417 Pre commit build is broken due to surefire plugin crashes Critical build
HBASE-21371 Hbase unable to compile against Hadoop trunk (3.3.0-SNAPSHOT) due to license error Major .
HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing Major Replication
HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad Major .
HBASE-21349 Cluster is going down but CatalogJanitor and Normalizer try to run and fail noisely Minor .
HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permission Major .
HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split Blocker regionserver
HBASE-21334 TestMergeTableRegionsProcedure is flakey Major amv2, proc-v2, test
HBASE-21178 [BC break] : Get and Scan operation with a custom converter_class not working Critical shell
HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner. Critical Scanners
HBASE-21292 IdLock.getLockEntry() may hang if interrupted Major .
HBASE-21335 Change the default wait time of HBCK2 tool Critical .
HBASE-21291 Add a test for bypassing stuck state-machine procedures Major .
HBASE-21055 NullPointerException when balanceOverall() but server balance info is null Major Balancer
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP Trivial amv2
HBASE-21320 [canary] Cleanup of usage and add commentary Major canary
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list Major .
HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region Major Balancer, master
HBASE-21280 Add anchors for each heading in UI Trivial UI, Usability
HBASE-20764 build broken when latest commit is gpg signed Critical build
HBASE-18549 Unclaimed replication queues can go undetected Critical Replication
HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure Major proc-v2, Replication
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation Critical Performance
HBASE-19418 RANGE_OF_DELAY in PeriodicMemstoreFlusher should be configurable. Minor .
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request Major regionserver
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later Critical wal
HBASE-20766 Verify Replication Tool Has Typo "remove cluster" Trivial .
HBASE-21232 Show table state in Tables view on Master home page Major Operability, UI
HBASE-21212 Wrong flush time when update flush metric Minor .
HBASE-21208 Bytes#toShort doesn't work without unsafe Critical .
HBASE-20704 Sometimes some compacted storefiles are not archived on region close Critical Compaction
HBASE-21203 TestZKMainServer#testCommandLineWorks won't pass with default 4lw whitelist Minor test, Zookeeper
HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region Major Region Assignment
HBASE-21206 Scan with batch size may return incomplete cells Critical Scanners
HBASE-21182 Failed to execute start-hbase.sh Major .
HBASE-21179 Fix the number of actions in responseTooSlow log Major logging, rpc
HBASE-21174 [REST] Failed to parse empty qualifier in TableResource#getScanResource Major REST
HBASE-21181 Use the same filesystem for wal archive directory and wal directory Major .
HBASE-21021 Result returned by Append operation should be ordered Major .
HBASE-21173 Remove the duplicate HRegion#close in TestHRegion Minor test
HBASE-21144 AssignmentManager.waitForAssignment is not stable Major amv2, test
HBASE-21143 Update findbugs-maven-plugin to 3.0.4 Major pom
HBASE-21171 [amv2] Tool to parse a directory of MasterProcWALs standalone Major amv2, test
HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck Major snapshots
HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0 Major .
HBASE-20741 Split of a region with replicas creates all daughter regions and its replica in same server Major read replicas
HBASE-21127 TableRecordReader need to handle cursor result too Major .
HBASE-20892 [UI] Start / End keys are empty on table.jsp Major .
HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime Major metrics
HBASE-21132 return wrong result in rest multiget Major .
HBASE-21128 TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is broken Major test
HBASE-20940 HStore.cansplit should not allow split to happen if it has references Major .
HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online Major snapshots
HBASE-20968 list_procedures_test fails due to no matching regex Major shell, test
HBASE-21030 Correct javadoc for append operation Minor documentation
HBASE-21088 HStoreFile should be closed in HStore#hasReferences Major .
HBASE-20890 PE filterScan seems to be stuck forever Minor .
HBASE-20772 Controlled shutdown fills Master log with the disturbing message "No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSED Major logging
HBASE-20978 [amv2] Worker terminating UNNATURALLY during MoveRegionProcedure Critical amv2
HBASE-21078 [amv2] CODE-BUG NPE in RTP doing Unassign Major amv2
HBASE-21113 Apply the branch-2 version of HBASE-21095, The timeout retry logic for several procedures are broken after master restarts Major amv2
HBASE-21101 Remove the waitUntilAllRegionsAssigned call after split in TestTruncateTableProcedure Major test
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations Major .
HBASE-20614 REST scan API with incorrect filter text file throws HTTP 503 Service Unavailable error Minor REST
HBASE-21041 Memstore's heap size will be decreased to minus zero after flush Major .
HBASE-21031 Memory leak if replay edits failed during region opening Major .
HBASE-20666 Unsuccessful table creation leaves entry in hbase:rsgroup table Minor .
HBASE-21032 ScanResponses contain only one cell each Major Performance, Scanners
HBASE-20705 Having RPC Quota on a table prevents Space quota to be recreated/removed Major .
HBASE-21058 Nightly tests for branches 1 fail to build ref guide Major documentation
HBASE-21074 JDK7 branches need to pass "-Dhttps.protocols=TLSv1.2" to maven when building Major build, community, test
HBASE-21062 WALFactory has misleading notion of "default" Major wal
HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 Major .
HBASE-21005 Maven site configuration causes downstream projects to get a directory named ${project.basedir} Minor build
HBASE-21007 Memory leak in HBase rest server Critical REST
HBASE-20794 CreateTable operation does not log its landing at the master nor the initiator at INFO level Major logging
HBASE-20538 Upgrade our hadoop versions to 2.7.7 and 3.0.3 Critical java, security
HBASE-20927 RSGroupAdminEndpoint doesn't handle clearing dead servers if they are not processed yet. Major .
HBASE-20932 Effective MemStoreSize::hashCode() Major .
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow Minor io
HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result since 1.4 Major Filters
HBASE-20908 Infinite loop on regionserver if region replica are reduced Major read replicas
HBASE-19893 restore_snapshot is broken in master branch when region splits Critical snapshots
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool Minor integration tests
HBASE-20901 Reducing region replica has no effect Major .
HBASE-6028 Implement a cancel for in-progress compactions Minor regionserver
HBASE-20869 Endpoint-based Export use incorrect user to write to destination Major Coprocessors
HBASE-20879 Compacting memstore config should handle lower case Major .
HBASE-20865 CreateTableProcedure is stuck in retry loop in CREATE_TABLE_WRITE_FS_LAYOUT state Major amv2
HBASE-19572 RegionMover should use the configured default port number and not the one from HConstants Major .
HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations() Major meta
HBASE-20791 RSGroupBasedLoadBalancer#setClusterMetrics should pass ClusterMetrics to its internalBalancer Major Balancer, rsgroup
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do Critical logging

TESTS:

JIRA Summary Priority Component
HBASE-21963 Add a script for building and verifying release candidate Minor community, scripts
HBASE-21756 Backport HBASE-21279 (Split TestAdminShell into several tests) to branch-2 Major .
HBASE-20136 TestKeyValue misses ClassRule and Category annotations Minor .
HBASE-21261 Add log4j.properties for hbase-rsgroup tests Trivial .
HBASE-21258 Add resetting of flags for RS Group pre/post hooks in TestRSGroups Major .
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning Major regionserver
HBASE-21138 Close HRegion instance at the end of every test in TestHRegion Major .
HBASE-21161 Enable the test added in HBASE-20741 that was removed accidentally Minor .
HBASE-21076 TestTableResource fails with NPE Major REST, test
HBASE-20907 Fix Intermittent failure on TestProcedurePriority Major .
HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed Major .

SUB-TASKS:

JIRA Summary Priority Component
HBASE-21970 Document that how to upgrade from 2.0 or 2.1 to 2.2+ Major .
HBASE-22357 Fix remaining Checkstyle issues in hbase-replication Trivial Replication
HBASE-22554 Upgrade to surefire 2.22.2 Major test
HBASE-22500 Modify pom and jenkins jobs for hadoop versions Blocker build, hadoop2, hadoop3
HBASE-22316 Record the stack trace for current thread in FutureUtils.get Major asyncclient, Client
HBASE-22326 Fix Checkstyle errors in hbase-examples Minor .
HBASE-22327 Fix remaining Checkstyle issues in hbase-hadoop-compat Trivial .
HBASE-22478 Add jackson dependency for hbase-http module Major build, dependencies
HBASE-22445 Add file info when throw exceptions in HFileReaderImpl Major .
HBASE-22447 Check refCount before free block in BucketCache Major BucketCache
HBASE-22400 Remove the adapter code in async fs implementation for hadoop-2.7.x Major wal
HBASE-22430 hbase-vote should tee build and test output to console Trivial .
HBASE-22429 hbase-vote download step requires URL to end with '/' Trivial .
HBASE-22405 Update Ref Guide for EOL of Hadoop 2.7 Major community, documentation
HBASE-22325 AsyncRpcRetryingCaller will not schedule retry if we hit a NotServingRegionException but there is no TableName provided Major asyncclient, Client
HBASE-22322 Use special pause for CallQueueTooBigException Major asyncclient, Client
HBASE-22317 Support reading from meta replicas Major asyncclient, read replicas
HBASE-22261 Make use of ClusterStatusListener for async client Major asyncclient
HBASE-22267 Implement client push back for async client Major asyncclient
HBASE-19763 Fix Checkstyle errors in hbase-procedure Minor .
HBASE-22244 Make use of MetricsConnection in async client Major asyncclient, metrics
HBASE-22196 Split TestRestartCluster Major test
HBASE-22117 Move hasPermission/checkPermissions from region server to master Major .
HBASE-21886 Run ITBLL for branch-2.2 Major .
HBASE-22155 Move 2.2.0 on to hbase-thirdparty-2.2.0 Major thirdparty
HBASE-22153 Fix the flaky TestRestartCluster Major test
HBASE-22152 Create a jenkins file for yetus to processing GitHub PR Major build
HBASE-22158 RawAsyncHBaseAdmin.getTableSplits should filter out none default replicas Major Admin
HBASE-22157 Include the cause when constructing RestoreSnapshotException in restoreSnapshot Major Admin
HBASE-22141 Fix TestAsyncDecommissionAdminApi Major test
HBASE-22135 AsyncAdmin will not refresh master address Major Admin, asyncclient, Client
HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException Major Admin, asyncclient, Client
HBASE-22094 Throw TableNotFoundException if table not exists in AsyncAdmin.compact Major Admin
HBASE-21911 Move getUserPermissions from regionserver to master Major .
HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public Blocker .
HBASE-22066 Add markers to CHANGES.md and RELEASENOTES.md Major .
HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin Major Admin, asyncclient, Client
HBASE-22039 Should add the synchronous parameter for the XXXSwitch method in AsyncAdmin Major Admin, asyncclient, Client
HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check Major .
HBASE-22025 RAT check fails in nightlies; fails on (old) test data files. Major .
HBASE-21977 Skip replay WAL and update seqid when open regions restored from snapshot Major Region Assignment, snapshots
HBASE-21999 [DEBUG] Exit if git returns empty revision! Major build
HBASE-22000 Deprecated isTableAvailable with splitKeys Major asyncclient, Client
HBASE-21949 Fix flaky test TestHBaseTestingUtility.testMiniZooKeeperWithMultipleClientPorts Major .
HBASE-21993 Set version as 2.2.0 in branch-2.2 in prep for first RC Major .
HBASE-21997 Fix hbase-rest findbugs ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD complaint Major REST
HBASE-21986 Generate CHANGES.md and RELEASENOTES.md for 2.2.0 Major .
HBASE-21972 Copy master doc into branch-2.2 and edit to make it suit 2.2.0 Major .
HBASE-15728 Add remaining per-table region / store / flush / compaction related metrics Major metrics
HBASE-21934 RemoteProcedureDispatcher should track the ongoing dispatched calls Blocker proc-v2
HBASE-21588 Procedure v2 wal splitting implementation Major .
HBASE-21729 Extract ProcedureCoordinatorRpcs and ProcedureMemberRpcs from CoordinatedStateManager Major .
HBASE-21094 Remove the explicit timeout config for TestTruncateTableProcedure Major test
HBASE-21093 Move TestCreateTableProcedure.testMRegions to a separated file Major test
HBASE-18201 add UT and docs for DataBlockEncodingTool Minor tooling
HBASE-21978 Should close AsyncRegistry if we fail to get cluster id when creating AsyncConnection Major asyncclient, Client
HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission Major .
HBASE-21976 Deal with RetryImmediatelyException for batching request Major asyncclient, Client
HBASE-21820 Implement CLUSTER quota scope Major .
HBASE-21962 Filters do not work in ThriftTable Major Thrift
HBASE-21927 Always fail the locate request when error occur Major asyncclient, Client
HBASE-21944 Validate put for batch operation Major asyncclient, Client
HBASE-21945 Maintain the original order when sending batch request Major asyncclient, Client
HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota Major .
HBASE-21930 Deal with ScannerResetException when opening region scanner Major asyncclient, Client
HBASE-21907 Should set priority for rpc request Major asyncclient, Client
HBASE-21909 Validate the put instance before executing in AsyncTable.put method Major asyncclient, Client
HBASE-21814 Remove the TODO in AccessControlLists#addUserPermission Major .
HBASE-19889 Revert Workaround: Purge User API building from branch-2 so can make a beta-1 Major website
HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine Major Replication, wal
HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly Major asyncclient, Client
HBASE-21828 Make sure we do not return CompletionException when locating region Major asyncclient, Client
HBASE-21764 Size of in-memory compaction thread pool should be configurable Major Compaction, in-memory-compaction
HBASE-21809 Add retry thrift client for ThriftTable/Admin Major .
HBASE-21739 Move grant/revoke from regionserver to master Major .
HBASE-21798 Cut branch-2.2 Major .
HBASE-20542 Better heap utilization for IMC with MSLABs Major in-memory-compaction
HBASE-21713 Support set region server throttle quota Major .
HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator Major asyncclient, Client
HBASE-17370 Fix or provide shell scripts to drain and decommission region server Major .
HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized Major .
HBASE-21734 Some optimization in FilterListWithOR Major .
HBASE-21738 Remove all the CSLM#size operation in our memstore because it's an quite time consuming. Critical Performance
HBASE-21034 Add new throttle type: read/write capacity unit Major .
HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator Major asyncclient, Client
HBASE-19695 Handle disabled table for async client Major asyncclient, Client
HBASE-21711 Remove references to git.apache.org/hbase.git Critical .
HBASE-21647 Add status track for splitting WAL tasks Major Operability
HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin Major Admin, asyncclient, Client
HBASE-21663 Add replica scan support Major asyncclient, Client, read replicas
HBASE-21580 Support getting Hbck instance from AsyncConnection Major asyncclient, Client, hbck2
HBASE-21652 Refactor ThriftServer making thrift2 server inherited from thrift1 server Major .
HBASE-21661 Provide Thrift2 implementation of Table/Admin Major .
HBASE-21682 Support getting from specific replica Major read replicas
HBASE-21159 Add shell command to switch throttle on or off Major .
HBASE-21362 Disable printing of stack-trace in shell when quotas are violated Minor shell
HBASE-21361 Disable printing of stack-trace in shell when quotas are not enabled Minor shell
HBASE-17356 Add replica get support Major Client
HBASE-21650 Add DDL operation and some other miscellaneous to thrift2 Major Thrift
HBASE-21401 Sanity check when constructing the KeyValue Critical regionserver
HBASE-21578 Fix wrong throttling exception for capacity unit Major .
HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator Major asyncclient, Client
HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors Major amv2
HBASE-21508 Ignore the reportRegionStateTransition call from a dead server Major amv2
HBASE-21490 WALProcedure may remove proc wal files still with active procedures Major proc-v2
HBASE-21377 Add debug log for procedure stack id related operations Major proc-v2
HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase Major amv2
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags Major .
HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP Critical amv2
HBASE-21376 Add some verbose log to MasterProcedureScheduler Major logging, proc-v2
HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors Major hbase-connectors, spark
HBASE-21421 Do not kill RS if reportOnlineRegions fails Major .
HBASE-21314 The implementation of BitSetNode is not efficient Major proc-v2
HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back Critical proc-v2
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared). Major amv2
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService Critical hbck2
HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler Major proc-v2
HBASE-20973 ArrayIndexOutOfBoundsException when rolling back procedure Critical amv2
HBASE-21384 Procedure with holdlock=false should not be restored lock when restarts Blocker .
HBASE-21364 Procedure holds the lock should put to front of the queue after restart Blocker .
HBASE-21215 Figure how to invoke hbck2; make it easy to find Major amv2, hbck2
HBASE-21372 Set hbase.assignment.maximum.attempts to Long.MAX Major amv2
HBASE-21363 Rewrite the buildingHoldCleanupTracker method in WALProcedureStore Major proc-v2
HBASE-21338 [balancer] If balancer is an ill-fit for cluster size, it gives little indication Major Balancer, Operability
HBASE-21192 Add HOW-TO repair damaged AMv2. Major amv2
HBASE-21073 "Maintenance mode" master Major amv2, hbck2, master
HBASE-21354 Procedure may be deleted improperly during master restarts resulting in 'Corrupt' Major .
HBASE-21336 Simplify the implementation of WALProcedureMap Major proc-v2
HBASE-21323 Should not skip force updating for a sub procedure even if it has been finished Major proc-v2
HBASE-21269 Forward-port to branch-2 " HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign" Major amv2
HBASE-20716 Unsafe access cleanup Critical Performance
HBASE-21330 ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same time Major amv2
HBASE-21310 Split TestCloneSnapshotFromClient Major test
HBASE-21311 Split TestRestoreSnapshotFromClient Major test
HBASE-21315 The getActiveMinProcId and getActiveMaxProcId of BitSetNode are incorrect if there are no active procedure Major .
HBASE-21278 Do not rollback successful sub procedures when rolling back a procedure Critical proc-v2
HBASE-21309 Increase the waiting timeout for TestProcedurePriority Major test
HBASE-21254 Need to find a way to limit the number of proc wal files Critical proc-v2
HBASE-21250 Refactor WALProcedureStore and add more comments for better understanding the implementation Major proc-v2
HBASE-19275 TestSnapshotFileCache never worked properly Major .
HBASE-21249 Add jitter for ProcedureUtil.getBackoffTimeMs Major proc-v2
HBASE-21244 Skip persistence when retrying for assignment related procedures Major amv2, Performance, proc-v2
HBASE-21233 Allow the procedure implementation to skip persistence of the state after a execution Major Performance, proc-v2
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217 Major amv2, regionserver
HBASE-21217 Revisit the executeProcedure method for open/close region Critical amv2, proc-v2
HBASE-21214 [hbck2] setTableState just sets hbase:meta state, not in-memory state Major amv2, hbck2
HBASE-21023 Add bypassProcedureToCompletion() API to HbckService Major hbck2
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign Critical hbck2
HBASE-21169 Initiate hbck2 tool in hbase-operator-tools repo Major hbck2
HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure Major amv2, proc-v2
HBASE-21189 flaky job should gather machine stats Minor test
HBASE-21190 Log files and count of entries in each as we load from the MasterProcWAL store Major amv2
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure Major amv2
HBASE-21017 Revisit the expected states for open/close Major amv2
HBASE-20941 Create and implement HbckService in master Major .
HBASE-21072 Block out HBCK1 in hbase2 Major hbck
HBASE-21095 The timeout retry logic for several procedures are broken after master restarts Critical amv2, proc-v2
HBASE-20975 Lock may not be taken or released while rolling back procedure Major amv2
HBASE-21025 Add cache for TableStateManager Major .
HBASE-21012 Revert the change of serializing TimeRangeTracker Critical .
HBASE-20813 Remove RPC quotas when the associated table/Namespace is dropped off Minor .
HBASE-20885 Remove entry for RPC quota from hbase:quota when RPC quota is removed. Minor .
HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing Major .
HBASE-20950 Helper method to configure secure DFS cluster for tests Major test
HBASE-19369 HBase Should use Builder Pattern to Create Log Files while using WAL on Erasure Coding Major .
HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException Critical amv2
HBASE-20921 Possible NPE in ReopenTableRegionsProcedure Major amv2
HBASE-20867 RS may get killed while master restarts Major .
HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing Critical amv2
HBASE-20846 Restore procedure locks when master restarts Major .
HBASE-20914 Trim Master memory usage Major Balancer, master
HBASE-20853 Polish "Add defaults to Table Interface so Implementors don't have to" Major API
HBASE-20875 MemStoreLABImp::copyIntoCell uses 7% CPU when writing Major Performance
HBASE-20860 Merged region's RIT state may not be cleaned after master restart Major .
HBASE-20847 The parent procedure of RegionTransitionProcedure may not have the table lock Major proc-v2, Region Assignment
HBASE-20776 Update branch-2 version to 2.2.0-SNAPSHOT Major build

OTHER:

JIRA Summary Priority Component
HBASE-21612 Add developer debug options in HBase Config for REST server Minor Operability, REST, scripts
HBASE-18735 Provide a fast mechanism for shutting down mini cluster Major .
HBASE-21489 TestShell is broken Major shell
HBASE-20152 [AMv2] DisableTableProcedure versus ServerCrashProcedure Major amv2
HBASE-20540 [umbrella] Hadoop 3 compatibility Major .
HBASE-21536 Fix completebulkload usage instructions Trivial documentation, mapreduce
HBASE-22449 https everywhere in Maven metadata Minor .
HBASE-22406 skip generating rdoc when building gems in our docker image for running yetus Critical build, test
HBASE-22375 Promote AccessChecker to LimitedPrivate(Coprocessor) Minor Coprocessors, security
HBASE-21714 Deprecated isTableAvailableWithSplit method in thrift module Major Thrift
HBASE-22359 Backport of HBASE-21371 misses activation-api license information Minor build, community
HBASE-22174 Remove error prone from our precommit javac check Major build
HBASE-22231 Remove unused and * imports Minor .
HBASE-22304 Fix remaining Checkstyle issues in hbase-endpoint Trivial .
HBASE-22020 upgrade to yetus 0.9.0 Major build, community
HBASE-22187 Remove usage of deprecated ClusterConnection.clearRegionCache Trivial Client
HBASE-22203 Reformat DemoClient.java Trivial .
HBASE-22189 Remove usage of StoreFile.getModificationTimeStamp Trivial .
HBASE-22108 Avoid passing null in Admin methods Major Admin
HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin Major Admin, asyncclient, Client
HBASE-22131 Delete the patches in hbase-protocol-shaded module Major build, Protobufs
HBASE-22099 Backport HBASE-21895 "Error prone upgrade" to branch-2 Major build
HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications Major .
HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin Major Admin
HBASE-22042 Missing @Override annotation for RawAsyncTableImpl.scan Major asyncclient, Client
HBASE-21057 upgrade to latest spotbugs Minor community, test
HBASE-21888 Add a isClosed method to AsyncConnection Major asyncclient, Client
HBASE-21884 Fix box/unbox findbugs warning in secure bulk load Minor .
HBASE-21859 Add clearRegionLocationCache method for AsyncConnection Major asyncclient, Client
HBASE-21853 update copyright notices to 2019 Major documentation
HBASE-21791 Upgrade thrift dependency to 0.12.0 Blocker Thrift
HBASE-21710 Add quota related methods to the Admin interface Major .
HBASE-21782 LoadIncrementalHFiles should not be IA.Public Major mapreduce
HBASE-21762 Move some methods in ClusterConnection to Connection Major Client
HBASE-21715 Do not throw UnsupportedOperationException in ProcedureFuture.get Major Client
HBASE-21716 Add toStringCustomizedValues to TableDescriptor Major .
HBASE-21731 Do not need to use ClusterConnection in IntegrationTestBigLinkedListWithVisibility Major .
HBASE-21685 Change repository urls to Gitbox Critical .
HBASE-21534 TestAssignmentManager is flakey Major test
HBASE-21541 Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup module Major .
HBASE-21265 Split up TestRSGroups Minor rsgroup, test
HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster Major test
HBASE-21281 Update bouncycastle dependency. Major dependencies, test
HBASE-21198 Exclude dependency on net.minidev:json-smart Major .
HBASE-21282 Upgrade to latest jetty 9.2 and 9.3 versions Major dependencies
HBASE-21287 JVMClusterUtil Master initialization wait time not configurable Major test
HBASE-21168 BloomFilterUtil uses hardcoded randomness Trivial .
HBASE-20482 Print a link to the ref guide chapter for the shell during startup Minor documentation, shell
HBASE-20942 Improve RpcServer TRACE logging Major Operability
HBASE-20989 Minor, miscellaneous logging fixes Trivial logging