Skip to content

hbase datasource #261

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
elliVM wants to merge 7 commits into
base: main
Choose a base branch
from
Draft

hbase datasource #261

elliVM wants to merge 7 commits into from

Conversation

@elliVM
Copy link
Contributor

@elliVM elliVM commented Nov 27, 2025 •
edited
Loading

Description

Provides a HBase datasource option

Checklists

Testing

General

  • I have checked that my test files and functions have meaningful names.
  • I have checked that each test tests only a single behavior.
  • I have done happy tests.
  • I have tested only my own code.
  • I have tested at least all public methods.

Assertions

  • I have checked that my tests use assertions and not runtime overhead.
  • I have checked that my tests end in assertions.
  • I have checked that there is no comparison statements in assertions.
  • I have checked that assertions are in tests and not in helper functions.
  • I have checked that assertions for iterables are outside of for loops and both sides of the iteration blocks.
  • I have checked that assertions are not tested inside consumers.

Testing Data

  • I have tested algorithms and anything else with the possibility of unbound growth.
  • I have checked that all testing data is local and fully replaceable or reproducible or both.
  • I have checked that all test files are standalone.
  • I have checked that all test-specific fake objects and classes are in the test directory.
  • I have checked that my tests do not contain anything related to customers, infrastructure or users.
  • I have checked that my tests do not contain non-generic information.
  • I have checked that my tests do not do external requests and are not privately or publicly routable.

Statements

  • I have checked that my tests do not use throws for exceptions.
  • I have checked that my tests do not use try-catch statements.
  • I have checked that my tests do not use if-else statements.

Java

  • I have checked that my tests for Java uses JUnit library.
  • I have checked that my tests for Java uses JUnit utilities for parameters.

Other

  • I have only tested public behavior and not private implementation details.
  • I have checked that my tests are not (partially) commented out.
  • I have checked that hand-crafted variables in assertions are used accordingly.
  • I have tested Object Equality.
  • I have checked that I do not have any manual tests or I have a valid reason for them and I have explained it in the PR description.

Code Quality

  • I have checked that my code follows metrics set in Procedure: Class Metrics.
  • I have checked that my code follows metrics set in Procedure: Method Metrics.
  • I have checked that my code follows metrics set in Procedure: Object Quality.
  • I have checked that my code does not have any NULL values.
  • I have checked my code does not contain FIXME or TODO comments.

@elliVM elliVM self-assigned this Nov 27, 2025
@elliVM elliVM added the feature Existing feature label Nov 27, 2025
@elliVM
Squashed commit of the following:
03692ea 
commit 345b7dd
Author: elliVM <47@teragrep.com>
Date:   Thu Nov 27 14:43:30 2025 +0200

    rename Expression and ValueExpression interface methods to be more descriptive

commit 02c8a4b
Author: elliVM <47@teragrep.com>
Date:   Thu Nov 27 14:38:12 2025 +0200

    refactor AST interfaces, remove XMLValueExpression and replace with named objects for each value expression type, code cleanup and added equals + hashcode methods

commit e297cdc
Author: elliVM <47@teragrep.com>
Date:   Wed Nov 19 10:55:41 2025 +0200

    flatten if-else logic for ArchiveMicroStreamReader and Batch

commit 0568642
Author: elliVM <47@teragrep.com>
Date:   Thu Nov 13 11:43:56 2025 +0200

    fix missing operations GE, LE for time qualifiers. Cleanup and improved testing

commit 0cbc7f5
Author: elliVM <47@teragrep.com>
Date:   Tue Nov 11 08:59:43 2025 +0200

    hbase-client to provided, remove unused hadoop-client-api and make hadoop-client-runtime test scope

commit d132e8b
Author: elliVM <47@teragrep.com>
Date:   Mon Nov 10 10:45:01 2025 +0200

    shade all required hbase and hadoop artifacts and relocate them under namespace

commit dd746db
Author: elliVM <47@teragrep.com>
Date:   Mon Nov 10 08:33:21 2025 +0200

    publish a shaded artifact to GitHub Packages, relocate hbase and hadoop dependencies to avoid conflicts

commit 56a90ec
Author: elliVM <47@teragrep.com>
Date:   Thu Nov 6 10:01:16 2025 +0200

    use hbase 2.6.0-hadoop3

commit 26cb779
Author: elliVM <47@teragrep.com>
Date:   Tue Nov 4 12:46:49 2025 +0200

    fix latest test in HBaseQueryImplTest

commit 28a89c9
Author: elliVM <47@teragrep.com>
Date:   Tue Nov 4 12:14:57 2025 +0200

    move HourlySlicesFake into test folder from interface

commit 0cdb5c4
Author: elliVM <47@teragrep.com>
Date:   Tue Nov 4 12:02:09 2025 +0200

    apply spotless

commit 38fcf4d
Author: elliVM <47@teragrep.com>
Date:   Tue Nov 4 11:59:43 2025 +0200

    update most recent batch and fix correct start offset for last batch

commit 1de35d3
Author: elliVM <47@teragrep.com>
Date:   Tue Nov 4 05:05:39 2025 +0200

    add custom metrics support, add LimitedResults to hold a batch results from hbase

commit 910cb7c
Author: elliVM <47@teragrep.com>
Date:   Tue Nov 4 02:37:29 2025 +0200

    make hbase-client provided

commit 1a55ca4
Author: elliVM <47@teragrep.com>
Date:   Mon Oct 27 09:02:11 2025 +0200

    merge release-github-packages for QA packaging

commit 0402123
Author: elliVM <47@teragrep.com>
Date:   Thu Oct 23 11:41:28 2025 +0300

    fix HBaseQueryImpl query increment logic by moving incrementation to latest() call, renaming and cleanup

commit e4f9bf2
Author: elliVM <47@teragrep.com>
Date:   Tue Oct 21 08:12:39 2025 +0300

    refactoring of the HBaseQueryImpl to also manage the results

commit 1253e06
Author: elliVM <47@teragrep.com>
Date:   Thu Oct 16 14:44:07 2025 +0300

    make h2 database url have uuid for separate connections per test

commit e5f458f
Author: elliVM <47@teragrep.com>
Date:   Thu Oct 16 12:59:51 2025 +0300

    fix tests database memory not resetting

commit 918b878
Author: elliVM <47@teragrep.com>
Date:   Thu Oct 16 11:42:13 2025 +0300

    better handling of hbase connection creation and sharing between objects, add tests for factory objects, cleanup and better naming

commit 71c0351
Author: elliVM <47@teragrep.com>
Date:   Tue Oct 14 15:20:06 2025 +0300

    separate much of the analyzing logic into own objects, better naming for interfaces and objects

commit 71c14da
Author: elliVM <47@teragrep.com>
Date:   Tue Oct 14 10:03:52 2025 +0300

    add missing interfaces, fix hbase offset logic, code cleanup

commit 4e4d35a
Author: elliVM <47@teragrep.com>
Date:   Fri Oct 10 10:21:53 2025 +0300

    make Expression enum explicitly static

commit b527ef2
Author: elliVM <47@teragrep.com>
Date:   Fri Oct 10 10:19:03 2025 +0300

    doxygen test

commit a281f46
Author: elliVM <47@teragrep.com>
Date:   Fri Oct 10 10:05:15 2025 +0300

    add batch size limit support

commit afe56fc
Author: elliVM <47@teragrep.com>
Date:   Wed Oct 8 15:17:27 2025 +0300

    cleanup of code quality

commit 88c8eb9
Author: elliVM <47@teragrep.com>
Date:   Wed Oct 8 13:59:12 2025 +0300

    Squashed commit of the following:

    commit cf56cb7
    Author: elliVM <47@teragrep.com>
    Date:   Wed Oct 8 13:25:03 2025 +0300

        remove unused objects and update latest in HBaseQuery after batch slice has processed offsets

    commit 774f9d2
    Author: elliVM <47@teragrep.com>
    Date:   Wed Oct 8 10:51:32 2025 +0300

        HBase results logic moved to Batch instead of replacing ArchiveQuery interface.

    commit 198451f
    Author: elliVM <47@teragrep.com>
    Date:   Wed Sep 24 11:28:31 2025 +0300

        wip

    commit cbf5016
    Author: elliVM <47@teragrep.com>
    Date:   Tue Sep 23 03:05:14 2025 +0300

        add testing and instantation testing and factory pattern for queries

    commit 6087051
    Author: elliVM <47@teragrep.com>
    Date:   Mon Sep 1 10:38:29 2025 +0300

        work on HBaseArchiveQuery and new objects related to the integration with archive query interface

    commit 93b1314
    Author: elliVM <47@teragrep.com>
    Date:   Wed Aug 27 12:08:34 2025 +0300

        Star work on Hbase support for ArchiveQuery interface

    commit 977f161
    Author: elliVM <47@teragrep.com>
    Date:   Mon Aug 4 11:01:52 2025 +0300

        SQL metadata to build rowkey values

    commit 3250adb
    Author: elliVM <47@teragrep.com>
    Date:   Mon Jun 16 12:06:54 2025 +0300

        implement basic logical AST and XML parsing, some logical optimizations

    # Conflicts:
    #	src/main/java/com/teragrep/pth_06/planner/ArchiveQuery.java
    #	src/main/java/com/teragrep/pth_06/planner/ArchiveQueryProcessor.java
    #	src/test/java/com/teragrep/pth_06/MockTeragrepDatasource.java

# Conflicts:
#	src/main/java/com/teragrep/pth_06/ArchiveMicroStreamReader.java
@elliVM
apply spotless
d2d6035
@elliVM
fix missing abstract declaration in ScanGroupExpression
65638a2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@elliVM elliVM

Labels

feature Existing feature

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@elliVM