ursadb v1.5.2

Almost exclusively performance improvements. Query speed is reduced by over 50% in tested workloads.

Features:

• Add a verbose mode (-v) that also prints debug logs (#218)

Performance:

• Refactor (#218)
• Add debug logs, including query plans (#218)
• opt1: Flatten trivial operations (#220)
• opt2: Inline suboperations (#221)
• opt3: Deduplicate primitives (#222)
• opt4: Simplify minof in some cases (#223)
• opt5: Propagate degenerate queries (#224)
• opt6: Reorder subqueries more optimally (#225)
• opt7: Prefetch disk reads (#226)
• opt8: Keep runs in compressed form for longer (#227)

Correctness:

Refactoring and maintenance:

• Create a simple framework for query optimizations (#217)

ursadb v1.5.1

Mostly bugfix and maintenance release:

Features:

• Implement GC for iterators - remove stale iterators (#208)

Performance:

• Move away from query graphs to query plans (#191)
• And improve their performance (#194)

Correctness:

• Fix Undefined Behaviour when getting a memory map size (#188)
• Add support for 2gb+ iterators (fix signed i32 overflow) (#202)

Refactoring and maintenance:

• Bump catch v2.2.2 -> v2.13.10 (#192)
• Disable clang-tidy, which has become very noisy (#193)
• Add performabce counters for unique ngram reads (#199)
• Remove dead code accrued over the years (#200)

ursadb v1.5.0

Features:

• Alternatives (like {(41 | 42)}) implemented in the ursadb query syntax (#65)
• Better support for wildcards (#23)
• Syntax for indexing with taints (#31)

Performance:

• Query graph pruning (#67)

Correctness:

• Some improvements for thread safety (#32)

Refactoring and maintenance:

• Ursacli rewritten to C++ (#48)
• Documentation improvements (#33)

ursadb v1.4.1

Release refs/tags/v1.4.1

ursadb v1.4.0

Release refs/tags/v1.4.0

ursadb v1.3.2

Bugfixes

• Improved stability of ursacli.

New features

Native client

In ursacli console client:

• Introduced -c (command), -q (non-interactive mode) and -j (always output raw JSON) command line switches.
• Better result printing for select query results.

ursadb v1.3.1

New features

Native client

Built-in command line client ursacli.

• Interactive mode/single command mode
• Task progress is reported every second
• Very basic output processing

ursadb v1.3.0

New features

Taints

Dataset tainting. Datasets with incompatible taints will never get merged.

• New command: dataset "xxx" taint "yyy" - adds taint yyy to xxx.
• New command: dataset "xxx" untaint "yyy" - removes taint yyy from xxx.
• New construct: select with taints ["xxx"] "stuff" - select that only
  looks in datasets with specified tags.

Iterators

Huge memory saver for large results. Store query results on disk, instead
of dumping them with json to the client.

• New command select into iterator "stuff" - select that returns iterator.
• New command iterator "itername" pop 123 - pops element from the specified
  iterator.

Performance

• Enable IPO for release builds.

Internals

• New lock modes - new coordinator command to lock iterator.
• Rewrite logging to spdlog, instead of using std::cout like savages.

Code quality, tests and CI

• New target format added to CMakeLists. make format will reformat the
  whole code. We also reformatted our code to match new style.
• DatabaseName introduced, code expected to be slowly rewritten to use it.
• We now run clang-format after every commit in our CI pipeline.
• Run make build and unit tests after every build in the CI.
• Build the docker image automatically in our CI pipeline.
• Create a automatic pipeline for building deb packages.
• Refactor cmake lists, and revamp the project sructure.
• Use std::thread instead of raw pthread in the network service code.

ursadb v1.2.0

v1.2.0

ursadb v1.0

v1.0