Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

View data in a topic #1818

Open
ElenaAfina opened this issue Jan 13, 2025 · 1 comment
Open

View data in a topic #1818

ElenaAfina opened this issue Jan 13, 2025 · 1 comment
Labels
area/diagnostics area/ux Issues to improve UX. Mainly research follow-ups topics For issues about YDB Topics 🚀 type/feature New feature or request

Comments

@ElenaAfina
Copy link

ElenaAfina commented Jan 13, 2025

  1. Create new tab for topic - Data
  2. Tab Data displays topic data. It contains navigation panel(s) and topic's data.
  3. Navigation panel contains:
  • limit of record in tables with data (default - TBD)
  • filter for Partition ID
  • filter for timestamps (from..to..)
  • filter for offsets (from..to..)
  • filter for value (?) - search by substring in topic values
  1. Variant A: Every topic partition with data is shown separately, one by one.
    5.1. For every topic partitions these elements are shown:
  • Partition ID
  • Table with partition data
    5.2. Every table with partition data contains next columns:
  • Number (offset)
  • Timestamp
  • Value
    Table with page navigation for listing records.
  1. Variant B (preferable): All topic data are shown in one table.
    6.1. Table with topic data consists of next columns:
  • Partition ID
  • Offset
  • Timestamp create
  • Timestamp write
  • Metadata
  • Value
    User can view part of columns and change their order.
    6.2. By default all partitions are shown, data are sorted by partition, timestamp.
  1. Possible scenarios of using view data in a topic:
  • to see that topic has any data
  • to see data in a specific partition (filter by partition id)
  • to see all data which were written during certain period of time (filter by timestamp). Filter by timestamp can refer to one partition or to all partitions.
  • to navigate to the specific point (by timestamp, by offset). Filter by offset has no sense in case of all partitions (user wants to filter by offset only in specific partition)
  • to show data in a specific format (user says: json - show data with json markdown, user says: protobuf - ...) - there will be schema integrations in future realizations in this point
  • preview hole message in a separate window with formatting of json/protobuf/...
  • to download data of specific message
  • to see message size in case of long messages (always or on mouseover)
  1. More complicated scenarios:
  • to find specific value in a topic data
  1. Additional:
  • offset is unique within a partition
  • data in topic: text or binary, user can additionally chooses format: json/protobuf/...
@ElenaAfina
Copy link
Author

ElenaAfina commented Jan 15, 2025

References from other UIs
Image
Image

@ElenaAfina ElenaAfina added area/ux Issues to improve UX. Mainly research follow-ups area/diagnostics 🚀 type/feature New feature or request size/m topics For issues about YDB Topics and removed size/m labels Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/diagnostics area/ux Issues to improve UX. Mainly research follow-ups topics For issues about YDB Topics 🚀 type/feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant