Skip to content

Commit

Permalink
docs: bucket as a reference (minor)
Browse files Browse the repository at this point in the history
Signed-off-by: Alex Aizman <[email protected]>
  • Loading branch information
alex-aizman committed Dec 4, 2023
1 parent 3474341 commit a1f5b5d
Showing 1 changed file with 22 additions and 0 deletions.
22 changes: 22 additions & 0 deletions docs/bucket.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,7 @@ redirect_from:
- [Prefetch/Evict Objects](#prefetchevict-objects)
- [Evict Remote Bucket](#evict-remote-bucket)
- [Backend Bucket](#backend-bucket)
- [AIS bucket as a reference](#ais-bucket-as-a-reference)
- [Bucket Properties](#bucket-properties)
- [CLI examples: listing and setting bucket properties](#cli-examples-listing-and-setting-bucket-properties)
- [Bucket Access Attributes](#bucket-access-attributes)
Expand Down Expand Up @@ -533,6 +534,27 @@ shard-0.tar 2.50KiB 1

For more examples please refer to [CLI docs](/docs/cli/bucket.md#connectdisconnect-ais-bucket-tofrom-cloud-bucket).

## AIS bucket as a reference

Stated differently, aistore bucket itself can serve as a reference to another bucket. E.g., you could have, say, `ais://llm-latest` to always point to whatever is the latest result of a data prep service.

```console
### create an arbitrary bucket (say, `ais://llm-latest`) and always use it to reference the latest augmented results

$ ais create ais://llm-latest
$ ais bucket props set ais://llm-latest backend_bck=gs://llm-augmented-2023-12-04

### next day, when the data prep service produces a new derivative:

$ ais bucket props set ais://llm-latest backend_bck=gs://llm-augmented-2023-12-05

### and keep using the same static name, etc.
```

Caching wise, when you walk `ais://llm-latest` (or any other aistore bucket with a remote backend), aistore will make sure to perform remote (cold) GETs to update itself when and if required, etc.

> In re "cold GET" vs "warm GET" performance, see [AIStore as a Fast Tier Storage](https://aiatscale.org/blog/2023/11/27/aistore-fast-tier) blog.
# Bucket Properties

The full list of bucket properties are:
Expand Down

0 comments on commit a1f5b5d

Please sign in to comment.