Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions models/artifacts.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ title: Artifacts overview
---
import { ColabLink } from '/snippets/_includes/colab-link.mdx';
import { TryProductLink } from '/snippets/_includes/try-product-link.mdx';
import ArtifactRegistryUsageLimits from "/snippets/_includes/artifact-registry-usage-limits.mdx";

<CardGroup cols={4}>
<ColabLink url="https://colab.research.google.com/github/wandb/examples/blob/master/colabs/wandb-artifacts/Pipeline_Versioning_with_W&B_Artifacts.ipynb" />
Expand Down Expand Up @@ -80,6 +81,11 @@ datadir = artifact.download() # downloads the full `my_data` artifact to the de
You can pass a custom path into the `root` [parameter](/models/ref/python/experiments/artifact) to download an artifact to a specific directory. For alternate ways to download artifacts and to see additional parameters, see the guide on [downloading and using artifacts](/models/artifacts/download-and-use-an-artifact).
</Note>

## Usage limits

The following table lists usage limits for Artifacts and W&B Registry. These limits are shown together because Artifacts and Registry share related resources and workflows.

<ArtifactRegistryUsageLimits />

## Next steps
* Learn how to [version](/models/artifacts/create-a-new-artifact-version) and [update](/models/artifacts/update-an-artifact) artifacts.
Expand Down
7 changes: 7 additions & 0 deletions models/registry.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@ title: Registry overview
description: Use W&B Registry to manage and share artifact versions across your organization
---
import { ColabLink } from '/snippets/_includes/colab-link.mdx';
import ArtifactRegistryUsageLimits from "/snippets/_includes/artifact-registry-usage-limits.mdx";

<ColabLink url="https://colab.research.google.com/github/wandb/examples/blob/master/colabs/wandb_registry/zoo_wandb.ipynb" />

Expand Down Expand Up @@ -106,6 +107,12 @@ Based on your deployment type, satisfy the following conditions to enable W&B Re
| Self-Managed | For Server v0.71.0 or newer, no action required. Registry is enabled by default. For older supported Server versions, contact your W&B account team to enable Registry. |


## Usage limits

The following table lists usage limits for W&B Registry and Artifacts. These limits are shown together because Registry collections contain linked artifact versions and share related resources with Artifacts.

<ArtifactRegistryUsageLimits />

## Resources to get started

Depending on your use case, explore the following resources to get started with the W&B Registry:
Expand Down
12 changes: 12 additions & 0 deletions snippets/_includes/artifact-registry-usage-limits.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
| Dimension | Scope | Counting | Free | Pro | Enterprise |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these limits most likely will no affect on prem, not sure if we need to call that out or not

| --- | --- | --- | --- | --- | --- |
| Registries| Organization | Registry projects in the organization | 5 | 25 | 250|
| Artifacts | Organization | Committed artifact versions across the whole organization | 100,000 | 5,000,000 | 100,000,000 |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Committed is an internal detail, here you can probably say Artifact versions across the whole org

| Unique tags | Organization | Distinct tag definitions in the org | 1,000 | 1,000 | 10,000 |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| Unique tags | Organization | Distinct tag definitions in the org | 1,000 | 1,000 | 10,000 |
| Unique tags | Organization | Distinct tag definitions in the organization | 1,000 | 1,000 | 10,000 |

| Collections | Per Registry | Portfolios inside one registry | 50 | 250 | 5,000 |
| Linked versions per Registry Collection | Per Registry Collection | Distinct linked artifact versions in one registry collection | 500 | 1,000 | 2,500 |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| Linked versions per Registry Collection | Per Registry Collection | Distinct linked artifact versions in one registry collection | 500 | 1,000 | 2,500 |
| Linked versions | Per Registry Collection | Distinct linked artifact versions in one registry collection | 500 | 1,000 | 2,500 |

| Versions per artifact sequence | Per artifact sequence | Committed versions in one branch (sequence) | 1,000 | 10,000 | 50,000 |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| Versions per artifact sequence | Per artifact sequence | Committed versions in one branch (sequence) | 1,000 | 10,000 | 50,000 |
| Artifact Versions | Per project collection | Versions in one project collection | 1,000 | 10,000 | 50,000 |


An artifact *sequence* is a specific, versioned artifact in a project. For example, if you log an artifact named `model`, W&B creates a sequence called `model`. Each time you log a new version of that artifact, W&B creates a new version in the sequence: `model:v0`, `model:v1`, and `model:v2`.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general, "Sequence" and "Portofolio" are internal terminology we use to distinguish project collections vs registry collections. With that, I would just maybe rename this to "Versions per project collection" and keep "Linked versions per registry collection"?

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, here, a sequence isn't exactly a specific, versioned artifact. It is a collection of artifacts which is ordered / versioned


Contact [W&B Support](mailto:support@wandb.com) if you have questions about limits.
2 changes: 1 addition & 1 deletion support.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ and the W&B community.
<CardGroup cols={3}>
<Card title="W&B Models" href="/support/models" arrow="true" icon="/icons/cropped-models.svg">
{/* AUTO-GENERATED: counts */}
214 articles &middot; 41 tags
215 articles &middot; 41 tags
{/* END AUTO-GENERATED: counts */}
</Card>
<Card title="W&B Weave" href="/support/weave" arrow="true" icon="/icons/cropped-weave.svg">
Expand Down
4 changes: 2 additions & 2 deletions support/models.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ template: "docengine-site/templates/support_product_index.mdx.j2"
2 articles
</Card>
<Card title="Artifacts" href="/support/models/tags/artifacts" arrow="true">
16 articles
17 articles
</Card>
<Card title="Authentication" href="/support/models/tags/authentication" arrow="true">
1 article
Expand All @@ -68,7 +68,7 @@ template: "docengine-site/templates/support_product_index.mdx.j2"
14 articles
</Card>
<Card title="Experiments" href="/support/models/tags/experiments" arrow="true">
51 articles
52 articles
</Card>
<Card title="Hyperparameter" href="/support/models/tags/hyperparameter" arrow="true">
3 articles
Expand Down
19 changes: 19 additions & 0 deletions support/models/articles/what-are-artifact-registry-limits.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
---
title: "Are there W&B Registry and Artifacts usage limits?"
keywords: ["Artifacts", "Experiments"]
docengineDescription: "W&B applies the following usage limits to Artifacts and Registry features..."
featured: false
---

import ArtifactRegistryUsageLimits from "/snippets/_includes/artifact-registry-usage-limits.mdx";

W&B applies the following usage limits to Artifacts and Registry features:

<ArtifactRegistryUsageLimits />

---

{/* AUTO-GENERATED: tab badges */}
<Badge stroke shape="pill" color="orange" size="md">[Artifacts](/support/models/tags/artifacts)</Badge><Badge stroke shape="pill" color="orange" size="md">[Experiments](/support/models/tags/experiments)</Badge>
{/* END AUTO-GENERATED: tab badges */}

5 changes: 4 additions & 1 deletion support/models/tags/artifacts.mdx
Original file line number Diff line number Diff line change
@@ -1,10 +1,13 @@
---
title: "Artifacts"
tag: "16"
tag: "17"
generator: "knowledgebase-nav"
template: "docengine-site/templates/support_tag.mdx.j2"
---

<Card title="Are there W&B Registry and Artifacts usage limits?" href="/support/models/articles/what-are-artifact-registry-limits" arrow="true" horizontal>
W&B applies the following usage limits to Artifacts and Registry features...
</Card>
<Card title="How can I fetch these Version IDs and ETags in W&B?" href="/support/models/articles/how-can-i-fetch-these-version-ids-and-et" arrow="true" horizontal>
If you log an artifact reference with W&B and enable versioning on the buckets, the version IDs appear in the Amazon S3 ...
</Card>
Expand Down
5 changes: 4 additions & 1 deletion support/models/tags/experiments.mdx
Original file line number Diff line number Diff line change
@@ -1,10 +1,13 @@
---
title: "Experiments"
tag: "51"
tag: "52"
generator: "knowledgebase-nav"
template: "docengine-site/templates/support_tag.mdx.j2"
---

<Card title="Are there W&B Registry and Artifacts usage limits?" href="/support/models/articles/what-are-artifact-registry-limits" arrow="true" horizontal>
W&B applies the following usage limits to Artifacts and Registry features...
</Card>
<Card title="Does W&B use the `multiprocessing` library?" href="/support/models/articles/does-wb-use-the-multiprocessing-library" arrow="true" horizontal>
Yes, W&B uses the multiprocessing library. As a result, scripts that call W&B directly need to guard their entry point s ...
</Card>
Expand Down
Loading