Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
63e4289
Object storage: identity cache + GetObjectAttributes to avoid per-fil…
UnamedRus Aug 8, 2026
ef65f44
Object storage: own the identity cache from Context
ianton-ru Nov 16, 2026
f01689c
Update 01271_show_privileges reference for SYSTEM DROP OBJECT STORAGE…
UnamedRus Aug 9, 2026
c653bcc
Object storage: default to HEAD for identity metadata, gate GetObject…
UnamedRus Aug 13, 2026
3119a15
Object storage: initialize ObjectMetadata::part_offsets to fix build
ianton-ru Nov 16, 2026
56df2a6
Object storage: test identity cache and honor the fetch-part-offsets …
ianton-ru Nov 17, 2026
b9229c4
Object storage: key the identity cache by endpoint and region
ianton-ru Nov 17, 2026
17e10c3
Object storage: drop replaced object identity from the identity cache
ianton-ru Nov 17, 2026
5c9cd7f
Object storage: store the quoted ETag from GetObjectAttributes
ianton-ru Nov 17, 2026
91e2cf3
Object storage: create the identity cache on config reload
ianton-ru Nov 17, 2026
8421641
Object storage: simplify the identity cache
ianton-ru Nov 17, 2026
25026d6
Object storage: keep a stale identity out of the cache after an overw…
ianton-ru Nov 17, 2026
5c9ae99
Object storage: keep a fetch from storing after the identity cache is…
ianton-ru Nov 17, 2026
7099ed7
Object storage: cap the identity cache generation map
ianton-ru Nov 17, 2026
a1580ca
Object storage: simplify the identity cache generation to one epoch
ianton-ru Nov 17, 2026
46e8d1c
Object storage: drop a replaced object's identity from the identity c…
ianton-ru Nov 17, 2026
87e0944
Object storage: keep the url() shard index when fetching object metadata
ianton-ru Nov 17, 2026
e1cf3b4
Object storage: return Last-Modified from the identity cache
ianton-ru Nov 17, 2026
4309cb8
Object storage: keep a cached Last-Modified out of schema and count f…
ianton-ru Nov 17, 2026
a5016ad
Object storage: revalidate the identity before a filesystem-cache hit
ianton-ru Nov 17, 2026
d6e0058
Object storage: do not cache "time unknown" from GetObjectAttributes
ianton-ru Nov 17, 2026
24f0663
Object storage: revalidate a filesystem-cache hit with HEAD, not GetO…
ianton-ru Nov 17, 2026
5d910de
Object storage: HEAD before a Parquet footer-only count uses an ident…
ianton-ru Nov 17, 2026
62901c4
Object storage: identity cache stores only HEAD results
ianton-ru Nov 17, 2026
1cda589
Object storage: re-HEAD an identity-cache hit before a skip decision
ianton-ru Nov 17, 2026
e05a9bc
Object storage: re-HEAD before skipping an empty condition-cache repl…
ianton-ru Nov 17, 2026
9253933
Merge remote-tracking branch 'altinity/antalya-26.8' into feature/ant…
ianton-ru Nov 17, 2026
d208648
Object storage: rename the private S3 metadata overload to fix overlo…
ianton-ru Nov 17, 2026
be68b12
Object storage: pin populate-on-miss in the identity cache filesystem…
ianton-ru Nov 17, 2026
0ffd9d6
Merge branch 'antalya-26.8' into feature/antalya-26.8/object-storage-…
ianton-ru Nov 17, 2026
96dba9e
Object storage: clear the identity cache in tests that rewrite object…
ianton-ru Nov 18, 2026
9f77d4e
Key the object storage identity cache by credentials
ianton-ru Nov 18, 2026
0c385e1
Object storage: do not use a cached identity for reads without ETag v…
ianton-ru Nov 19, 2026
2608efa
Object storage: drop the identity cache entry for backup writes and d…
ianton-ru Nov 19, 2026
2d50588
Object storage: drop the identity cache entry when an upload fails af…
ianton-ru Nov 19, 2026
e1b1580
Object storage: drop the identity cache entry when a copy fails after…
ianton-ru Nov 19, 2026
1263d35
Object storage queue: drop the identity cache entry for a cross-bucke…
ianton-ru Nov 19, 2026
2add0ef
Object storage: share one helper for dropping the identity cache entry
ianton-ru Nov 19, 2026
9990639
Object storage: declare s3_validate_etag_on_read in S3ObjectStorage
ianton-ru Nov 19, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions docs/reference/statements/system.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -134,6 +134,10 @@ Clears the per-URL Confluent Schema Registry caches used by the `AvroConfluent`

Clears the parquet metadata cache.

## SYSTEM CLEAR|DROP OBJECT STORAGE IDENTITY CACHE {#drop-object-storage-identity-cache}

Clears the object-storage identity cache, which stores per-object size, ETag and Last-Modified so that opening an object does not repeat a `HEAD` request. Its size is configured with the server settings `object_storage_identity_cache_size`, `object_storage_identity_cache_policy` and `object_storage_identity_cache_size_ratio`. Set `object_storage_identity_cache_size` to `0` to disable the cache. `SYSTEM RELOAD CONFIG` with a non-zero size creates it when startup left it disabled. A write, copy, or delete by this server drops that object's entry, and the next read requests the metadata again.

## SYSTEM CLEAR|DROP PAIMON METADATA CACHE {#drop-paimon-metadata-cache}

Clears the in-memory cache of parsed Paimon metadata files (manifest lists and manifests).
Expand Down
14 changes: 14 additions & 0 deletions programs/local/LocalServer.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -169,6 +169,9 @@ namespace ServerSetting
extern const ServerSettingsString mark_cache_policy;
extern const ServerSettingsUInt64 mark_cache_size;
extern const ServerSettingsDouble mark_cache_size_ratio;
extern const ServerSettingsString object_storage_identity_cache_policy;
extern const ServerSettingsUInt64 object_storage_identity_cache_size;
extern const ServerSettingsDouble object_storage_identity_cache_size_ratio;
extern const ServerSettingsString unique_key_bitmap_cache_policy;
extern const ServerSettingsUInt64 unique_key_bitmap_cache_size_bytes;
extern const ServerSettingsDouble unique_key_bitmap_cache_size_ratio;
Expand Down Expand Up @@ -1529,6 +1532,17 @@ void LocalServer::processConfig()
}
global_context->setMarkCache(mark_cache_policy, mark_cache_size, mark_cache_size_ratio);

String object_storage_identity_cache_policy = server_settings[ServerSetting::object_storage_identity_cache_policy];
size_t object_storage_identity_cache_size = server_settings[ServerSetting::object_storage_identity_cache_size];
double object_storage_identity_cache_size_ratio = server_settings[ServerSetting::object_storage_identity_cache_size_ratio];
if (object_storage_identity_cache_size > max_cache_size)
{
object_storage_identity_cache_size = max_cache_size;
LOG_INFO(log, "Lowered object storage identity cache size to {} because the system has limited RAM", formatReadableSizeWithBinarySuffix(object_storage_identity_cache_size));
}
global_context->setObjectStorageIdentityCache(
object_storage_identity_cache_policy, object_storage_identity_cache_size, object_storage_identity_cache_size_ratio);

/// UNIQUE KEY delete-bitmap cache. Zero size disables.
String unique_key_bitmap_cache_policy_name = server_settings[ServerSetting::unique_key_bitmap_cache_policy];
size_t unique_key_bitmap_cache_size = server_settings[ServerSetting::unique_key_bitmap_cache_size_bytes];
Expand Down
15 changes: 15 additions & 0 deletions programs/server/Server.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -320,6 +320,9 @@ namespace ServerSetting
extern const ServerSettingsString mark_cache_policy;
extern const ServerSettingsUInt64 mark_cache_size;
extern const ServerSettingsDouble mark_cache_size_ratio;
extern const ServerSettingsString object_storage_identity_cache_policy;
extern const ServerSettingsUInt64 object_storage_identity_cache_size;
extern const ServerSettingsDouble object_storage_identity_cache_size_ratio;
extern const ServerSettingsString unique_key_index_cache_policy;
extern const ServerSettingsUInt64 unique_key_index_cache_size_bytes;
extern const ServerSettingsDouble unique_key_index_cache_size_ratio;
Expand Down Expand Up @@ -2475,6 +2478,17 @@ try
}
global_context->setMarkCache(mark_cache_policy, mark_cache_size, mark_cache_size_ratio);

String object_storage_identity_cache_policy = server_settings[ServerSetting::object_storage_identity_cache_policy];
size_t object_storage_identity_cache_size = server_settings[ServerSetting::object_storage_identity_cache_size];
double object_storage_identity_cache_size_ratio = server_settings[ServerSetting::object_storage_identity_cache_size_ratio];
if (object_storage_identity_cache_size > max_cache_size)
{
object_storage_identity_cache_size = max_cache_size;
LOG_INFO(log, "Lowered object storage identity cache size to {} because the system has limited RAM", formatReadableSizeWithBinarySuffix(object_storage_identity_cache_size));
}
global_context->setObjectStorageIdentityCache(
object_storage_identity_cache_policy, object_storage_identity_cache_size, object_storage_identity_cache_size_ratio);

String unique_key_index_cache_policy_name = server_settings[ServerSetting::unique_key_index_cache_policy];
size_t unique_key_index_cache_size = server_settings[ServerSetting::unique_key_index_cache_size_bytes];
double unique_key_index_cache_size_ratio = server_settings[ServerSetting::unique_key_index_cache_size_ratio];
Expand Down Expand Up @@ -3123,6 +3137,7 @@ try

global_context->updateUncompressedCacheConfiguration(config(), max_cache_size_in_bytes);
global_context->updateMarkCacheConfiguration(config(), max_cache_size_in_bytes);
global_context->updateObjectStorageIdentityCacheConfiguration(config(), max_cache_size_in_bytes);
global_context->updateUniqueKeyIndexCacheConfiguration(config(), max_cache_size_in_bytes);
global_context->updateDeleteBitmapCacheConfiguration(config(), max_cache_size_in_bytes);
global_context->updatePrimaryIndexCacheConfiguration(config(), max_cache_size_in_bytes);
Expand Down
1 change: 1 addition & 0 deletions src/Access/Common/AccessType.h
Original file line number Diff line number Diff line change
Expand Up @@ -332,6 +332,7 @@ enum class AccessType : uint16_t
M(SYSTEM_DROP_PAIMON_METADATA_CACHE, "SYSTEM CLEAR PAIMON_METADATA_CACHE, SYSTEM DROP PAIMON_METADATA_CACHE", GLOBAL, SYSTEM_DROP_CACHE) \
M(SYSTEM_DROP_AVRO_SCHEMA_CACHE, "SYSTEM CLEAR AVRO SCHEMA CACHE, SYSTEM DROP AVRO SCHEMA CACHE, DROP AVRO SCHEMA CACHE", GLOBAL, SYSTEM_DROP_CACHE) \
M(SYSTEM_DROP_PARQUET_METADATA_CACHE, "SYSTEM DROP PARQUET_METADATA_CACHE", GLOBAL, SYSTEM_DROP_CACHE) \
M(SYSTEM_DROP_OBJECT_STORAGE_IDENTITY_CACHE, "SYSTEM CLEAR OBJECT STORAGE IDENTITY CACHE, SYSTEM DROP OBJECT STORAGE IDENTITY CACHE", GLOBAL, SYSTEM_DROP_CACHE) \
M(SYSTEM_DROP_POINT_IN_POLYGON_CACHE, "SYSTEM CLEAR POINT IN POLYGON CACHE, SYSTEM DROP POINT IN POLYGON CACHE, DROP POINT IN POLYGON CACHE", GLOBAL, SYSTEM_DROP_CACHE) \
M(SYSTEM_DROP_PUFFIN_FILES_CACHE, "SYSTEM DROP PUFFIN_FILES_CACHE", GLOBAL, SYSTEM_DROP_CACHE) \
M(SYSTEM_PREWARM_PRIMARY_INDEX_CACHE, "SYSTEM PREWARM PRIMARY INDEX, PREWARM PRIMARY INDEX CACHE, PREWARM PRIMARY INDEX", GLOBAL, SYSTEM_DROP_CACHE) \
Expand Down
88 changes: 74 additions & 14 deletions src/Backups/BackupIO_S3.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@
#include <Disks/IDisk.h>
#include <Disks/DiskObjectStorage/MetadataStorages/ContentAddressed/ContentAddressedExchange.h>
#include <Disks/DiskObjectStorage/ObjectStorages/IObjectStorage.h>
#include <Disks/DiskObjectStorage/ObjectStorages/ObjectStorageIdentityCache.h>

#include <Poco/Util/AbstractConfiguration.h>

Expand Down Expand Up @@ -649,6 +650,15 @@ void BackupWriterS3::copyFileFromDisk(
const size_t source_size = ca_plan ? ca_plan->object.bytes_size
: (copy_encrypted ? src_disk->getEncryptedFileSize(src_path) : src_disk->getFileSize(src_path));
const bool whole_object = (src_offset == 0) && (length == source_size);
const String dest_key = fs::path(s3_uri.key) / path_in_backup;
/// Runs when the copy throws after `CopyObject`, `PutObject`, or `CompleteMultipartUpload`
/// was sent. The success path below invalidates only if the copy returns.
const String endpoint = s3_uri.endpoint;
const String bucket = s3_uri.bucket;
auto on_object_creation_failure = [endpoint, bucket, dest_key]()
{
invalidateObjectStorageIdentityCache(endpoint, bucket, dest_key);
};

if (whole_object)
{
Expand All @@ -660,12 +670,16 @@ void BackupWriterS3::copyFileFromDisk(
length,
/* dest_s3_client */ client,
/* dest_bucket */ s3_uri.bucket,
/* dest_key */ fs::path(s3_uri.key) / path_in_backup,
/* dest_key */ dest_key,
s3_settings.request_settings,
read_settings,
blob_storage_log,
runner,
create_read_buffer);
create_read_buffer,
/* object_metadata= */ std::nullopt,
ObjectStorageCopyMode::Default,
/* object_creation_client= */ nullptr,
on_object_creation_failure);
}
else
{
Expand All @@ -678,14 +692,18 @@ void BackupWriterS3::copyFileFromDisk(
/* src_object_size= */ source_size,
/* dest_s3_client */ client,
/* dest_bucket */ s3_uri.bucket,
/* dest_key */ fs::path(s3_uri.key) / path_in_backup,
/* dest_key */ dest_key,
s3_settings.request_settings,
read_settings,
blob_storage_log,
runner,
create_read_buffer);
create_read_buffer,
/* object_metadata= */ std::nullopt,
on_object_creation_failure);
}

/// The copy has replaced `dest_key`. A read that cached the previous ETag must not send it as `If-Match`.
invalidateObjectStorageIdentityCache(s3_uri.endpoint, s3_uri.bucket, dest_key);
return; /// copied!
}
}
Expand All @@ -699,14 +717,17 @@ void BackupWriterS3::copyFile(const String & destination, const String & source,
LOG_TRACE(log, "Copying file inside backup from {} to {}", source, destination);

const auto source_key = fs::path(s3_uri.key) / source;
const String dest_key = fs::path(s3_uri.key) / destination;
const String endpoint = s3_uri.endpoint;
const String bucket = s3_uri.bucket;
copyS3File(
client,
/* src_bucket */ s3_uri.bucket,
/* src_key= */ source_key,
size,
/* dest_s3_client= */ client,
/* dest_bucket= */ s3_uri.bucket,
/* dest_key= */ fs::path(s3_uri.key) / destination,
/* dest_key= */ dest_key,
s3_settings.request_settings,
read_settings,
blob_storage_log,
Expand All @@ -716,14 +737,31 @@ void BackupWriterS3::copyFile(const String & destination, const String & source,
LOG_TRACE(log, "Falling back to copy file inside backup from {} to {} through direct buffers", source, destination);
return std::make_unique<ReadBufferFromS3>(
client, s3_uri.bucket, source_key, s3_uri.version_id, s3_settings.request_settings, read_settings);
},
/* object_metadata= */ std::nullopt,
ObjectStorageCopyMode::Default,
/* object_creation_client= */ nullptr,
[endpoint, bucket, dest_key]()
{
invalidateObjectStorageIdentityCache(endpoint, bucket, dest_key);
});
invalidateObjectStorageIdentityCache(s3_uri.endpoint, s3_uri.bucket, dest_key);
}

void BackupWriterS3::copyDataToFile(const String & path_in_backup, const CreateReadBufferFunction & create_read_buffer, UInt64 start_pos, UInt64 length)
{
copyDataToS3File(create_read_buffer, start_pos, length, client, s3_uri.bucket, fs::path(s3_uri.key) / path_in_backup,
const String dest_key = fs::path(s3_uri.key) / path_in_backup;
const String endpoint = s3_uri.endpoint;
const String bucket = s3_uri.bucket;
copyDataToS3File(create_read_buffer, start_pos, length, client, s3_uri.bucket, dest_key,
s3_settings.request_settings, blob_storage_log,
threadPoolCallbackRunnerUnsafe<void>(getBackupsIOThreadPool().get(), ThreadName::S3_BACKUP_WRITER));
threadPoolCallbackRunnerUnsafe<void>(getBackupsIOThreadPool().get(), ThreadName::S3_BACKUP_WRITER),
/* object_metadata= */ std::nullopt,
[endpoint, bucket, dest_key]()
{
invalidateObjectStorageIdentityCache(endpoint, bucket, dest_key);
});
invalidateObjectStorageIdentityCache(s3_uri.endpoint, s3_uri.bucket, dest_key);
}

BackupWriterS3::~BackupWriterS3() = default;
Expand Down Expand Up @@ -752,38 +790,57 @@ std::unique_ptr<ReadBuffer> BackupWriterS3::readFile(const String & file_name, s

std::unique_ptr<WriteBuffer> BackupWriterS3::writeFile(const String & file_name)
{
/// Captured by value. The buffer can outlive this writer, and the cache itself is process-global.
const String endpoint = s3_uri.endpoint;
const String bucket = s3_uri.bucket;
const String object_key = fs::path(s3_uri.key) / file_name;
return std::make_unique<WriteBufferFromS3>(
client,
s3_uri.bucket,
fs::path(s3_uri.key) / file_name,
bucket,
object_key,
DBMS_DEFAULT_BUFFER_SIZE,
s3_settings.request_settings,
blob_storage_log,
std::nullopt,
threadPoolCallbackRunnerUnsafe<void>(getBackupsIOThreadPool().get(), ThreadName::S3_BACKUP_WRITER),
write_settings);
write_settings,
/* object_creation_client */ nullptr,
[endpoint, bucket, object_key]()
{
invalidateObjectStorageIdentityCache(endpoint, bucket, object_key);
});
}

std::unique_ptr<WriteBuffer> BackupWriterS3::writeFileIfNotExists(const String & file_name)
{
WriteSettings conditional_write_settings = write_settings;
conditional_write_settings.object_storage_write_if_none_match = "*";
const String endpoint = s3_uri.endpoint;
const String bucket = s3_uri.bucket;
const String object_key = fs::path(s3_uri.key) / file_name;
return std::make_unique<WriteBufferFromS3>(
client,
s3_uri.bucket,
fs::path(s3_uri.key) / file_name,
bucket,
object_key,
DBMS_DEFAULT_BUFFER_SIZE,
s3_settings.request_settings,
blob_storage_log,
std::nullopt,
threadPoolCallbackRunnerUnsafe<void>(getBackupsIOThreadPool().get(), ThreadName::S3_BACKUP_WRITER),
conditional_write_settings);
conditional_write_settings,
/* object_creation_client */ nullptr,
[endpoint, bucket, object_key]()
{
invalidateObjectStorageIdentityCache(endpoint, bucket, object_key);
});
}

void BackupWriterS3::removeFile(const String & file_name)
{
deleteFileFromS3(client, s3_uri.bucket, fs::path(s3_uri.key) / file_name, /* if_exists = */ true,
const String object_key = fs::path(s3_uri.key) / file_name;
deleteFileFromS3(client, s3_uri.bucket, object_key, /* if_exists = */ true,
blob_storage_log);
invalidateObjectStorageIdentityCache(s3_uri.endpoint, s3_uri.bucket, object_key);
}

void BackupWriterS3::removeFiles(const Strings & file_names)
Expand All @@ -798,6 +855,9 @@ void BackupWriterS3::removeFiles(const Strings & file_names)

deleteFilesFromS3(client, s3_uri.bucket, keys, /* if_exists = */ true,
s3_capabilities, batch_size, blob_storage_log);
/// A key that was deleted, or was already gone, must not keep its previous size and ETag.
for (const auto & key : keys)
invalidateObjectStorageIdentityCache(s3_uri.endpoint, s3_uri.bucket, key);
}

}
Expand Down
2 changes: 2 additions & 0 deletions src/Common/CurrentMetrics.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -386,6 +386,8 @@
M(PaimonMetadataFilesCacheFiles, "Number of cached files in the Paimon metadata cache") \
M(ParquetMetadataCacheBytes, "Size of the Parquet metadata cache in bytes") \
M(ParquetMetadataCacheFiles, "Number of cached files in the Parquet metadata cache") \
M(ObjectStorageIdentityCacheBytes, "Size of the object-storage identity cache in bytes") \
M(ObjectStorageIdentityCacheCells, "Number of entries in the object-storage identity cache") \
M(PuffinFilesCacheBytes, "Size of the Puffin files cache in bytes (deletion vectors plus memoized footers)") \
M(PuffinFilesCacheFiles, "Number of cached entries in the Puffin files cache (deletion vectors plus memoized footers)") \
M(AvroSchemaCacheBytes, "Size of the Avro schema cache in bytes") \
Expand Down
1 change: 1 addition & 0 deletions src/Common/FailPoint.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -84,6 +84,7 @@ static struct InitFiu
ONCE(s3_read_buffer_throw_expired_token) \
ONCE(s3_send_request_throw_expired_token) \
REGULAR(s3_read_inject_etag_mismatch) \
PAUSEABLE_ONCE(object_storage_identity_cache_pause_before_store) \
REGULAR(azure_inject_forbidden_response) \
ONCE(azure_inject_forbidden_response_once) \
REGULAR(azure_inject_auth_failure_on_request) \
Expand Down
2 changes: 2 additions & 0 deletions src/Common/ProfileEvents.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -820,6 +820,8 @@ The server successfully detected this situation and will download merged part fr
M(S3ListObjects, "Number of S3 API ListObjects calls.", ValueType::Number) \
M(S3ListObjectsMicroseconds, "Time of S3 API ListObjects execution.", ValueType::Microseconds) \
M(S3HeadObject, "Number of S3 API HeadObject calls.", ValueType::Number) \
M(ObjectStorageIdentityCacheHits, "Number of object-storage identity (size/etag/Last-Modified) cache hits, avoiding a HEAD.", ValueType::Number) \
M(ObjectStorageIdentityCacheMisses, "Number of object-storage identity cache misses that triggered a metadata request.", ValueType::Number) \
/* CA per-namespace S3 op instrumentation: one event per (namespace, op) cell of the table in */ \
/* CasInstrumentedBackend.cpp; attributes PUTs/HEADs/404s/412s/LISTs to the CA operation type. */ \
M(CASBlobPut, "Number of CAS blob PUT requests. Grows with blob uploads and indicates storage write traffic.", ValueType::Number) \
Expand Down
1 change: 1 addition & 0 deletions src/Common/QueryFuzzer.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -7934,6 +7934,7 @@ void QueryFuzzer::fuzz(ASTPtr & ast)
Type::CLEAR_ENCRYPTION_HEADERS_CACHE,
Type::CLEAR_PAIMON_METADATA_CACHE,
Type::CLEAR_PARQUET_METADATA_CACHE,
Type::CLEAR_OBJECT_STORAGE_IDENTITY_CACHE,
Type::CLEAR_POINT_IN_POLYGON_CACHE,
/// `CLEAR_{DISK_METADATA,DISTRIBUTED,FILESYSTEM,FORMAT_SCHEMA,QUERY,SCHEMA}_CACHE`
/// are deliberately absent: they carry an operand this rotation would not preserve.
Expand Down
3 changes: 3 additions & 0 deletions src/Core/ServerSettings.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -632,6 +632,9 @@ This setting can be modified at runtime and will take effect immediately.
)", 0) \
DECLARE(Double, mark_cache_size_ratio, DEFAULT_MARK_CACHE_SIZE_RATIO, R"(The size of the protected queue (in case of SLRU policy) in the mark cache relative to the cache's total size.)", 0) \
DECLARE(Double, mark_cache_prewarm_ratio, 0.95, R"(The ratio of total size of mark cache to fill during prewarm.)", 0) \
DECLARE(String, object_storage_identity_cache_policy, "SLRU", R"(Object-storage identity cache policy name (SLRU or LRU).)", 0) \
DECLARE(UInt64, object_storage_identity_cache_size, 67108864, R"(Maximum size of the object-storage identity cache in bytes. This cache stores per-object size, ETag and Last-Modified so that opening an object does not require a fresh HEAD on every read. Set to 0 to disable. A reload (`SYSTEM RELOAD CONFIG`) with a non-zero size creates the cache when startup left it disabled, so a restart is not required to turn it on.)", 0) \
DECLARE(Double, object_storage_identity_cache_size_ratio, 0.5, R"(The size of the protected queue (in case of SLRU policy) in the object-storage identity cache relative to the cache's total size.)", 0) \
DECLARE(String, unique_key_index_cache_policy, "SLRU", R"(UNIQUE KEY index cache policy name (SLRU or LRU).)", 0) \
DECLARE(UInt64, unique_key_index_cache_size_bytes, 1_GiB, R"(Maximum size (bytes) of the in-process cache for UNIQUE KEY index (SST) blocks. Set to 0 to disable the cache.)", 0) \
DECLARE(Double, unique_key_index_cache_size_ratio, 0.5, R"(The size of the protected queue (in case of SLRU policy) in the UNIQUE KEY index cache relative to the cache's total size.)", 0) \
Expand Down
Loading
Loading