tglite.TContext.set_cache_limit

TContext.set_cache_limit(limit: int)

Sets embedding cache limit and clear cache tables.

Parameters:

limit (int) – Number of embeddings to cache.