org.apache.ignite.internal.processors.cache.persistence.snapshot

Class IgniteSnapshotManager

java.lang.Object

org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter

org.apache.ignite.internal.processors.cache.persistence.snapshot.IgniteSnapshotManager

All Implemented Interfaces:

IgniteSnapshot, PartitionsExchangeAware, GridCacheSharedManager, MetastorageLifecycleListener, IgniteChangeGlobalStateSupport

public class IgniteSnapshotManager
extends GridCacheSharedManagerAdapter
implements IgniteSnapshot, PartitionsExchangeAware, MetastorageLifecycleListener, IgniteChangeGlobalStateSupport

Internal implementation of snapshot operations over persistence caches.

These major actions available:

• Create snapshot of the whole cluster cache groups by triggering PME to achieve consistency.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	IgniteSnapshotManager.ClusterSnapshotFuture

Field Summary

Fields

Modifier and Type	Field and Description
static String	CP_SNAPSHOT_REASON Text Reason for checkpoint to start snapshot operation.
static String	DELTA_SUFFIX File with delta pages suffix.
static String	DFLT_SNAPSHOT_TMP_DIR Default snapshot directory for loading remote snapshots.
static String	INDEX_DELTA_NAME File name template for index delta pages.
static String	PART_DELTA_TEMPLATE File name template consists of delta pages.
static String	SNAPSHOT_METAFILE_EXT Snapshot metafile extension.
static String	SNAPSHOT_METRICS Snapshot metrics prefix.
static String	SNP_IN_PROGRESS_ERR_MSG Snapshot in progress error message.
static String	SNP_NODE_STOPPING_ERR_MSG Error message to finalize snapshot tasks.
static String	SNP_RUNNING_KEY Metastorage key to save currently running snapshot.

Fields inherited from class org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter

cctx, diagnosticLog, log

Constructor Summary

Constructors

Constructor and Description
IgniteSnapshotManager(GridKernalContext ctx)

Method Summary

Modifier and Type	Method and Description
Set<UUID>	cacheStartRequiredAliveNodes(@Nullable IgniteUuid restoreId)
IgniteFuture<Boolean>	cancelLocalRestoreTask(String name)
void	cancelLocalSnapshotTask(String name)
IgniteFuture<Void>	cancelSnapshot(String name) Cancel running snapshot operation.
IgniteFuture<Boolean>	cancelSnapshotRestore(String name) Cancel snapshot restore operation.
IgniteInternalFuture<IdleVerifyResultV2>	checkSnapshot(String name)
IgniteInternalFuture<SnapshotPartitionsVerifyTaskResult>	checkSnapshot(String name, @Nullable Collection<String> grps) The check snapshot procedure performs compute operation over the whole cluster to verify the snapshot entirety and partitions consistency.
IgniteFuture<Void>	createSnapshot(String name) Create a consistent copy of all persistence cache groups from the whole cluster.
StandaloneGridKernalContext	createStandaloneKernalContext(String snpName, String folderName)
void	deleteSnapshot(File snpDir, String folderName)
boolean	isRestoring() Check if snapshot restore process is currently running.
boolean	isRestoring(String snpName) Check if snapshot restore process is currently running.
boolean	isRestoring(String cacheName, @Nullable String grpName) Check if the cache or group with the specified name is currently being restored from the snapshot.
boolean	isSnapshotCreating()
static boolean	isSnapshotOperation(DiscoveryEvent evt)
List<String>	localSnapshotNames()
void	onActivate(GridKernalContext kctx) Called when cluster performing activation.
void	onCacheGroupsStopped(List<Integer> grps)
void	onDeActivate(GridKernalContext kctx) Called when cluster performing deactivation.
void	onDoneBeforeTopologyUnlock(GridDhtPartitionsExchangeFuture fut) Callback from exchange process completion; called before topology is unlocked.
void	onReadyForRead(ReadOnlyMetastorage metaStorage) Is called when metastorage is made ready for read-only operations very early on node startup phase.
void	onReadyForReadWrite(ReadWriteMetastorage metaStorage) Fully functional metastore capable of performing reading and writing operations.
static File	partDeltaFile(File snapshotCacheDir, int partId)
static String	partDeltaFileName(int partId)
GridCloseableIterator<CacheDataRow>	partitionRowIterator(GridKernalContext ctx, String grpName, int partId, FilePageStore pageStore)
GridCloseableIterator<CacheDataRow>	partitionRowIterator(GridKernalContext ctx, String snpName, String folderName, String grpName, int partId)
SnapshotMetadata	readSnapshotMetadata(String snpName, String consId)
List<SnapshotMetadata>	readSnapshotMetadatas(String snpName)
static File	resolveSnapshotWorkDirectory(IgniteConfiguration cfg)
IgniteFuture<Void>	restoreSnapshot(String name, @Nullable Collection<String> grpNames) Restore cache group(s) from the snapshot.
IgniteFuture<Boolean>	restoreStatus(String snpName) Status of the restore operation cluster-wide.
List<File>	snapshotCacheDirectories(String snpName, String folderName)
List<File>	snapshotCacheDirectories(String snpName, String folderName, Predicate<String> names)
File	snapshotLocalDir(String snpName)
File	snapshotTmpDir()
protected void	start0()
protected void	stop0(boolean cancel)

Methods inherited from class org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter

context, isStopping, kernalStartInfo, kernalStopInfo, log, onDisconnected, onKernalStart, onKernalStart0, onKernalStop, onKernalStop0, onReconnected, printMemoryStats, start, startInfo, stop, stopInfo, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.ignite.internal.processors.cache.distributed.dht.preloader.PartitionsExchangeAware

onDoneAfterTopologyUnlock, onInitAfterTopologyLock, onInitBeforeTopologyLock

Field Detail

DELTA_SUFFIX

public static final String DELTA_SUFFIX

File with delta pages suffix.

See Also:

Constant Field Values

PART_DELTA_TEMPLATE

public static final String PART_DELTA_TEMPLATE

File name template consists of delta pages.

See Also:

Constant Field Values

INDEX_DELTA_NAME

public static final String INDEX_DELTA_NAME

File name template for index delta pages.

See Also:

Constant Field Values

CP_SNAPSHOT_REASON

public static final String CP_SNAPSHOT_REASON

Text Reason for checkpoint to start snapshot operation.

See Also:

Constant Field Values

DFLT_SNAPSHOT_TMP_DIR

public static final String DFLT_SNAPSHOT_TMP_DIR

Default snapshot directory for loading remote snapshots.

See Also:

Constant Field Values

SNP_IN_PROGRESS_ERR_MSG

public static final String SNP_IN_PROGRESS_ERR_MSG

Snapshot in progress error message.

See Also:

Constant Field Values

SNP_NODE_STOPPING_ERR_MSG

public static final String SNP_NODE_STOPPING_ERR_MSG

Error message to finalize snapshot tasks.

See Also:

Constant Field Values

SNP_RUNNING_KEY

public static final String SNP_RUNNING_KEY

Metastorage key to save currently running snapshot.

See Also:

Constant Field Values

SNAPSHOT_METRICS

public static final String SNAPSHOT_METRICS

Snapshot metrics prefix.

See Also:

Constant Field Values

SNAPSHOT_METAFILE_EXT

public static final String SNAPSHOT_METAFILE_EXT

Snapshot metafile extension.

See Also:

Constant Field Values

Constructor Detail

IgniteSnapshotManager

public IgniteSnapshotManager(GridKernalContext ctx)

Parameters:

ctx - Kernal context.

Method Detail

partDeltaFile

public static File partDeltaFile(File snapshotCacheDir,
                                 int partId)

Parameters:

snapshotCacheDir - Snapshot directory to store files.

partId - Cache partition identifier.

Returns:

A file representation.

partDeltaFileName

public static String partDeltaFileName(int partId)

Parameters:

partId - Partition id.

Returns:

File name of delta partition pages.

start0

protected void start0()
               throws IgniteCheckedException

Overrides:

start0 in class GridCacheSharedManagerAdapter

Throws:

IgniteCheckedException - If failed.

stop0

protected void stop0(boolean cancel)

Overrides:

stop0 in class GridCacheSharedManagerAdapter

Parameters:

cancel - Cancel flag.

onActivate

public void onActivate(GridKernalContext kctx)

Called when cluster performing activation.

Specified by:

onActivate in interface IgniteChangeGlobalStateSupport

Parameters:

kctx - Kernal context.

onDeActivate

public void onDeActivate(GridKernalContext kctx)

Called when cluster performing deactivation.

Specified by:

onDeActivate in interface IgniteChangeGlobalStateSupport

Parameters:

kctx - Kernal context.

deleteSnapshot

public void deleteSnapshot(File snpDir,
                           String folderName)

Parameters:

snpDir - Snapshot dir.

folderName - Local node folder name (see IgniteUtils.maskForFileName(java.lang.CharSequence) with consistent id).

snapshotLocalDir

public File snapshotLocalDir(String snpName)

Parameters:

snpName - Snapshot name.

Returns:

Local snapshot directory for snapshot with given name.

snapshotTmpDir

public File snapshotTmpDir()

Returns:

Node snapshot working directory.

isSnapshotCreating

public boolean isSnapshotCreating()

Returns:

True if snapshot operation is in progress.

isRestoring

public boolean isRestoring()

Check if snapshot restore process is currently running.

Returns:

True if the snapshot restore operation is in progress.

isRestoring

public boolean isRestoring(String snpName)

Check if snapshot restore process is currently running.

Parameters:

snpName - Snapshot name.

Returns:

True if the snapshot restore operation from the specified snapshot is in progress locally.

isRestoring

public boolean isRestoring(String cacheName,
                           @Nullable
                           @Nullable String grpName)

Check if the cache or group with the specified name is currently being restored from the snapshot.

Parameters:

cacheName - Cache name.

grpName - Cache group name.

Returns:

True if the cache or group with the specified name is being restored.

restoreStatus

public IgniteFuture<Boolean> restoreStatus(String snpName)

Status of the restore operation cluster-wide.

Parameters:

snpName - Snapshot name.

Returns:

Future that will be completed when the status of the restore operation is received from all the server nodes. The result of this future will be false if the restore process with the specified snapshot name is not running on all nodes.

cacheStartRequiredAliveNodes

public Set<UUID> cacheStartRequiredAliveNodes(@Nullable
                                              @Nullable IgniteUuid restoreId)

Parameters:

restoreId - Restore process ID.

Returns:

Server nodes on which a successful start of the cache(s) is required, if any of these nodes fails when starting the cache(s), the whole procedure is rolled back.

localSnapshotNames

public List<String> localSnapshotNames()

Returns:

List of all known snapshots on the local node.

cancelSnapshot

public IgniteFuture<Void> cancelSnapshot(String name)

Cancel running snapshot operation. All intermediate results of cancelled snapshot operation will be deleted. If snapshot already created this command will have no effect.

Specified by:

cancelSnapshot in interface IgniteSnapshot

Parameters:

name - Snapshot name to cancel.

Returns:

Future which will be completed when cancel operation finished.

cancelLocalSnapshotTask

public void cancelLocalSnapshotTask(String name)

Parameters:

name - Snapshot name to cancel operation on local node.

cancelSnapshotRestore

public IgniteFuture<Boolean> cancelSnapshotRestore(String name)

Cancel snapshot restore operation.

Specified by:

cancelSnapshotRestore in interface IgniteSnapshot

Parameters:

name - Snapshot name.

Returns:

Future that will be finished when the process is complete on all nodes. The result of this future will be false if the restore process with the specified snapshot name is not running at all.

cancelLocalRestoreTask

public IgniteFuture<Boolean> cancelLocalRestoreTask(String name)

Parameters:

name - Snapshot name.

Returns:

Future that will be finished when process the process is complete. The result of this future will be false if the restore process with the specified snapshot name is not running at all.

checkSnapshot

public IgniteInternalFuture<IdleVerifyResultV2> checkSnapshot(String name)

Parameters:

name - Snapshot name.

Returns:

true if snapshot is OK.

checkSnapshot

public IgniteInternalFuture<SnapshotPartitionsVerifyTaskResult> checkSnapshot(String name,
                                                                              @Nullable
                                                                              @Nullable Collection<String> grps)

The check snapshot procedure performs compute operation over the whole cluster to verify the snapshot entirety and partitions consistency. The result future will be completed with an exception if this exception is not related to the check procedure, and will be completed normally with the IdleVerifyResult.

Parameters:

name - Snapshot name.

grps - Collection of cache group names to check.

Returns:

true if snapshot is OK.

snapshotCacheDirectories

public List<File> snapshotCacheDirectories(String snpName,
                                           String folderName)

Parameters:

snpName - Snapshot name.

folderName - Directory name for cache group.

Returns:

The list of cache or cache group names in given snapshot on local node.

snapshotCacheDirectories

public List<File> snapshotCacheDirectories(String snpName,
                                           String folderName,
                                           Predicate<String> names)

Parameters:

snpName - Snapshot name.

folderName - Directory name for cache group.

names - Cache group names to filter.

Returns:

The list of cache or cache group names in given snapshot on local node.

readSnapshotMetadata

public SnapshotMetadata readSnapshotMetadata(String snpName,
                                             String consId)

Parameters:

snpName - Snapshot name.

consId - Node consistent id to read medata for.

Returns:

Snapshot metadata instance.

readSnapshotMetadatas

public List<SnapshotMetadata> readSnapshotMetadatas(String snpName)

Parameters:

snpName - Snapshot name.

Returns:

List of snapshot metadata for the given snapshot name on local node. If snapshot has been taken from local node the snapshot metadata for given local node will be placed on the first place.

createSnapshot

public IgniteFuture<Void> createSnapshot(String name)

Create a consistent copy of all persistence cache groups from the whole cluster.

Specified by:

createSnapshot in interface IgniteSnapshot

Parameters:

name - Snapshot unique name which satisfies the following name pattern [a-zA-Z0-9_].

Returns:

Future which will be completed when a process ends.

restoreSnapshot

public IgniteFuture<Void> restoreSnapshot(String name,
                                          @Nullable
                                          @Nullable Collection<String> grpNames)

Restore cache group(s) from the snapshot.

NOTE: Cache groups to be restored from the snapshot must not present in the cluster, if they present, they must be destroyed by the user (eg with IgniteCache.destroy()) before starting this operation.

Specified by:

restoreSnapshot in interface IgniteSnapshot

Parameters:

name - Snapshot name.

grpNames - Cache groups to be restored or null to restore all cache groups from the snapshot.

Returns:

Future which will be completed when restore operation finished.

onReadyForReadWrite

public void onReadyForReadWrite(ReadWriteMetastorage metaStorage)
                         throws IgniteCheckedException

Fully functional metastore capable of performing reading and writing operations. Components interested in using metastore are allowed to keep reference passed into the method in their fields.

Specified by:

onReadyForReadWrite in interface MetastorageLifecycleListener

Parameters:

metaStorage - Fully functional meta storage.

Throws:

IgniteCheckedException

onReadyForRead

public void onReadyForRead(ReadOnlyMetastorage metaStorage)
                    throws IgniteCheckedException

Is called when metastorage is made ready for read-only operations very early on node startup phase. Reference for read-only metastorage should be used only within this method and shouldn't be stored to any field.

Specified by:

onReadyForRead in interface MetastorageLifecycleListener

Parameters:

metaStorage - Read-only meta storage.

Throws:

IgniteCheckedException

isSnapshotOperation

public static boolean isSnapshotOperation(DiscoveryEvent evt)

Parameters:

evt - Discovery event to check.

Returns:

true if exchange started by snapshot operation.

onDoneBeforeTopologyUnlock

public void onDoneBeforeTopologyUnlock(GridDhtPartitionsExchangeFuture fut)

Callback from exchange process completion; called before topology is unlocked. Guarantees that no updates were performed on local node since exchange process started.

Specified by:

onDoneBeforeTopologyUnlock in interface PartitionsExchangeAware

Parameters:

fut - Partition map exchange future.

onCacheGroupsStopped

public void onCacheGroupsStopped(List<Integer> grps)

Parameters:

grps - List of cache groups which will be destroyed.

createStandaloneKernalContext

public StandaloneGridKernalContext createStandaloneKernalContext(String snpName,
                                                                 String folderName)
                                                          throws IgniteCheckedException

Parameters:

snpName - Snapshot name.

folderName - The node folder name, usually it's the same as the U.maskForFileName(consistentId).

Returns:

Standalone kernal context related to the snapshot.

Throws:

IgniteCheckedException - If fails.

partitionRowIterator

public GridCloseableIterator<CacheDataRow> partitionRowIterator(GridKernalContext ctx,
                                                                String grpName,
                                                                int partId,
                                                                FilePageStore pageStore)
                                                         throws IgniteCheckedException

Parameters:

grpName - Cache group name.

partId - Partition id.

pageStore - File page store to iterate over.

Returns:

Iterator over partition.

Throws:

IgniteCheckedException - If and error occurs.

partitionRowIterator

public GridCloseableIterator<CacheDataRow> partitionRowIterator(GridKernalContext ctx,
                                                                String snpName,
                                                                String folderName,
                                                                String grpName,
                                                                int partId)
                                                         throws IgniteCheckedException

Parameters:

snpName - Snapshot name.

folderName - The node folder name, usually it's the same as the U.maskForFileName(consistentId).

grpName - Cache group name.

partId - Partition id.

Returns:

Iterator over partition.

Throws:

IgniteCheckedException - If and error occurs.

resolveSnapshotWorkDirectory

public static File resolveSnapshotWorkDirectory(IgniteConfiguration cfg)

Parameters:

cfg - Ignite configuration.

Returns:

Snapshot directory resolved through given configuration.