org.apache.ignite.internal.processors.hadoop

Enum GridHadoopJobProperty

java.lang.Object

java.lang.Enum<GridHadoopJobProperty>

org.apache.ignite.internal.processors.hadoop.GridHadoopJobProperty

All Implemented Interfaces:

Serializable, Comparable<GridHadoopJobProperty>

public enum GridHadoopJobProperty
extends Enum<GridHadoopJobProperty>

Enumeration of optional properties supported by Ignite for Apache Hadoop.

Enum Constant Summary

Enum Constants

Enum Constant and Description
COMBINER_HASHMAP_SIZE Initial size for hashmap which stores output of mapper and will be used as input of combiner.
EXTERNAL_CONCURRENT_MAPPERS Specifies number of concurrently running mappers for external execution mode.
EXTERNAL_CONCURRENT_REDUCERS Specifies number of concurrently running reducers for external execution mode.
JOB_STATUS_POLL_DELAY Delay in milliseconds after which Ignite server will reply job status.
PARTITION_HASHMAP_SIZE Initial size for hashmap which stores output of mapper or combiner and will be used as input of reducer.
SHUFFLE_COMBINER_NO_SORTING If set to true then input for combiner will not be sorted by key.
SHUFFLE_OFFHEAP_PAGE_SIZE Size in bytes of single memory page which will be allocated for data structures in shuffle.
SHUFFLE_REDUCER_NO_SORTING If set to true then input for reducer will not be sorted by key.

Method Summary

Methods

Modifier and Type	Method and Description
static boolean	get(GridHadoopJobInfo jobInfo, GridHadoopJobProperty pty, boolean dflt)
static int	get(GridHadoopJobInfo jobInfo, GridHadoopJobProperty pty, int dflt)
static String	get(GridHadoopJobInfo jobInfo, GridHadoopJobProperty pty, String dflt)
String	propertyName()
static GridHadoopJobProperty	valueOf(String name) Returns the enum constant of this type with the specified name.
static GridHadoopJobProperty[]	values() Returns an array containing the constants of this enum type, in the order they are declared.

Methods inherited from class java.lang.Enum

clone, compareTo, equals, finalize, getDeclaringClass, hashCode, name, ordinal, toString, valueOf

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Enum Constant Detail

COMBINER_HASHMAP_SIZE

public static final GridHadoopJobProperty COMBINER_HASHMAP_SIZE

Initial size for hashmap which stores output of mapper and will be used as input of combiner.

Setting it right allows to avoid rehashing.

PARTITION_HASHMAP_SIZE

public static final GridHadoopJobProperty PARTITION_HASHMAP_SIZE

Initial size for hashmap which stores output of mapper or combiner and will be used as input of reducer.

Setting it right allows to avoid rehashing.

EXTERNAL_CONCURRENT_MAPPERS

public static final GridHadoopJobProperty EXTERNAL_CONCURRENT_MAPPERS

Specifies number of concurrently running mappers for external execution mode.

If not specified, defaults to Runtime.getRuntime().availableProcessors().

EXTERNAL_CONCURRENT_REDUCERS

public static final GridHadoopJobProperty EXTERNAL_CONCURRENT_REDUCERS

Specifies number of concurrently running reducers for external execution mode.

If not specified, defaults to Runtime.getRuntime().availableProcessors().

JOB_STATUS_POLL_DELAY

public static final GridHadoopJobProperty JOB_STATUS_POLL_DELAY

Delay in milliseconds after which Ignite server will reply job status.

SHUFFLE_OFFHEAP_PAGE_SIZE

public static final GridHadoopJobProperty SHUFFLE_OFFHEAP_PAGE_SIZE

Size in bytes of single memory page which will be allocated for data structures in shuffle.

By default is 32 * 1024.

SHUFFLE_COMBINER_NO_SORTING

public static final GridHadoopJobProperty SHUFFLE_COMBINER_NO_SORTING

If set to true then input for combiner will not be sorted by key. Internally hash-map will be used instead of sorted one, so Object.equals(Object) and Object.hashCode() methods of key must be implemented consistently with comparator for that type. Grouping comparator is not supported if this setting is true.

By default is false.

SHUFFLE_REDUCER_NO_SORTING

public static final GridHadoopJobProperty SHUFFLE_REDUCER_NO_SORTING

If set to true then input for reducer will not be sorted by key. Internally hash-map will be used instead of sorted one, so Object.equals(Object) and Object.hashCode() methods of key must be implemented consistently with comparator for that type. Grouping comparator is not supported if this setting is true.

By default is false.

Method Detail

values

public static GridHadoopJobProperty[] values()

Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows:

for (GridHadoopJobProperty c : GridHadoopJobProperty.values())
    System.out.println(c);

Returns:

an array containing the constants of this enum type, in the order they are declared

valueOf

public static GridHadoopJobProperty valueOf(String name)

Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)

Parameters:

name - the name of the enum constant to be returned.

Returns:

the enum constant with the specified name

Throws:

IllegalArgumentException - if this enum type has no constant with the specified name

NullPointerException - if the argument is null

propertyName

public String propertyName()

Returns:

Property name.

get

public static String get(GridHadoopJobInfo jobInfo,
         GridHadoopJobProperty pty,
         @Nullable
         String dflt)

Parameters:

jobInfo - Job info.

pty - Property.

dflt - Default value.

Returns:

Property value.

get

public static int get(GridHadoopJobInfo jobInfo,
      GridHadoopJobProperty pty,
      int dflt)

Parameters:

jobInfo - Job info.

pty - Property.

dflt - Default value.

Returns:

Property value.

get

public static boolean get(GridHadoopJobInfo jobInfo,
          GridHadoopJobProperty pty,
          boolean dflt)

Parameters:

jobInfo - Job info.

pty - Property.

dflt - Default value.

Returns:

Property value.