| Copyright | (c) 2013-2018 Brendan Hay |
|---|---|
| License | Mozilla Public License, v. 2.0. |
| Maintainer | Brendan Hay <brendan.g.hay+amazonka@gmail.com> |
| Stability | auto-generated |
| Portability | non-portable (GHC extensions) |
| Safe Haskell | None |
| Language | Haskell2010 |
Network.AWS.EMR
Contents
- Service Configuration
- Errors
- Waiters
- Operations
- RunJobFlow
- RemoveAutoScalingPolicy
- SetVisibleToAllUsers
- TerminateJobFlows
- DescribeStep
- RemoveTags
- DescribeCluster
- ListSecurityConfigurations
- CancelSteps
- CreateSecurityConfiguration
- SetTerminationProtection
- AddJobFlowSteps
- ModifyInstanceGroups
- ListSteps (Paginated)
- AddInstanceFleet
- AddInstanceGroups
- DeleteSecurityConfiguration
- ModifyInstanceFleet
- ListInstanceGroups (Paginated)
- ListBootstrapActions (Paginated)
- AddTags
- ListInstances (Paginated)
- PutAutoScalingPolicy
- ListClusters (Paginated)
- DescribeSecurityConfiguration
- ListInstanceFleets (Paginated)
- Types
- ActionOnFailure
- AdjustmentType
- AutoScalingPolicyState
- AutoScalingPolicyStateChangeReasonCode
- CancelStepsRequestStatus
- ClusterState
- ClusterStateChangeReasonCode
- ComparisonOperator
- InstanceCollectionType
- InstanceFleetState
- InstanceFleetStateChangeReasonCode
- InstanceFleetType
- InstanceGroupState
- InstanceGroupStateChangeReasonCode
- InstanceGroupType
- InstanceRoleType
- InstanceState
- InstanceStateChangeReasonCode
- MarketType
- RepoUpgradeOnBoot
- ScaleDownBehavior
- SpotProvisioningTimeoutAction
- Statistic
- StepState
- StepStateChangeReasonCode
- Unit
- Application
- AutoScalingPolicy
- AutoScalingPolicyDescription
- AutoScalingPolicyStateChangeReason
- AutoScalingPolicyStatus
- BootstrapActionConfig
- CancelStepsInfo
- CloudWatchAlarmDefinition
- Cluster
- ClusterStateChangeReason
- ClusterStatus
- ClusterSummary
- ClusterTimeline
- Command
- Configuration
- EBSBlockDevice
- EBSBlockDeviceConfig
- EBSConfiguration
- EBSVolume
- EC2InstanceAttributes
- FailureDetails
- HadoopJARStepConfig
- HadoopStepConfig
- Instance
- InstanceFleet
- InstanceFleetConfig
- InstanceFleetModifyConfig
- InstanceFleetProvisioningSpecifications
- InstanceFleetStateChangeReason
- InstanceFleetStatus
- InstanceFleetTimeline
- InstanceGroup
- InstanceGroupConfig
- InstanceGroupModifyConfig
- InstanceGroupStateChangeReason
- InstanceGroupStatus
- InstanceGroupTimeline
- InstanceResizePolicy
- InstanceStateChangeReason
- InstanceStatus
- InstanceTimeline
- InstanceTypeConfig
- InstanceTypeSpecification
- JobFlowInstancesConfig
- KerberosAttributes
- KeyValue
- MetricDimension
- PlacementType
- ScalingAction
- ScalingConstraints
- ScalingRule
- ScalingTrigger
- ScriptBootstrapActionConfig
- SecurityConfigurationSummary
- ShrinkPolicy
- SimpleScalingPolicyConfiguration
- SpotProvisioningSpecification
- Step
- StepConfig
- StepStateChangeReason
- StepStatus
- StepSummary
- StepTimeline
- SupportedProductConfig
- Tag
- VolumeSpecification
Description
Amazon EMR is a web service that makes it easy to process large amounts of data efficiently. Amazon EMR uses Hadoop processing combined with several AWS products to do tasks such as web indexing, data mining, log file analysis, machine learning, scientific simulation, and data warehousing.
Synopsis
- emr :: Service
- _InvalidRequestException :: AsError a => Getting (First ServiceError) a ServiceError
- _InternalServerError :: AsError a => Getting (First ServiceError) a ServiceError
- _InternalServerException :: AsError a => Getting (First ServiceError) a ServiceError
- stepComplete :: Wait DescribeStep
- clusterTerminated :: Wait DescribeCluster
- clusterRunning :: Wait DescribeCluster
- module Network.AWS.EMR.RunJobFlow
- module Network.AWS.EMR.RemoveAutoScalingPolicy
- module Network.AWS.EMR.SetVisibleToAllUsers
- module Network.AWS.EMR.TerminateJobFlows
- module Network.AWS.EMR.DescribeStep
- module Network.AWS.EMR.RemoveTags
- module Network.AWS.EMR.DescribeCluster
- module Network.AWS.EMR.ListSecurityConfigurations
- module Network.AWS.EMR.CancelSteps
- module Network.AWS.EMR.CreateSecurityConfiguration
- module Network.AWS.EMR.SetTerminationProtection
- module Network.AWS.EMR.AddJobFlowSteps
- module Network.AWS.EMR.ModifyInstanceGroups
- module Network.AWS.EMR.ListSteps
- module Network.AWS.EMR.AddInstanceFleet
- module Network.AWS.EMR.AddInstanceGroups
- module Network.AWS.EMR.DeleteSecurityConfiguration
- module Network.AWS.EMR.ModifyInstanceFleet
- module Network.AWS.EMR.ListInstanceGroups
- module Network.AWS.EMR.ListBootstrapActions
- module Network.AWS.EMR.AddTags
- module Network.AWS.EMR.ListInstances
- module Network.AWS.EMR.PutAutoScalingPolicy
- module Network.AWS.EMR.ListClusters
- module Network.AWS.EMR.DescribeSecurityConfiguration
- module Network.AWS.EMR.ListInstanceFleets
- data ActionOnFailure
- data AdjustmentType
- data AutoScalingPolicyState
- data AutoScalingPolicyStateChangeReasonCode
- data CancelStepsRequestStatus
- data ClusterState
- data ClusterStateChangeReasonCode
- data ComparisonOperator
- data InstanceCollectionType
- data InstanceFleetState
- data InstanceFleetStateChangeReasonCode
- data InstanceFleetType
- data InstanceGroupState
- data InstanceGroupStateChangeReasonCode
- data InstanceGroupType
- data InstanceRoleType
- data InstanceState
- data InstanceStateChangeReasonCode
- data MarketType
- data RepoUpgradeOnBoot
- data ScaleDownBehavior
- data SpotProvisioningTimeoutAction
- data Statistic
- = Average
- | Maximum
- | Minimum
- | SampleCount
- | Sum
- data StepState
- data StepStateChangeReasonCode = SSCRCNone
- data Unit
- = Bits
- | BitsPerSecond
- | Bytes
- | BytesPerSecond
- | Count
- | CountPerSecond
- | GigaBits
- | GigaBitsPerSecond
- | GigaBytes
- | GigaBytesPerSecond
- | KiloBits
- | KiloBitsPerSecond
- | KiloBytes
- | KiloBytesPerSecond
- | MegaBits
- | MegaBitsPerSecond
- | MegaBytes
- | MegaBytesPerSecond
- | MicroSeconds
- | MilliSeconds
- | None
- | Percent
- | Seconds
- | TeraBits
- | TeraBitsPerSecond
- | TeraBytes
- | TeraBytesPerSecond
- data Application
- application :: Application
- aArgs :: Lens' Application [Text]
- aAdditionalInfo :: Lens' Application (HashMap Text Text)
- aName :: Lens' Application (Maybe Text)
- aVersion :: Lens' Application (Maybe Text)
- data AutoScalingPolicy
- autoScalingPolicy :: ScalingConstraints -> AutoScalingPolicy
- aspConstraints :: Lens' AutoScalingPolicy ScalingConstraints
- aspRules :: Lens' AutoScalingPolicy [ScalingRule]
- data AutoScalingPolicyDescription
- autoScalingPolicyDescription :: AutoScalingPolicyDescription
- aspdStatus :: Lens' AutoScalingPolicyDescription (Maybe AutoScalingPolicyStatus)
- aspdRules :: Lens' AutoScalingPolicyDescription [ScalingRule]
- aspdConstraints :: Lens' AutoScalingPolicyDescription (Maybe ScalingConstraints)
- data AutoScalingPolicyStateChangeReason
- autoScalingPolicyStateChangeReason :: AutoScalingPolicyStateChangeReason
- aspscrCode :: Lens' AutoScalingPolicyStateChangeReason (Maybe AutoScalingPolicyStateChangeReasonCode)
- aspscrMessage :: Lens' AutoScalingPolicyStateChangeReason (Maybe Text)
- data AutoScalingPolicyStatus
- autoScalingPolicyStatus :: AutoScalingPolicyStatus
- aspsState :: Lens' AutoScalingPolicyStatus (Maybe AutoScalingPolicyState)
- aspsStateChangeReason :: Lens' AutoScalingPolicyStatus (Maybe AutoScalingPolicyStateChangeReason)
- data BootstrapActionConfig
- bootstrapActionConfig :: Text -> ScriptBootstrapActionConfig -> BootstrapActionConfig
- bacName :: Lens' BootstrapActionConfig Text
- bacScriptBootstrapAction :: Lens' BootstrapActionConfig ScriptBootstrapActionConfig
- data CancelStepsInfo
- cancelStepsInfo :: CancelStepsInfo
- csiStatus :: Lens' CancelStepsInfo (Maybe CancelStepsRequestStatus)
- csiStepId :: Lens' CancelStepsInfo (Maybe Text)
- csiReason :: Lens' CancelStepsInfo (Maybe Text)
- data CloudWatchAlarmDefinition
- cloudWatchAlarmDefinition :: ComparisonOperator -> Text -> Int -> Double -> CloudWatchAlarmDefinition
- cwadEvaluationPeriods :: Lens' CloudWatchAlarmDefinition (Maybe Int)
- cwadNamespace :: Lens' CloudWatchAlarmDefinition (Maybe Text)
- cwadDimensions :: Lens' CloudWatchAlarmDefinition [MetricDimension]
- cwadUnit :: Lens' CloudWatchAlarmDefinition (Maybe Unit)
- cwadStatistic :: Lens' CloudWatchAlarmDefinition (Maybe Statistic)
- cwadComparisonOperator :: Lens' CloudWatchAlarmDefinition ComparisonOperator
- cwadMetricName :: Lens' CloudWatchAlarmDefinition Text
- cwadPeriod :: Lens' CloudWatchAlarmDefinition Int
- cwadThreshold :: Lens' CloudWatchAlarmDefinition Double
- data Cluster
- cluster :: Text -> Text -> ClusterStatus -> Cluster
- cluRequestedAMIVersion :: Lens' Cluster (Maybe Text)
- cluEBSRootVolumeSize :: Lens' Cluster (Maybe Int)
- cluEC2InstanceAttributes :: Lens' Cluster (Maybe EC2InstanceAttributes)
- cluNormalizedInstanceHours :: Lens' Cluster (Maybe Int)
- cluConfigurations :: Lens' Cluster [Configuration]
- cluCustomAMIId :: Lens' Cluster (Maybe Text)
- cluAutoScalingRole :: Lens' Cluster (Maybe Text)
- cluSecurityConfiguration :: Lens' Cluster (Maybe Text)
- cluScaleDownBehavior :: Lens' Cluster (Maybe ScaleDownBehavior)
- cluInstanceCollectionType :: Lens' Cluster (Maybe InstanceCollectionType)
- cluReleaseLabel :: Lens' Cluster (Maybe Text)
- cluRepoUpgradeOnBoot :: Lens' Cluster (Maybe RepoUpgradeOnBoot)
- cluLogURI :: Lens' Cluster (Maybe Text)
- cluKerberosAttributes :: Lens' Cluster (Maybe KerberosAttributes)
- cluRunningAMIVersion :: Lens' Cluster (Maybe Text)
- cluMasterPublicDNSName :: Lens' Cluster (Maybe Text)
- cluTerminationProtected :: Lens' Cluster (Maybe Bool)
- cluVisibleToAllUsers :: Lens' Cluster (Maybe Bool)
- cluAutoTerminate :: Lens' Cluster (Maybe Bool)
- cluApplications :: Lens' Cluster [Application]
- cluTags :: Lens' Cluster [Tag]
- cluServiceRole :: Lens' Cluster (Maybe Text)
- cluId :: Lens' Cluster Text
- cluName :: Lens' Cluster Text
- cluStatus :: Lens' Cluster ClusterStatus
- data ClusterStateChangeReason
- clusterStateChangeReason :: ClusterStateChangeReason
- cscrCode :: Lens' ClusterStateChangeReason (Maybe ClusterStateChangeReasonCode)
- cscrMessage :: Lens' ClusterStateChangeReason (Maybe Text)
- data ClusterStatus
- clusterStatus :: ClusterStatus
- csState :: Lens' ClusterStatus (Maybe ClusterState)
- csStateChangeReason :: Lens' ClusterStatus (Maybe ClusterStateChangeReason)
- csTimeline :: Lens' ClusterStatus (Maybe ClusterTimeline)
- data ClusterSummary
- clusterSummary :: ClusterSummary
- csStatus :: Lens' ClusterSummary (Maybe ClusterStatus)
- csNormalizedInstanceHours :: Lens' ClusterSummary (Maybe Int)
- csName :: Lens' ClusterSummary (Maybe Text)
- csId :: Lens' ClusterSummary (Maybe Text)
- data ClusterTimeline
- clusterTimeline :: ClusterTimeline
- ctReadyDateTime :: Lens' ClusterTimeline (Maybe UTCTime)
- ctCreationDateTime :: Lens' ClusterTimeline (Maybe UTCTime)
- ctEndDateTime :: Lens' ClusterTimeline (Maybe UTCTime)
- data Command
- command :: Command
- cArgs :: Lens' Command [Text]
- cScriptPath :: Lens' Command (Maybe Text)
- cName :: Lens' Command (Maybe Text)
- data Configuration
- configuration :: Configuration
- cConfigurations :: Lens' Configuration [Configuration]
- cClassification :: Lens' Configuration (Maybe Text)
- cProperties :: Lens' Configuration (HashMap Text Text)
- data EBSBlockDevice
- ebsBlockDevice :: EBSBlockDevice
- ebdDevice :: Lens' EBSBlockDevice (Maybe Text)
- ebdVolumeSpecification :: Lens' EBSBlockDevice (Maybe VolumeSpecification)
- data EBSBlockDeviceConfig
- ebsBlockDeviceConfig :: VolumeSpecification -> EBSBlockDeviceConfig
- ebdcVolumesPerInstance :: Lens' EBSBlockDeviceConfig (Maybe Int)
- ebdcVolumeSpecification :: Lens' EBSBlockDeviceConfig VolumeSpecification
- data EBSConfiguration
- ebsConfiguration :: EBSConfiguration
- ecEBSOptimized :: Lens' EBSConfiguration (Maybe Bool)
- ecEBSBlockDeviceConfigs :: Lens' EBSConfiguration [EBSBlockDeviceConfig]
- data EBSVolume
- ebsVolume :: EBSVolume
- evDevice :: Lens' EBSVolume (Maybe Text)
- evVolumeId :: Lens' EBSVolume (Maybe Text)
- data EC2InstanceAttributes
- ec2InstanceAttributes :: EC2InstanceAttributes
- eiaEC2KeyName :: Lens' EC2InstanceAttributes (Maybe Text)
- eiaEmrManagedSlaveSecurityGroup :: Lens' EC2InstanceAttributes (Maybe Text)
- eiaAdditionalSlaveSecurityGroups :: Lens' EC2InstanceAttributes [Text]
- eiaRequestedEC2SubnetIds :: Lens' EC2InstanceAttributes [Text]
- eiaAdditionalMasterSecurityGroups :: Lens' EC2InstanceAttributes [Text]
- eiaIAMInstanceProfile :: Lens' EC2InstanceAttributes (Maybe Text)
- eiaEmrManagedMasterSecurityGroup :: Lens' EC2InstanceAttributes (Maybe Text)
- eiaEC2SubnetId :: Lens' EC2InstanceAttributes (Maybe Text)
- eiaRequestedEC2AvailabilityZones :: Lens' EC2InstanceAttributes [Text]
- eiaServiceAccessSecurityGroup :: Lens' EC2InstanceAttributes (Maybe Text)
- eiaEC2AvailabilityZone :: Lens' EC2InstanceAttributes (Maybe Text)
- data FailureDetails
- failureDetails :: FailureDetails
- fdLogFile :: Lens' FailureDetails (Maybe Text)
- fdReason :: Lens' FailureDetails (Maybe Text)
- fdMessage :: Lens' FailureDetails (Maybe Text)
- data HadoopJARStepConfig
- hadoopJARStepConfig :: Text -> HadoopJARStepConfig
- hjscArgs :: Lens' HadoopJARStepConfig [Text]
- hjscMainClass :: Lens' HadoopJARStepConfig (Maybe Text)
- hjscProperties :: Lens' HadoopJARStepConfig [KeyValue]
- hjscJAR :: Lens' HadoopJARStepConfig Text
- data HadoopStepConfig
- hadoopStepConfig :: HadoopStepConfig
- hscArgs :: Lens' HadoopStepConfig [Text]
- hscJAR :: Lens' HadoopStepConfig (Maybe Text)
- hscMainClass :: Lens' HadoopStepConfig (Maybe Text)
- hscProperties :: Lens' HadoopStepConfig (HashMap Text Text)
- data Instance
- instance' :: Instance
- iStatus :: Lens' Instance (Maybe InstanceStatus)
- iPublicDNSName :: Lens' Instance (Maybe Text)
- iEBSVolumes :: Lens' Instance [EBSVolume]
- iEC2InstanceId :: Lens' Instance (Maybe Text)
- iInstanceType :: Lens' Instance (Maybe Text)
- iMarket :: Lens' Instance (Maybe MarketType)
- iPrivateIPAddress :: Lens' Instance (Maybe Text)
- iInstanceFleetId :: Lens' Instance (Maybe Text)
- iId :: Lens' Instance (Maybe Text)
- iInstanceGroupId :: Lens' Instance (Maybe Text)
- iPrivateDNSName :: Lens' Instance (Maybe Text)
- iPublicIPAddress :: Lens' Instance (Maybe Text)
- data InstanceFleet
- instanceFleet :: InstanceFleet
- ifProvisionedSpotCapacity :: Lens' InstanceFleet (Maybe Natural)
- ifStatus :: Lens' InstanceFleet (Maybe InstanceFleetStatus)
- ifTargetOnDemandCapacity :: Lens' InstanceFleet (Maybe Natural)
- ifInstanceFleetType :: Lens' InstanceFleet (Maybe InstanceFleetType)
- ifInstanceTypeSpecifications :: Lens' InstanceFleet [InstanceTypeSpecification]
- ifName :: Lens' InstanceFleet (Maybe Text)
- ifProvisionedOnDemandCapacity :: Lens' InstanceFleet (Maybe Natural)
- ifTargetSpotCapacity :: Lens' InstanceFleet (Maybe Natural)
- ifId :: Lens' InstanceFleet (Maybe Text)
- ifLaunchSpecifications :: Lens' InstanceFleet (Maybe InstanceFleetProvisioningSpecifications)
- data InstanceFleetConfig
- instanceFleetConfig :: InstanceFleetType -> InstanceFleetConfig
- ifcInstanceTypeConfigs :: Lens' InstanceFleetConfig [InstanceTypeConfig]
- ifcTargetOnDemandCapacity :: Lens' InstanceFleetConfig (Maybe Natural)
- ifcName :: Lens' InstanceFleetConfig (Maybe Text)
- ifcTargetSpotCapacity :: Lens' InstanceFleetConfig (Maybe Natural)
- ifcLaunchSpecifications :: Lens' InstanceFleetConfig (Maybe InstanceFleetProvisioningSpecifications)
- ifcInstanceFleetType :: Lens' InstanceFleetConfig InstanceFleetType
- data InstanceFleetModifyConfig
- instanceFleetModifyConfig :: Text -> InstanceFleetModifyConfig
- ifmcTargetOnDemandCapacity :: Lens' InstanceFleetModifyConfig (Maybe Natural)
- ifmcTargetSpotCapacity :: Lens' InstanceFleetModifyConfig (Maybe Natural)
- ifmcInstanceFleetId :: Lens' InstanceFleetModifyConfig Text
- data InstanceFleetProvisioningSpecifications
- instanceFleetProvisioningSpecifications :: SpotProvisioningSpecification -> InstanceFleetProvisioningSpecifications
- ifpsSpotSpecification :: Lens' InstanceFleetProvisioningSpecifications SpotProvisioningSpecification
- data InstanceFleetStateChangeReason
- instanceFleetStateChangeReason :: InstanceFleetStateChangeReason
- ifscrCode :: Lens' InstanceFleetStateChangeReason (Maybe InstanceFleetStateChangeReasonCode)
- ifscrMessage :: Lens' InstanceFleetStateChangeReason (Maybe Text)
- data InstanceFleetStatus
- instanceFleetStatus :: InstanceFleetStatus
- ifsState :: Lens' InstanceFleetStatus (Maybe InstanceFleetState)
- ifsStateChangeReason :: Lens' InstanceFleetStatus (Maybe InstanceFleetStateChangeReason)
- ifsTimeline :: Lens' InstanceFleetStatus (Maybe InstanceFleetTimeline)
- data InstanceFleetTimeline
- instanceFleetTimeline :: InstanceFleetTimeline
- iftReadyDateTime :: Lens' InstanceFleetTimeline (Maybe UTCTime)
- iftCreationDateTime :: Lens' InstanceFleetTimeline (Maybe UTCTime)
- iftEndDateTime :: Lens' InstanceFleetTimeline (Maybe UTCTime)
- data InstanceGroup
- instanceGroup :: InstanceGroup
- igStatus :: Lens' InstanceGroup (Maybe InstanceGroupStatus)
- igBidPrice :: Lens' InstanceGroup (Maybe Text)
- igRequestedInstanceCount :: Lens' InstanceGroup (Maybe Int)
- igRunningInstanceCount :: Lens' InstanceGroup (Maybe Int)
- igConfigurations :: Lens' InstanceGroup [Configuration]
- igInstanceGroupType :: Lens' InstanceGroup (Maybe InstanceGroupType)
- igEBSBlockDevices :: Lens' InstanceGroup [EBSBlockDevice]
- igInstanceType :: Lens' InstanceGroup (Maybe Text)
- igEBSOptimized :: Lens' InstanceGroup (Maybe Bool)
- igMarket :: Lens' InstanceGroup (Maybe MarketType)
- igName :: Lens' InstanceGroup (Maybe Text)
- igAutoScalingPolicy :: Lens' InstanceGroup (Maybe AutoScalingPolicyDescription)
- igShrinkPolicy :: Lens' InstanceGroup (Maybe ShrinkPolicy)
- igId :: Lens' InstanceGroup (Maybe Text)
- data InstanceGroupConfig
- instanceGroupConfig :: InstanceRoleType -> Text -> Int -> InstanceGroupConfig
- igcEBSConfiguration :: Lens' InstanceGroupConfig (Maybe EBSConfiguration)
- igcBidPrice :: Lens' InstanceGroupConfig (Maybe Text)
- igcConfigurations :: Lens' InstanceGroupConfig [Configuration]
- igcMarket :: Lens' InstanceGroupConfig (Maybe MarketType)
- igcName :: Lens' InstanceGroupConfig (Maybe Text)
- igcAutoScalingPolicy :: Lens' InstanceGroupConfig (Maybe AutoScalingPolicy)
- igcInstanceRole :: Lens' InstanceGroupConfig InstanceRoleType
- igcInstanceType :: Lens' InstanceGroupConfig Text
- igcInstanceCount :: Lens' InstanceGroupConfig Int
- data InstanceGroupModifyConfig
- instanceGroupModifyConfig :: Text -> InstanceGroupModifyConfig
- igmcInstanceCount :: Lens' InstanceGroupModifyConfig (Maybe Int)
- igmcEC2InstanceIdsToTerminate :: Lens' InstanceGroupModifyConfig [Text]
- igmcShrinkPolicy :: Lens' InstanceGroupModifyConfig (Maybe ShrinkPolicy)
- igmcInstanceGroupId :: Lens' InstanceGroupModifyConfig Text
- data InstanceGroupStateChangeReason
- instanceGroupStateChangeReason :: InstanceGroupStateChangeReason
- igscrCode :: Lens' InstanceGroupStateChangeReason (Maybe InstanceGroupStateChangeReasonCode)
- igscrMessage :: Lens' InstanceGroupStateChangeReason (Maybe Text)
- data InstanceGroupStatus
- instanceGroupStatus :: InstanceGroupStatus
- igsState :: Lens' InstanceGroupStatus (Maybe InstanceGroupState)
- igsStateChangeReason :: Lens' InstanceGroupStatus (Maybe InstanceGroupStateChangeReason)
- igsTimeline :: Lens' InstanceGroupStatus (Maybe InstanceGroupTimeline)
- data InstanceGroupTimeline
- instanceGroupTimeline :: InstanceGroupTimeline
- igtReadyDateTime :: Lens' InstanceGroupTimeline (Maybe UTCTime)
- igtCreationDateTime :: Lens' InstanceGroupTimeline (Maybe UTCTime)
- igtEndDateTime :: Lens' InstanceGroupTimeline (Maybe UTCTime)
- data InstanceResizePolicy
- instanceResizePolicy :: InstanceResizePolicy
- irpInstancesToProtect :: Lens' InstanceResizePolicy [Text]
- irpInstancesToTerminate :: Lens' InstanceResizePolicy [Text]
- irpInstanceTerminationTimeout :: Lens' InstanceResizePolicy (Maybe Int)
- data InstanceStateChangeReason
- instanceStateChangeReason :: InstanceStateChangeReason
- iscrCode :: Lens' InstanceStateChangeReason (Maybe InstanceStateChangeReasonCode)
- iscrMessage :: Lens' InstanceStateChangeReason (Maybe Text)
- data InstanceStatus
- instanceStatus :: InstanceStatus
- isState :: Lens' InstanceStatus (Maybe InstanceState)
- isStateChangeReason :: Lens' InstanceStatus (Maybe InstanceStateChangeReason)
- isTimeline :: Lens' InstanceStatus (Maybe InstanceTimeline)
- data InstanceTimeline
- instanceTimeline :: InstanceTimeline
- itReadyDateTime :: Lens' InstanceTimeline (Maybe UTCTime)
- itCreationDateTime :: Lens' InstanceTimeline (Maybe UTCTime)
- itEndDateTime :: Lens' InstanceTimeline (Maybe UTCTime)
- data InstanceTypeConfig
- instanceTypeConfig :: Text -> InstanceTypeConfig
- itcEBSConfiguration :: Lens' InstanceTypeConfig (Maybe EBSConfiguration)
- itcBidPrice :: Lens' InstanceTypeConfig (Maybe Text)
- itcWeightedCapacity :: Lens' InstanceTypeConfig (Maybe Natural)
- itcConfigurations :: Lens' InstanceTypeConfig [Configuration]
- itcBidPriceAsPercentageOfOnDemandPrice :: Lens' InstanceTypeConfig (Maybe Double)
- itcInstanceType :: Lens' InstanceTypeConfig Text
- data InstanceTypeSpecification
- instanceTypeSpecification :: InstanceTypeSpecification
- itsBidPrice :: Lens' InstanceTypeSpecification (Maybe Text)
- itsWeightedCapacity :: Lens' InstanceTypeSpecification (Maybe Natural)
- itsConfigurations :: Lens' InstanceTypeSpecification [Configuration]
- itsEBSBlockDevices :: Lens' InstanceTypeSpecification [EBSBlockDevice]
- itsInstanceType :: Lens' InstanceTypeSpecification (Maybe Text)
- itsEBSOptimized :: Lens' InstanceTypeSpecification (Maybe Bool)
- itsBidPriceAsPercentageOfOnDemandPrice :: Lens' InstanceTypeSpecification (Maybe Double)
- data JobFlowInstancesConfig
- jobFlowInstancesConfig :: JobFlowInstancesConfig
- jficInstanceFleets :: Lens' JobFlowInstancesConfig [InstanceFleetConfig]
- jficEC2KeyName :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficSlaveInstanceType :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficInstanceCount :: Lens' JobFlowInstancesConfig (Maybe Int)
- jficEmrManagedSlaveSecurityGroup :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficAdditionalSlaveSecurityGroups :: Lens' JobFlowInstancesConfig [Text]
- jficEC2SubnetIds :: Lens' JobFlowInstancesConfig [Text]
- jficHadoopVersion :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficAdditionalMasterSecurityGroups :: Lens' JobFlowInstancesConfig [Text]
- jficEmrManagedMasterSecurityGroup :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficEC2SubnetId :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficMasterInstanceType :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficInstanceGroups :: Lens' JobFlowInstancesConfig [InstanceGroupConfig]
- jficKeepJobFlowAliveWhenNoSteps :: Lens' JobFlowInstancesConfig (Maybe Bool)
- jficServiceAccessSecurityGroup :: Lens' JobFlowInstancesConfig (Maybe Text)
- jficTerminationProtected :: Lens' JobFlowInstancesConfig (Maybe Bool)
- jficPlacement :: Lens' JobFlowInstancesConfig (Maybe PlacementType)
- data KerberosAttributes
- kerberosAttributes :: Text -> Text -> KerberosAttributes
- kaADDomainJoinPassword :: Lens' KerberosAttributes (Maybe Text)
- kaCrossRealmTrustPrincipalPassword :: Lens' KerberosAttributes (Maybe Text)
- kaADDomainJoinUser :: Lens' KerberosAttributes (Maybe Text)
- kaRealm :: Lens' KerberosAttributes Text
- kaKdcAdminPassword :: Lens' KerberosAttributes Text
- data KeyValue
- keyValue :: KeyValue
- kvValue :: Lens' KeyValue (Maybe Text)
- kvKey :: Lens' KeyValue (Maybe Text)
- data MetricDimension
- metricDimension :: MetricDimension
- mdValue :: Lens' MetricDimension (Maybe Text)
- mdKey :: Lens' MetricDimension (Maybe Text)
- data PlacementType
- placementType :: PlacementType
- ptAvailabilityZones :: Lens' PlacementType [Text]
- ptAvailabilityZone :: Lens' PlacementType (Maybe Text)
- data ScalingAction
- scalingAction :: SimpleScalingPolicyConfiguration -> ScalingAction
- saMarket :: Lens' ScalingAction (Maybe MarketType)
- saSimpleScalingPolicyConfiguration :: Lens' ScalingAction SimpleScalingPolicyConfiguration
- data ScalingConstraints
- scalingConstraints :: Int -> Int -> ScalingConstraints
- scMinCapacity :: Lens' ScalingConstraints Int
- scMaxCapacity :: Lens' ScalingConstraints Int
- data ScalingRule
- scalingRule :: Text -> ScalingAction -> ScalingTrigger -> ScalingRule
- srDescription :: Lens' ScalingRule (Maybe Text)
- srName :: Lens' ScalingRule Text
- srAction :: Lens' ScalingRule ScalingAction
- srTrigger :: Lens' ScalingRule ScalingTrigger
- data ScalingTrigger
- scalingTrigger :: CloudWatchAlarmDefinition -> ScalingTrigger
- stCloudWatchAlarmDefinition :: Lens' ScalingTrigger CloudWatchAlarmDefinition
- data ScriptBootstrapActionConfig
- scriptBootstrapActionConfig :: Text -> ScriptBootstrapActionConfig
- sbacArgs :: Lens' ScriptBootstrapActionConfig [Text]
- sbacPath :: Lens' ScriptBootstrapActionConfig Text
- data SecurityConfigurationSummary
- securityConfigurationSummary :: SecurityConfigurationSummary
- scsName :: Lens' SecurityConfigurationSummary (Maybe Text)
- scsCreationDateTime :: Lens' SecurityConfigurationSummary (Maybe UTCTime)
- data ShrinkPolicy
- shrinkPolicy :: ShrinkPolicy
- spDecommissionTimeout :: Lens' ShrinkPolicy (Maybe Int)
- spInstanceResizePolicy :: Lens' ShrinkPolicy (Maybe InstanceResizePolicy)
- data SimpleScalingPolicyConfiguration
- simpleScalingPolicyConfiguration :: Int -> SimpleScalingPolicyConfiguration
- sspcAdjustmentType :: Lens' SimpleScalingPolicyConfiguration (Maybe AdjustmentType)
- sspcCoolDown :: Lens' SimpleScalingPolicyConfiguration (Maybe Int)
- sspcScalingAdjustment :: Lens' SimpleScalingPolicyConfiguration Int
- data SpotProvisioningSpecification
- spotProvisioningSpecification :: Natural -> SpotProvisioningTimeoutAction -> SpotProvisioningSpecification
- spsBlockDurationMinutes :: Lens' SpotProvisioningSpecification (Maybe Natural)
- spsTimeoutDurationMinutes :: Lens' SpotProvisioningSpecification Natural
- spsTimeoutAction :: Lens' SpotProvisioningSpecification SpotProvisioningTimeoutAction
- data Step
- step :: Step
- sStatus :: Lens' Step (Maybe StepStatus)
- sActionOnFailure :: Lens' Step (Maybe ActionOnFailure)
- sConfig :: Lens' Step (Maybe HadoopStepConfig)
- sName :: Lens' Step (Maybe Text)
- sId :: Lens' Step (Maybe Text)
- data StepConfig
- stepConfig :: Text -> HadoopJARStepConfig -> StepConfig
- scActionOnFailure :: Lens' StepConfig (Maybe ActionOnFailure)
- scName :: Lens' StepConfig Text
- scHadoopJARStep :: Lens' StepConfig HadoopJARStepConfig
- data StepStateChangeReason
- stepStateChangeReason :: StepStateChangeReason
- sscrCode :: Lens' StepStateChangeReason (Maybe StepStateChangeReasonCode)
- sscrMessage :: Lens' StepStateChangeReason (Maybe Text)
- data StepStatus
- stepStatus :: StepStatus
- ssState :: Lens' StepStatus (Maybe StepState)
- ssFailureDetails :: Lens' StepStatus (Maybe FailureDetails)
- ssStateChangeReason :: Lens' StepStatus (Maybe StepStateChangeReason)
- ssTimeline :: Lens' StepStatus (Maybe StepTimeline)
- data StepSummary
- stepSummary :: StepSummary
- ssStatus :: Lens' StepSummary (Maybe StepStatus)
- ssActionOnFailure :: Lens' StepSummary (Maybe ActionOnFailure)
- ssConfig :: Lens' StepSummary (Maybe HadoopStepConfig)
- ssName :: Lens' StepSummary (Maybe Text)
- ssId :: Lens' StepSummary (Maybe Text)
- data StepTimeline
- stepTimeline :: StepTimeline
- stCreationDateTime :: Lens' StepTimeline (Maybe UTCTime)
- stEndDateTime :: Lens' StepTimeline (Maybe UTCTime)
- stStartDateTime :: Lens' StepTimeline (Maybe UTCTime)
- data SupportedProductConfig
- supportedProductConfig :: SupportedProductConfig
- spcArgs :: Lens' SupportedProductConfig [Text]
- spcName :: Lens' SupportedProductConfig (Maybe Text)
- data Tag
- tag :: Tag
- tagValue :: Lens' Tag (Maybe Text)
- tagKey :: Lens' Tag (Maybe Text)
- data VolumeSpecification
- volumeSpecification :: Text -> Int -> VolumeSpecification
- vsIOPS :: Lens' VolumeSpecification (Maybe Int)
- vsVolumeType :: Lens' VolumeSpecification Text
- vsSizeInGB :: Lens' VolumeSpecification Int
Service Configuration
Errors
Error matchers are designed for use with the functions provided by
Control.Exception.Lens.
This allows catching (and rethrowing) service specific errors returned
by EMR.
InvalidRequestException
_InvalidRequestException :: AsError a => Getting (First ServiceError) a ServiceError #
This exception occurs when there is something wrong with user input.
InternalServerError
_InternalServerError :: AsError a => Getting (First ServiceError) a ServiceError #
Indicates that an error occurred while processing the request and that the request was not completed.
InternalServerException
_InternalServerException :: AsError a => Getting (First ServiceError) a ServiceError #
This exception occurs when there is an internal failure in the EMR service.
Waiters
Waiters poll by repeatedly sending a request until some remote success condition
configured by the Wait specification is fulfilled. The Wait specification
determines how many attempts should be made, in addition to delay and retry strategies.
StepComplete
stepComplete :: Wait DescribeStep #
Polls DescribeStep every 30 seconds until a successful state is reached. An error is returned after 60 failed checks.
ClusterTerminated
clusterTerminated :: Wait DescribeCluster #
Polls DescribeCluster every 30 seconds until a successful state is reached. An error is returned after 60 failed checks.
ClusterRunning
clusterRunning :: Wait DescribeCluster #
Polls DescribeCluster every 30 seconds until a successful state is reached. An error is returned after 60 failed checks.
Operations
Some AWS operations return results that are incomplete and require subsequent
requests in order to obtain the entire result set. The process of sending
subsequent requests to continue where a previous request left off is called
pagination. For example, the ListObjects operation of Amazon S3 returns up to
1000 objects at a time, and you must send subsequent requests with the
appropriate Marker in order to retrieve the next page of results.
Operations that have an AWSPager instance can transparently perform subsequent
requests, correctly setting Markers and other request facets to iterate through
the entire result set of a truncated API operation. Operations which support
this have an additional note in the documentation.
Many operations have the ability to filter results on the server side. See the individual operation parameters for details.
RunJobFlow
module Network.AWS.EMR.RunJobFlow
RemoveAutoScalingPolicy
SetVisibleToAllUsers
TerminateJobFlows
DescribeStep
module Network.AWS.EMR.DescribeStep
RemoveTags
module Network.AWS.EMR.RemoveTags
DescribeCluster
ListSecurityConfigurations
CancelSteps
module Network.AWS.EMR.CancelSteps
CreateSecurityConfiguration
SetTerminationProtection
AddJobFlowSteps
ModifyInstanceGroups
ListSteps (Paginated)
module Network.AWS.EMR.ListSteps
AddInstanceFleet
AddInstanceGroups
DeleteSecurityConfiguration
ModifyInstanceFleet
ListInstanceGroups (Paginated)
ListBootstrapActions (Paginated)
AddTags
module Network.AWS.EMR.AddTags
ListInstances (Paginated)
PutAutoScalingPolicy
ListClusters (Paginated)
module Network.AWS.EMR.ListClusters
DescribeSecurityConfiguration
ListInstanceFleets (Paginated)
Types
ActionOnFailure
data ActionOnFailure #
Constructors
| CancelAndWait | |
| Continue | |
| TerminateCluster | |
| TerminateJobFlow |
Instances
AdjustmentType
data AdjustmentType #
Constructors
| ChangeInCapacity | |
| ExactCapacity | |
| PercentChangeInCapacity |
Instances
AutoScalingPolicyState
data AutoScalingPolicyState #
Instances
AutoScalingPolicyStateChangeReasonCode
data AutoScalingPolicyStateChangeReasonCode #
Constructors
| CleanupFailure | |
| ProvisionFailure | |
| UserRequest |
Instances
CancelStepsRequestStatus
data CancelStepsRequestStatus #
Constructors
| CSRSFailed | |
| CSRSSubmitted |
Instances
ClusterState
data ClusterState #
Constructors
| CSBootstrapping | |
| CSRunning | |
| CSStarting | |
| CSTerminated | |
| CSTerminatedWithErrors | |
| CSTerminating | |
| CSWaiting |
Instances
ClusterStateChangeReasonCode
data ClusterStateChangeReasonCode #
Constructors
| CSCRCAllStepsCompleted | |
| CSCRCBootstrapFailure | |
| CSCRCInstanceFailure | |
| CSCRCInstanceFleetTimeout | |
| CSCRCInternalError | |
| CSCRCStepFailure | |
| CSCRCUserRequest | |
| CSCRCValidationError |
Instances
ComparisonOperator
data ComparisonOperator #
Constructors
| GreaterThan | |
| GreaterThanOrEqual | |
| LessThan | |
| LessThanOrEqual |
Instances
InstanceCollectionType
data InstanceCollectionType #
Constructors
| InstanceFleet | |
| InstanceGroup |
Instances
InstanceFleetState
data InstanceFleetState #
Constructors
| IFSBootstrapping | |
| IFSProvisioning | |
| IFSResizing | |
| IFSRunning | |
| IFSSuspended | |
| IFSTerminated | |
| IFSTerminating |
Instances
InstanceFleetStateChangeReasonCode
data InstanceFleetStateChangeReasonCode #
Instances
InstanceFleetType
data InstanceFleetType #
Instances
InstanceGroupState
data InstanceGroupState #
Constructors
| Arrested | |
| Bootstrapping | |
| Ended | |
| Provisioning | |
| Resizing | |
| Running | |
| ShuttingDown | |
| Suspended | |
| Terminated | |
| Terminating |
Instances
InstanceGroupStateChangeReasonCode
data InstanceGroupStateChangeReasonCode #
Constructors
| ClusterTerminated | |
| InstanceFailure | |
| InternalError | |
| ValidationError |
Instances
InstanceGroupType
data InstanceGroupType #
Instances
InstanceRoleType
data InstanceRoleType #
Instances
InstanceState
data InstanceState #
Instances
InstanceStateChangeReasonCode
data InstanceStateChangeReasonCode #
Constructors
| ISCRCBootstrapFailure | |
| ISCRCClusterTerminated | |
| ISCRCInstanceFailure | |
| ISCRCInternalError | |
| ISCRCValidationError |
Instances
MarketType
data MarketType #
Instances
RepoUpgradeOnBoot
data RepoUpgradeOnBoot #
Constructors
| RUOBNone | |
| RUOBSecurity |
Instances
ScaleDownBehavior
data ScaleDownBehavior #
Constructors
| TerminateAtInstanceHour | |
| TerminateAtTaskCompletion |
Instances
SpotProvisioningTimeoutAction
data SpotProvisioningTimeoutAction #
Constructors
| SPTASwitchToOnDemand | |
| SPTATerminateCluster |
Instances
Statistic
Constructors
| Average | |
| Maximum | |
| Minimum | |
| SampleCount | |
| Sum |
Instances
StepState
Instances
StepStateChangeReasonCode
data StepStateChangeReasonCode #
Constructors
| SSCRCNone |
Instances
Unit
Constructors
Instances
| Bounded Unit # | |
| Enum Unit # | |
| Eq Unit # | |
| Data Unit # | |
Defined in Network.AWS.EMR.Types.Sum Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> Unit -> c Unit # gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c Unit # dataTypeOf :: Unit -> DataType # dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c Unit) # dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c Unit) # gmapT :: (forall b. Data b => b -> b) -> Unit -> Unit # gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> Unit -> r # gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> Unit -> r # gmapQ :: (forall d. Data d => d -> u) -> Unit -> [u] # gmapQi :: Int -> (forall d. Data d => d -> u) -> Unit -> u # gmapM :: Monad m => (forall d. Data d => d -> m d) -> Unit -> m Unit # gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> Unit -> m Unit # gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> Unit -> m Unit # | |
| Ord Unit # | |
| Read Unit # | |
| Show Unit # | |
| Generic Unit # | |
| Hashable Unit # | |
Defined in Network.AWS.EMR.Types.Sum | |
| ToJSON Unit # | |
Defined in Network.AWS.EMR.Types.Sum | |
| FromJSON Unit # | |
| ToHeader Unit # | |
Defined in Network.AWS.EMR.Types.Sum Methods toHeader :: HeaderName -> Unit -> [Header] # | |
| ToQuery Unit # | |
Defined in Network.AWS.EMR.Types.Sum Methods toQuery :: Unit -> QueryString # | |
| ToByteString Unit # | |
Defined in Network.AWS.EMR.Types.Sum Methods toBS :: Unit -> ByteString # | |
| FromText Unit # | |
Defined in Network.AWS.EMR.Types.Sum | |
| ToText Unit # | |
Defined in Network.AWS.EMR.Types.Sum | |
| NFData Unit # | |
Defined in Network.AWS.EMR.Types.Sum | |
| type Rep Unit # | |
Defined in Network.AWS.EMR.Types.Sum type Rep Unit = D1 (MetaData "Unit" "Network.AWS.EMR.Types.Sum" "amazonka-emr-1.6.0-FYKfcui3Ox72PqQzDiwDXJ" False) ((((C1 (MetaCons "Bits" PrefixI False) (U1 :: * -> *) :+: (C1 (MetaCons "BitsPerSecond" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "Bytes" PrefixI False) (U1 :: * -> *))) :+: (C1 (MetaCons "BytesPerSecond" PrefixI False) (U1 :: * -> *) :+: (C1 (MetaCons "Count" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "CountPerSecond" PrefixI False) (U1 :: * -> *)))) :+: ((C1 (MetaCons "GigaBits" PrefixI False) (U1 :: * -> *) :+: (C1 (MetaCons "GigaBitsPerSecond" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "GigaBytes" PrefixI False) (U1 :: * -> *))) :+: ((C1 (MetaCons "GigaBytesPerSecond" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "KiloBits" PrefixI False) (U1 :: * -> *)) :+: (C1 (MetaCons "KiloBitsPerSecond" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "KiloBytes" PrefixI False) (U1 :: * -> *))))) :+: (((C1 (MetaCons "KiloBytesPerSecond" PrefixI False) (U1 :: * -> *) :+: (C1 (MetaCons "MegaBits" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "MegaBitsPerSecond" PrefixI False) (U1 :: * -> *))) :+: ((C1 (MetaCons "MegaBytes" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "MegaBytesPerSecond" PrefixI False) (U1 :: * -> *)) :+: (C1 (MetaCons "MicroSeconds" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "MilliSeconds" PrefixI False) (U1 :: * -> *)))) :+: ((C1 (MetaCons "None" PrefixI False) (U1 :: * -> *) :+: (C1 (MetaCons "Percent" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "Seconds" PrefixI False) (U1 :: * -> *))) :+: ((C1 (MetaCons "TeraBits" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "TeraBitsPerSecond" PrefixI False) (U1 :: * -> *)) :+: (C1 (MetaCons "TeraBytes" PrefixI False) (U1 :: * -> *) :+: C1 (MetaCons "TeraBytesPerSecond" PrefixI False) (U1 :: * -> *)))))) | |
Application
data Application #
An application is any Amazon or third-party software that you can add to the cluster. This structure contains a list of strings that indicates the software to use with the cluster and accepts a user argument list. Amazon EMR accepts and forwards the argument list to the corresponding installation script as bootstrap action argument. For more information, see Using the MapR Distribution for Hadoop . Currently supported values are:
- "mapr-m3" - launch the cluster using MapR M3 Edition.
- "mapr-m5" - launch the cluster using MapR M5 Edition.
- "mapr" with the user arguments specifying "--edition,m3" or "--edition,m5" - launch the cluster using MapR M3 or M5 Edition, respectively.
See: application smart constructor.
Instances
Creates a value of Application with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
aArgs- Arguments for Amazon EMR to pass to the application.aAdditionalInfo- This option is for advanced users only. This is meta information about third-party applications that third-party vendors use for testing purposes.aName- The name of the application.aVersion- The version of the application.
aArgs :: Lens' Application [Text] #
Arguments for Amazon EMR to pass to the application.
aAdditionalInfo :: Lens' Application (HashMap Text Text) #
This option is for advanced users only. This is meta information about third-party applications that third-party vendors use for testing purposes.
AutoScalingPolicy
data AutoScalingPolicy #
An automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster. An automatic scaling policy defines how an instance group dynamically adds and terminates EC2 instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy .
See: autoScalingPolicy smart constructor.
Instances
Arguments
| :: ScalingConstraints | |
| -> AutoScalingPolicy |
Creates a value of AutoScalingPolicy with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
aspConstraints- The upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activity will not cause an instance group to grow above or below these limits.aspRules- The scale-in and scale-out rules that comprise the automatic scaling policy.
aspConstraints :: Lens' AutoScalingPolicy ScalingConstraints #
The upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activity will not cause an instance group to grow above or below these limits.
aspRules :: Lens' AutoScalingPolicy [ScalingRule] #
The scale-in and scale-out rules that comprise the automatic scaling policy.
AutoScalingPolicyDescription
data AutoScalingPolicyDescription #
An automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster. The automatic scaling policy defines how an instance group dynamically adds and terminates EC2 instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy .
See: autoScalingPolicyDescription smart constructor.
Instances
autoScalingPolicyDescription :: AutoScalingPolicyDescription #
Creates a value of AutoScalingPolicyDescription with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
aspdStatus- The status of an automatic scaling policy.aspdRules- The scale-in and scale-out rules that comprise the automatic scaling policy.aspdConstraints- The upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activity will not cause an instance group to grow above or below these limits.
aspdStatus :: Lens' AutoScalingPolicyDescription (Maybe AutoScalingPolicyStatus) #
The status of an automatic scaling policy.
aspdRules :: Lens' AutoScalingPolicyDescription [ScalingRule] #
The scale-in and scale-out rules that comprise the automatic scaling policy.
aspdConstraints :: Lens' AutoScalingPolicyDescription (Maybe ScalingConstraints) #
The upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activity will not cause an instance group to grow above or below these limits.
AutoScalingPolicyStateChangeReason
data AutoScalingPolicyStateChangeReason #
The reason for an AutoScalingPolicyStatus change.
See: autoScalingPolicyStateChangeReason smart constructor.
Instances
autoScalingPolicyStateChangeReason :: AutoScalingPolicyStateChangeReason #
Creates a value of AutoScalingPolicyStateChangeReason with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
aspscrCode- The code indicating the reason for the change in status.USER_REQUESTindicates that the scaling policy status was changed by a user.PROVISION_FAILUREindicates that the status change was because the policy failed to provision.CLEANUP_FAILUREindicates an error.aspscrMessage- A friendly, more verbose message that accompanies an automatic scaling policy state change.
aspscrCode :: Lens' AutoScalingPolicyStateChangeReason (Maybe AutoScalingPolicyStateChangeReasonCode) #
The code indicating the reason for the change in status.USER_REQUEST indicates that the scaling policy status was changed by a user. PROVISION_FAILURE indicates that the status change was because the policy failed to provision. CLEANUP_FAILURE indicates an error.
aspscrMessage :: Lens' AutoScalingPolicyStateChangeReason (Maybe Text) #
A friendly, more verbose message that accompanies an automatic scaling policy state change.
AutoScalingPolicyStatus
data AutoScalingPolicyStatus #
The status of an automatic scaling policy.
See: autoScalingPolicyStatus smart constructor.
Instances
autoScalingPolicyStatus :: AutoScalingPolicyStatus #
Creates a value of AutoScalingPolicyStatus with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
aspsState- Indicates the status of the automatic scaling policy.aspsStateChangeReason- The reason for a change in status.
aspsState :: Lens' AutoScalingPolicyStatus (Maybe AutoScalingPolicyState) #
Indicates the status of the automatic scaling policy.
aspsStateChangeReason :: Lens' AutoScalingPolicyStatus (Maybe AutoScalingPolicyStateChangeReason) #
The reason for a change in status.
BootstrapActionConfig
data BootstrapActionConfig #
Configuration of a bootstrap action.
See: bootstrapActionConfig smart constructor.
Instances
Arguments
| :: Text | |
| -> ScriptBootstrapActionConfig | |
| -> BootstrapActionConfig |
Creates a value of BootstrapActionConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
bacName- The name of the bootstrap action.bacScriptBootstrapAction- The script run by the bootstrap action.
bacName :: Lens' BootstrapActionConfig Text #
The name of the bootstrap action.
bacScriptBootstrapAction :: Lens' BootstrapActionConfig ScriptBootstrapActionConfig #
The script run by the bootstrap action.
CancelStepsInfo
data CancelStepsInfo #
Specification of the status of a CancelSteps request. Available only in Amazon EMR version 4.8.0 and later, excluding version 5.0.0.
See: cancelStepsInfo smart constructor.
Instances
cancelStepsInfo :: CancelStepsInfo #
Creates a value of CancelStepsInfo with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
csiStatus :: Lens' CancelStepsInfo (Maybe CancelStepsRequestStatus) #
The status of a CancelSteps Request. The value may be SUBMITTED or FAILED.
csiReason :: Lens' CancelStepsInfo (Maybe Text) #
The reason for the failure if the CancelSteps request fails.
CloudWatchAlarmDefinition
data CloudWatchAlarmDefinition #
The definition of a CloudWatch metric alarm, which determines when an automatic scaling activity is triggered. When the defined alarm conditions are satisfied, scaling activity begins.
See: cloudWatchAlarmDefinition smart constructor.
Instances
Arguments
| :: ComparisonOperator | |
| -> Text | |
| -> Int | |
| -> Double | |
| -> CloudWatchAlarmDefinition |
Creates a value of CloudWatchAlarmDefinition with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
cwadEvaluationPeriods- The number of periods, expressed in seconds usingPeriod, during which the alarm condition must exist before the alarm triggers automatic scaling activity. The default value is1.cwadNamespace- The namespace for the CloudWatch metric. The default isAWS/ElasticMapReduce.cwadDimensions- A CloudWatch metric dimension.cwadUnit- The unit of measure associated with the CloudWatch metric being watched. The value specified forUnitmust correspond to the units specified in the CloudWatch metric.cwadStatistic- The statistic to apply to the metric associated with the alarm. The default isAVERAGE.cwadComparisonOperator- Determines how the metric specified byMetricNameis compared to the value specified byThreshold.cwadMetricName- The name of the CloudWatch metric that is watched to determine an alarm condition.cwadPeriod- The period, in seconds, over which the statistic is applied. EMR CloudWatch metrics are emitted every five minutes (300 seconds), so if an EMR CloudWatch metric is specified, specify300.cwadThreshold- The value against which the specified statistic is compared.
cwadEvaluationPeriods :: Lens' CloudWatchAlarmDefinition (Maybe Int) #
The number of periods, expressed in seconds using Period , during which the alarm condition must exist before the alarm triggers automatic scaling activity. The default value is 1 .
cwadNamespace :: Lens' CloudWatchAlarmDefinition (Maybe Text) #
The namespace for the CloudWatch metric. The default is AWS/ElasticMapReduce .
cwadDimensions :: Lens' CloudWatchAlarmDefinition [MetricDimension] #
A CloudWatch metric dimension.
cwadUnit :: Lens' CloudWatchAlarmDefinition (Maybe Unit) #
The unit of measure associated with the CloudWatch metric being watched. The value specified for Unit must correspond to the units specified in the CloudWatch metric.
cwadStatistic :: Lens' CloudWatchAlarmDefinition (Maybe Statistic) #
The statistic to apply to the metric associated with the alarm. The default is AVERAGE .
cwadComparisonOperator :: Lens' CloudWatchAlarmDefinition ComparisonOperator #
Determines how the metric specified by MetricName is compared to the value specified by Threshold .
cwadMetricName :: Lens' CloudWatchAlarmDefinition Text #
The name of the CloudWatch metric that is watched to determine an alarm condition.
cwadPeriod :: Lens' CloudWatchAlarmDefinition Int #
The period, in seconds, over which the statistic is applied. EMR CloudWatch metrics are emitted every five minutes (300 seconds), so if an EMR CloudWatch metric is specified, specify 300 .
cwadThreshold :: Lens' CloudWatchAlarmDefinition Double #
The value against which the specified statistic is compared.
Cluster
The detailed description of the cluster.
See: cluster smart constructor.
Instances
Creates a value of Cluster with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
cluRequestedAMIVersion- The AMI version requested for this cluster.cluEBSRootVolumeSize- The size, in GiB, of the EBS root device volume of the Linux AMI that is used for each EC2 instance. Available in Amazon EMR version 4.x and later.cluEC2InstanceAttributes- Provides information about the EC2 instances in a cluster grouped by category. For example, key name, subnet ID, IAM instance profile, and so on.cluNormalizedInstanceHours- An approximation of the cost of the cluster, represented in m1.small/hours. This value is incremented one time for every hour an m1.small instance runs. Larger instances are weighted more, so an EC2 instance that is roughly four times more expensive would result in the normalized instance hours being incremented by four. This result is only an approximation and does not reflect the actual billing rate.cluConfigurations- Applies only to Amazon EMR releases 4.x and later. The list of Configurations supplied to the EMR cluster.cluCustomAMIId- Available only in Amazon EMR version 5.7.0 and later. The ID of a custom Amazon EBS-backed Linux AMI if the cluster uses a custom AMI.cluAutoScalingRole- An IAM role for automatic scaling policies. The default role isEMR_AutoScaling_DefaultRole. The IAM role provides permissions that the automatic scaling feature requires to launch and terminate EC2 instances in an instance group.cluSecurityConfiguration- The name of the security configuration applied to the cluster.cluScaleDownBehavior- The way that individual Amazon EC2 instances terminate when an automatic scale-in activity occurs or an instance group is resized.TERMINATE_AT_INSTANCE_HOURindicates that Amazon EMR terminates nodes at the instance-hour boundary, regardless of when the request to terminate the instance was submitted. This option is only available with Amazon EMR 5.1.0 and later and is the default for clusters created using that version.TERMINATE_AT_TASK_COMPLETIONindicates that Amazon EMR blacklists and drains tasks from nodes before terminating the Amazon EC2 instances, regardless of the instance-hour boundary. With either behavior, Amazon EMR removes the least active nodes first and blocks instance termination if it could lead to HDFS corruption.TERMINATE_AT_TASK_COMPLETIONis available only in Amazon EMR version 4.1.0 and later, and is the default for versions of Amazon EMR earlier than 5.1.0.cluInstanceCollectionType- The instance group configuration of the cluster. A value ofINSTANCE_GROUPindicates a uniform instance group configuration. A value ofINSTANCE_FLEETindicates an instance fleets configuration.cluReleaseLabel- The release label for the Amazon EMR release.cluRepoUpgradeOnBoot- Applies only whenCustomAmiIDis used. Specifies the type of updates that are applied from the Amazon Linux AMI package repositories when an instance boots using the AMI.cluLogURI- The path to the Amazon S3 location where logs for this cluster are stored.cluKerberosAttributes- Attributes for Kerberos configuration when Kerberos authentication is enabled using a security configuration. For more information see Use Kerberos Authentication in the EMR Management Guide .cluRunningAMIVersion- The AMI version running on this cluster.cluMasterPublicDNSName- The DNS name of the master node. If the cluster is on a private subnet, this is the private DNS name. On a public subnet, this is the public DNS name.cluTerminationProtected- Indicates whether Amazon EMR will lock the cluster to prevent the EC2 instances from being terminated by an API call or user intervention, or in the event of a cluster error.cluVisibleToAllUsers- Indicates whether the cluster is visible to all IAM users of the AWS account associated with the cluster. If this value is set totrue, all IAM users of that AWS account can view and manage the cluster if they have the proper policy permissions set. If this value isfalse, only the IAM user that created the cluster can view and manage it. This value can be changed using theSetVisibleToAllUsersaction.cluAutoTerminate- Specifies whether the cluster should terminate after completing all steps.cluApplications- The applications installed on this cluster.cluTags- A list of tags associated with a cluster.cluServiceRole- The IAM role that will be assumed by the Amazon EMR service to access AWS resources on your behalf.cluId- The unique identifier for the cluster.cluName- The name of the cluster.cluStatus- The current status details about the cluster.
cluEBSRootVolumeSize :: Lens' Cluster (Maybe Int) #
The size, in GiB, of the EBS root device volume of the Linux AMI that is used for each EC2 instance. Available in Amazon EMR version 4.x and later.
cluEC2InstanceAttributes :: Lens' Cluster (Maybe EC2InstanceAttributes) #
Provides information about the EC2 instances in a cluster grouped by category. For example, key name, subnet ID, IAM instance profile, and so on.
cluNormalizedInstanceHours :: Lens' Cluster (Maybe Int) #
An approximation of the cost of the cluster, represented in m1.small/hours. This value is incremented one time for every hour an m1.small instance runs. Larger instances are weighted more, so an EC2 instance that is roughly four times more expensive would result in the normalized instance hours being incremented by four. This result is only an approximation and does not reflect the actual billing rate.
cluConfigurations :: Lens' Cluster [Configuration] #
Applies only to Amazon EMR releases 4.x and later. The list of Configurations supplied to the EMR cluster.
cluCustomAMIId :: Lens' Cluster (Maybe Text) #
Available only in Amazon EMR version 5.7.0 and later. The ID of a custom Amazon EBS-backed Linux AMI if the cluster uses a custom AMI.
cluAutoScalingRole :: Lens' Cluster (Maybe Text) #
An IAM role for automatic scaling policies. The default role is EMR_AutoScaling_DefaultRole . The IAM role provides permissions that the automatic scaling feature requires to launch and terminate EC2 instances in an instance group.
cluSecurityConfiguration :: Lens' Cluster (Maybe Text) #
The name of the security configuration applied to the cluster.
cluScaleDownBehavior :: Lens' Cluster (Maybe ScaleDownBehavior) #
The way that individual Amazon EC2 instances terminate when an automatic scale-in activity occurs or an instance group is resized. TERMINATE_AT_INSTANCE_HOUR indicates that Amazon EMR terminates nodes at the instance-hour boundary, regardless of when the request to terminate the instance was submitted. This option is only available with Amazon EMR 5.1.0 and later and is the default for clusters created using that version. TERMINATE_AT_TASK_COMPLETION indicates that Amazon EMR blacklists and drains tasks from nodes before terminating the Amazon EC2 instances, regardless of the instance-hour boundary. With either behavior, Amazon EMR removes the least active nodes first and blocks instance termination if it could lead to HDFS corruption. TERMINATE_AT_TASK_COMPLETION is available only in Amazon EMR version 4.1.0 and later, and is the default for versions of Amazon EMR earlier than 5.1.0.
cluInstanceCollectionType :: Lens' Cluster (Maybe InstanceCollectionType) #
The instance group configuration of the cluster. A value of INSTANCE_GROUP indicates a uniform instance group configuration. A value of INSTANCE_FLEET indicates an instance fleets configuration.
cluRepoUpgradeOnBoot :: Lens' Cluster (Maybe RepoUpgradeOnBoot) #
Applies only when CustomAmiID is used. Specifies the type of updates that are applied from the Amazon Linux AMI package repositories when an instance boots using the AMI.
cluLogURI :: Lens' Cluster (Maybe Text) #
The path to the Amazon S3 location where logs for this cluster are stored.
cluKerberosAttributes :: Lens' Cluster (Maybe KerberosAttributes) #
Attributes for Kerberos configuration when Kerberos authentication is enabled using a security configuration. For more information see Use Kerberos Authentication in the EMR Management Guide .
cluMasterPublicDNSName :: Lens' Cluster (Maybe Text) #
The DNS name of the master node. If the cluster is on a private subnet, this is the private DNS name. On a public subnet, this is the public DNS name.
cluTerminationProtected :: Lens' Cluster (Maybe Bool) #
Indicates whether Amazon EMR will lock the cluster to prevent the EC2 instances from being terminated by an API call or user intervention, or in the event of a cluster error.
cluVisibleToAllUsers :: Lens' Cluster (Maybe Bool) #
Indicates whether the cluster is visible to all IAM users of the AWS account associated with the cluster. If this value is set to true , all IAM users of that AWS account can view and manage the cluster if they have the proper policy permissions set. If this value is false , only the IAM user that created the cluster can view and manage it. This value can be changed using the SetVisibleToAllUsers action.
cluAutoTerminate :: Lens' Cluster (Maybe Bool) #
Specifies whether the cluster should terminate after completing all steps.
cluApplications :: Lens' Cluster [Application] #
The applications installed on this cluster.
cluServiceRole :: Lens' Cluster (Maybe Text) #
The IAM role that will be assumed by the Amazon EMR service to access AWS resources on your behalf.
cluStatus :: Lens' Cluster ClusterStatus #
The current status details about the cluster.
ClusterStateChangeReason
data ClusterStateChangeReason #
The reason that the cluster changed to its current state.
See: clusterStateChangeReason smart constructor.
Instances
clusterStateChangeReason :: ClusterStateChangeReason #
Creates a value of ClusterStateChangeReason with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
cscrCode- The programmatic code for the state change reason.cscrMessage- The descriptive message for the state change reason.
cscrCode :: Lens' ClusterStateChangeReason (Maybe ClusterStateChangeReasonCode) #
The programmatic code for the state change reason.
cscrMessage :: Lens' ClusterStateChangeReason (Maybe Text) #
The descriptive message for the state change reason.
ClusterStatus
data ClusterStatus #
The detailed status of the cluster.
See: clusterStatus smart constructor.
Instances
clusterStatus :: ClusterStatus #
Creates a value of ClusterStatus with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
csState- The current state of the cluster.csStateChangeReason- The reason for the cluster status change.csTimeline- A timeline that represents the status of a cluster over the lifetime of the cluster.
csState :: Lens' ClusterStatus (Maybe ClusterState) #
The current state of the cluster.
csStateChangeReason :: Lens' ClusterStatus (Maybe ClusterStateChangeReason) #
The reason for the cluster status change.
csTimeline :: Lens' ClusterStatus (Maybe ClusterTimeline) #
A timeline that represents the status of a cluster over the lifetime of the cluster.
ClusterSummary
data ClusterSummary #
The summary description of the cluster.
See: clusterSummary smart constructor.
Instances
clusterSummary :: ClusterSummary #
Creates a value of ClusterSummary with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
csStatus- The details about the current status of the cluster.csNormalizedInstanceHours- An approximation of the cost of the cluster, represented in m1.small/hours. This value is incremented one time for every hour an m1.small instance runs. Larger instances are weighted more, so an EC2 instance that is roughly four times more expensive would result in the normalized instance hours being incremented by four. This result is only an approximation and does not reflect the actual billing rate.csName- The name of the cluster.csId- The unique identifier for the cluster.
csStatus :: Lens' ClusterSummary (Maybe ClusterStatus) #
The details about the current status of the cluster.
csNormalizedInstanceHours :: Lens' ClusterSummary (Maybe Int) #
An approximation of the cost of the cluster, represented in m1.small/hours. This value is incremented one time for every hour an m1.small instance runs. Larger instances are weighted more, so an EC2 instance that is roughly four times more expensive would result in the normalized instance hours being incremented by four. This result is only an approximation and does not reflect the actual billing rate.
ClusterTimeline
data ClusterTimeline #
Represents the timeline of the cluster's lifecycle.
See: clusterTimeline smart constructor.
Instances
clusterTimeline :: ClusterTimeline #
Creates a value of ClusterTimeline with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ctReadyDateTime- The date and time when the cluster was ready to execute steps.ctCreationDateTime- The creation date and time of the cluster.ctEndDateTime- The date and time when the cluster was terminated.
ctReadyDateTime :: Lens' ClusterTimeline (Maybe UTCTime) #
The date and time when the cluster was ready to execute steps.
ctCreationDateTime :: Lens' ClusterTimeline (Maybe UTCTime) #
The creation date and time of the cluster.
ctEndDateTime :: Lens' ClusterTimeline (Maybe UTCTime) #
The date and time when the cluster was terminated.
Command
An entity describing an executable that runs on a cluster.
See: command smart constructor.
Instances
| Eq Command # | |
| Data Command # | |
Defined in Network.AWS.EMR.Types.Product Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> Command -> c Command # gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c Command # toConstr :: Command -> Constr # dataTypeOf :: Command -> DataType # dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c Command) # dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c Command) # gmapT :: (forall b. Data b => b -> b) -> Command -> Command # gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> Command -> r # gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> Command -> r # gmapQ :: (forall d. Data d => d -> u) -> Command -> [u] # gmapQi :: Int -> (forall d. Data d => d -> u) -> Command -> u # gmapM :: Monad m => (forall d. Data d => d -> m d) -> Command -> m Command # gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> Command -> m Command # gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> Command -> m Command # | |
| Read Command # | |
| Show Command # | |
| Generic Command # | |
| Hashable Command # | |
Defined in Network.AWS.EMR.Types.Product | |
| FromJSON Command # | |
| NFData Command # | |
Defined in Network.AWS.EMR.Types.Product | |
| type Rep Command # | |
Defined in Network.AWS.EMR.Types.Product type Rep Command = D1 (MetaData "Command" "Network.AWS.EMR.Types.Product" "amazonka-emr-1.6.0-FYKfcui3Ox72PqQzDiwDXJ" False) (C1 (MetaCons "Command'" PrefixI True) (S1 (MetaSel (Just "_cArgs") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 (MetaSel (Just "_cScriptPath") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)) :*: S1 (MetaSel (Just "_cName") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text))))) | |
Creates a value of Command with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
cArgs- Arguments for Amazon EMR to pass to the command for execution.cScriptPath- The Amazon S3 location of the command script.cName- The name of the command.
Configuration
data Configuration #
An optional configuration specification to be used when provisioning cluster instances, which can include configurations for applications and software bundled with Amazon EMR. A configuration consists of a classification, properties, and optional nested configurations. A classification refers to an application-specific configuration file. Properties are the settings you want to change in that file. For more information, see Configuring Applications .
See: configuration smart constructor.
Instances
configuration :: Configuration #
Creates a value of Configuration with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
cConfigurations- A list of additional configurations to apply within a configuration object.cClassification- The classification within a configuration.cProperties- A set of properties specified within a configuration classification.
cConfigurations :: Lens' Configuration [Configuration] #
A list of additional configurations to apply within a configuration object.
cClassification :: Lens' Configuration (Maybe Text) #
The classification within a configuration.
cProperties :: Lens' Configuration (HashMap Text Text) #
A set of properties specified within a configuration classification.
EBSBlockDevice
data EBSBlockDevice #
Configuration of requested EBS block device associated with the instance group.
See: ebsBlockDevice smart constructor.
Instances
ebsBlockDevice :: EBSBlockDevice #
Creates a value of EBSBlockDevice with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ebdDevice- The device name that is exposed to the instance, such as devsdh.ebdVolumeSpecification- EBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for the EBS volume attached to an EC2 instance in the cluster.
ebdDevice :: Lens' EBSBlockDevice (Maybe Text) #
The device name that is exposed to the instance, such as devsdh.
ebdVolumeSpecification :: Lens' EBSBlockDevice (Maybe VolumeSpecification) #
EBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for the EBS volume attached to an EC2 instance in the cluster.
EBSBlockDeviceConfig
data EBSBlockDeviceConfig #
Configuration of requested EBS block device associated with the instance group with count of volumes that will be associated to every instance.
See: ebsBlockDeviceConfig smart constructor.
Instances
Creates a value of EBSBlockDeviceConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ebdcVolumesPerInstance- Number of EBS volumes with a specific volume configuration that will be associated with every instance in the instance groupebdcVolumeSpecification- EBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for the EBS volume attached to an EC2 instance in the cluster.
ebdcVolumesPerInstance :: Lens' EBSBlockDeviceConfig (Maybe Int) #
Number of EBS volumes with a specific volume configuration that will be associated with every instance in the instance group
ebdcVolumeSpecification :: Lens' EBSBlockDeviceConfig VolumeSpecification #
EBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for the EBS volume attached to an EC2 instance in the cluster.
EBSConfiguration
data EBSConfiguration #
The Amazon EBS configuration of a cluster instance.
See: ebsConfiguration smart constructor.
Instances
ebsConfiguration :: EBSConfiguration #
Creates a value of EBSConfiguration with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ecEBSOptimized- Indicates whether an Amazon EBS volume is EBS-optimized.ecEBSBlockDeviceConfigs- An array of Amazon EBS volume specifications attached to a cluster instance.
ecEBSOptimized :: Lens' EBSConfiguration (Maybe Bool) #
Indicates whether an Amazon EBS volume is EBS-optimized.
ecEBSBlockDeviceConfigs :: Lens' EBSConfiguration [EBSBlockDeviceConfig] #
An array of Amazon EBS volume specifications attached to a cluster instance.
EBSVolume
EBS block device that's attached to an EC2 instance.
See: ebsVolume smart constructor.
Instances
| Eq EBSVolume # | |
| Data EBSVolume # | |
Defined in Network.AWS.EMR.Types.Product Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> EBSVolume -> c EBSVolume # gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c EBSVolume # toConstr :: EBSVolume -> Constr # dataTypeOf :: EBSVolume -> DataType # dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c EBSVolume) # dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c EBSVolume) # gmapT :: (forall b. Data b => b -> b) -> EBSVolume -> EBSVolume # gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> EBSVolume -> r # gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> EBSVolume -> r # gmapQ :: (forall d. Data d => d -> u) -> EBSVolume -> [u] # gmapQi :: Int -> (forall d. Data d => d -> u) -> EBSVolume -> u # gmapM :: Monad m => (forall d. Data d => d -> m d) -> EBSVolume -> m EBSVolume # gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> EBSVolume -> m EBSVolume # gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> EBSVolume -> m EBSVolume # | |
| Read EBSVolume # | |
| Show EBSVolume # | |
| Generic EBSVolume # | |
| Hashable EBSVolume # | |
Defined in Network.AWS.EMR.Types.Product | |
| FromJSON EBSVolume # | |
| NFData EBSVolume # | |
Defined in Network.AWS.EMR.Types.Product | |
| type Rep EBSVolume # | |
Defined in Network.AWS.EMR.Types.Product type Rep EBSVolume = D1 (MetaData "EBSVolume" "Network.AWS.EMR.Types.Product" "amazonka-emr-1.6.0-FYKfcui3Ox72PqQzDiwDXJ" False) (C1 (MetaCons "EBSVolume'" PrefixI True) (S1 (MetaSel (Just "_evDevice") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)) :*: S1 (MetaSel (Just "_evVolumeId") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)))) | |
Creates a value of EBSVolume with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
evDevice- The device name that is exposed to the instance, such as devsdh.evVolumeId- The volume identifier of the EBS volume.
evDevice :: Lens' EBSVolume (Maybe Text) #
The device name that is exposed to the instance, such as devsdh.
EC2InstanceAttributes
data EC2InstanceAttributes #
Provides information about the EC2 instances in a cluster grouped by category. For example, key name, subnet ID, IAM instance profile, and so on.
See: ec2InstanceAttributes smart constructor.
Instances
ec2InstanceAttributes :: EC2InstanceAttributes #
Creates a value of EC2InstanceAttributes with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
eiaEC2KeyName- The name of the Amazon EC2 key pair to use when connecting with SSH into the master node as a user named "hadoop".eiaEmrManagedSlaveSecurityGroup- The identifier of the Amazon EC2 security group for the slave nodes.eiaAdditionalSlaveSecurityGroups- A list of additional Amazon EC2 security group IDs for the slave nodes.eiaRequestedEC2SubnetIds- Applies to clusters configured with the instance fleets option. Specifies the unique identifier of one or more Amazon EC2 subnets in which to launch EC2 cluster instances. Subnets must exist within the same VPC. Amazon EMR chooses the EC2 subnet with the best fit from among the list ofRequestedEc2SubnetIds, and then launches all cluster instances within that Subnet. If this value is not specified, and the account and region support EC2-Classic networks, the cluster launches instances in the EC2-Classic network and usesRequestedEc2AvailabilityZonesinstead of this setting. If EC2-Classic is not supported, and no Subnet is specified, Amazon EMR chooses the subnet for you.RequestedEc2SubnetIDsandRequestedEc2AvailabilityZonescannot be specified together.eiaAdditionalMasterSecurityGroups- A list of additional Amazon EC2 security group IDs for the master node.eiaIAMInstanceProfile- The IAM role that was specified when the cluster was launched. The EC2 instances of the cluster assume this role.eiaEmrManagedMasterSecurityGroup- The identifier of the Amazon EC2 security group for the master node.eiaEC2SubnetId- To launch the cluster in Amazon VPC, set this parameter to the identifier of the Amazon VPC subnet where you want the cluster to launch. If you do not specify this value, the cluster is launched in the normal AWS cloud, outside of a VPC. Amazon VPC currently does not support cluster compute quadruple extra large (cc1.4xlarge) instances. Thus, you cannot specify the cc1.4xlarge instance type for nodes of a cluster launched in a VPC.eiaRequestedEC2AvailabilityZones- Applies to clusters configured with the instance fleets option. Specifies one or more Availability Zones in which to launch EC2 cluster instances when the EC2-Classic network configuration is supported. Amazon EMR chooses the Availability Zone with the best fit from among the list ofRequestedEc2AvailabilityZones, and then launches all cluster instances within that Availability Zone. If you do not specify this value, Amazon EMR chooses the Availability Zone for you.RequestedEc2SubnetIDsandRequestedEc2AvailabilityZonescannot be specified together.eiaServiceAccessSecurityGroup- The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters in VPC private subnets.eiaEC2AvailabilityZone- The Availability Zone in which the cluster will run.
eiaEC2KeyName :: Lens' EC2InstanceAttributes (Maybe Text) #
The name of the Amazon EC2 key pair to use when connecting with SSH into the master node as a user named "hadoop".
eiaEmrManagedSlaveSecurityGroup :: Lens' EC2InstanceAttributes (Maybe Text) #
The identifier of the Amazon EC2 security group for the slave nodes.
eiaAdditionalSlaveSecurityGroups :: Lens' EC2InstanceAttributes [Text] #
A list of additional Amazon EC2 security group IDs for the slave nodes.
eiaRequestedEC2SubnetIds :: Lens' EC2InstanceAttributes [Text] #
Applies to clusters configured with the instance fleets option. Specifies the unique identifier of one or more Amazon EC2 subnets in which to launch EC2 cluster instances. Subnets must exist within the same VPC. Amazon EMR chooses the EC2 subnet with the best fit from among the list of RequestedEc2SubnetIds , and then launches all cluster instances within that Subnet. If this value is not specified, and the account and region support EC2-Classic networks, the cluster launches instances in the EC2-Classic network and uses RequestedEc2AvailabilityZones instead of this setting. If EC2-Classic is not supported, and no Subnet is specified, Amazon EMR chooses the subnet for you. RequestedEc2SubnetIDs and RequestedEc2AvailabilityZones cannot be specified together.
eiaAdditionalMasterSecurityGroups :: Lens' EC2InstanceAttributes [Text] #
A list of additional Amazon EC2 security group IDs for the master node.
eiaIAMInstanceProfile :: Lens' EC2InstanceAttributes (Maybe Text) #
The IAM role that was specified when the cluster was launched. The EC2 instances of the cluster assume this role.
eiaEmrManagedMasterSecurityGroup :: Lens' EC2InstanceAttributes (Maybe Text) #
The identifier of the Amazon EC2 security group for the master node.
eiaEC2SubnetId :: Lens' EC2InstanceAttributes (Maybe Text) #
To launch the cluster in Amazon VPC, set this parameter to the identifier of the Amazon VPC subnet where you want the cluster to launch. If you do not specify this value, the cluster is launched in the normal AWS cloud, outside of a VPC. Amazon VPC currently does not support cluster compute quadruple extra large (cc1.4xlarge) instances. Thus, you cannot specify the cc1.4xlarge instance type for nodes of a cluster launched in a VPC.
eiaRequestedEC2AvailabilityZones :: Lens' EC2InstanceAttributes [Text] #
Applies to clusters configured with the instance fleets option. Specifies one or more Availability Zones in which to launch EC2 cluster instances when the EC2-Classic network configuration is supported. Amazon EMR chooses the Availability Zone with the best fit from among the list of RequestedEc2AvailabilityZones , and then launches all cluster instances within that Availability Zone. If you do not specify this value, Amazon EMR chooses the Availability Zone for you. RequestedEc2SubnetIDs and RequestedEc2AvailabilityZones cannot be specified together.
eiaServiceAccessSecurityGroup :: Lens' EC2InstanceAttributes (Maybe Text) #
The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters in VPC private subnets.
eiaEC2AvailabilityZone :: Lens' EC2InstanceAttributes (Maybe Text) #
The Availability Zone in which the cluster will run.
FailureDetails
data FailureDetails #
The details of the step failure. The service attempts to detect the root cause for many common failures.
See: failureDetails smart constructor.
Instances
failureDetails :: FailureDetails #
Creates a value of FailureDetails with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
fdLogFile- The path to the log file where the step failure root cause was originally recorded.fdReason- The reason for the step failure. In the case where the service cannot successfully determine the root cause of the failure, it returns "Unknown Error" as a reason.fdMessage- The descriptive message including the error the EMR service has identified as the cause of step failure. This is text from an error log that describes the root cause of the failure.
fdLogFile :: Lens' FailureDetails (Maybe Text) #
The path to the log file where the step failure root cause was originally recorded.
fdReason :: Lens' FailureDetails (Maybe Text) #
The reason for the step failure. In the case where the service cannot successfully determine the root cause of the failure, it returns "Unknown Error" as a reason.
fdMessage :: Lens' FailureDetails (Maybe Text) #
The descriptive message including the error the EMR service has identified as the cause of step failure. This is text from an error log that describes the root cause of the failure.
HadoopJARStepConfig
data HadoopJARStepConfig #
A job flow step consisting of a JAR file whose main function will be executed. The main function submits a job for Hadoop to execute and waits for the job to finish or fail.
See: hadoopJARStepConfig smart constructor.
Instances
Arguments
| :: Text | |
| -> HadoopJARStepConfig |
Creates a value of HadoopJARStepConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
hjscArgs- A list of command line arguments passed to the JAR file's main function when executed.hjscMainClass- The name of the main class in the specified Java file. If not specified, the JAR file should specify a Main-Class in its manifest file.hjscProperties- A list of Java properties that are set when the step runs. You can use these properties to pass key value pairs to your main function.hjscJAR- A path to a JAR file run during the step.
hjscArgs :: Lens' HadoopJARStepConfig [Text] #
A list of command line arguments passed to the JAR file's main function when executed.
hjscMainClass :: Lens' HadoopJARStepConfig (Maybe Text) #
The name of the main class in the specified Java file. If not specified, the JAR file should specify a Main-Class in its manifest file.
hjscProperties :: Lens' HadoopJARStepConfig [KeyValue] #
A list of Java properties that are set when the step runs. You can use these properties to pass key value pairs to your main function.
hjscJAR :: Lens' HadoopJARStepConfig Text #
A path to a JAR file run during the step.
HadoopStepConfig
data HadoopStepConfig #
A cluster step consisting of a JAR file whose main function will be executed. The main function submits a job for Hadoop to execute and waits for the job to finish or fail.
See: hadoopStepConfig smart constructor.
Instances
hadoopStepConfig :: HadoopStepConfig #
Creates a value of HadoopStepConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
hscArgs- The list of command line arguments to pass to the JAR file's main function for execution.hscJAR- The path to the JAR file that runs during the step.hscMainClass- The name of the main class in the specified Java file. If not specified, the JAR file should specify a main class in its manifest file.hscProperties- The list of Java properties that are set when the step runs. You can use these properties to pass key value pairs to your main function.
hscArgs :: Lens' HadoopStepConfig [Text] #
The list of command line arguments to pass to the JAR file's main function for execution.
hscMainClass :: Lens' HadoopStepConfig (Maybe Text) #
The name of the main class in the specified Java file. If not specified, the JAR file should specify a main class in its manifest file.
hscProperties :: Lens' HadoopStepConfig (HashMap Text Text) #
The list of Java properties that are set when the step runs. You can use these properties to pass key value pairs to your main function.
Instance
Represents an EC2 instance provisioned as part of cluster.
See: instance' smart constructor.
Instances
Creates a value of Instance with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
iStatus- The current status of the instance.iPublicDNSName- The public DNS name of the instance.iEBSVolumes- The list of EBS volumes that are attached to this instance.iEC2InstanceId- The unique identifier of the instance in Amazon EC2.iInstanceType- The EC2 instance type, for examplem3.xlarge.iMarket- The instance purchasing option. Valid values areON_DEMANDorSPOT.iPrivateIPAddress- The private IP address of the instance.iInstanceFleetId- The unique identifier of the instance fleet to which an EC2 instance belongs.iId- The unique identifier for the instance in Amazon EMR.iInstanceGroupId- The identifier of the instance group to which this instance belongs.iPrivateDNSName- The private DNS name of the instance.iPublicIPAddress- The public IP address of the instance.
iEBSVolumes :: Lens' Instance [EBSVolume] #
The list of EBS volumes that are attached to this instance.
iMarket :: Lens' Instance (Maybe MarketType) #
The instance purchasing option. Valid values are ON_DEMAND or SPOT .
iInstanceFleetId :: Lens' Instance (Maybe Text) #
The unique identifier of the instance fleet to which an EC2 instance belongs.
iInstanceGroupId :: Lens' Instance (Maybe Text) #
The identifier of the instance group to which this instance belongs.
InstanceFleet
data InstanceFleet #
Describes an instance fleet, which is a group of EC2 instances that host a particular node type (master, core, or task) in an Amazon EMR cluster. Instance fleets can consist of a mix of instance types and On-Demand and Spot instances, which are provisioned to meet a defined target capacity.
See: instanceFleet smart constructor.
Instances
instanceFleet :: InstanceFleet #
Creates a value of InstanceFleet with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ifProvisionedSpotCapacity- The number of Spot units that have been provisioned for this instance fleet to fulfillTargetSpotCapacity. This provisioned capacity might be less than or greater thanTargetSpotCapacity.ifStatus- The current status of the instance fleet.ifTargetOnDemandCapacity- The target capacity of On-Demand units for the instance fleet, which determines how many On-Demand instances to provision. When the instance fleet launches, Amazon EMR tries to provision On-Demand instances as specified byInstanceTypeConfig. Each instance configuration has a specifiedWeightedCapacity. When an On-Demand instance is provisioned, theWeightedCapacityunits count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with aWeightedCapacityof 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units. You can use 'InstanceFleet$ProvisionedOnDemandCapacity' to determine the Spot capacity units that have been provisioned for the instance fleet.ifInstanceFleetType- The node type that the instance fleet hosts. Valid values are MASTER, CORE, or TASK.ifInstanceTypeSpecifications- The specification for the instance types that comprise an instance fleet. Up to five unique instance specifications may be defined for each instance fleet.ifName- A friendly name for the instance fleet.ifProvisionedOnDemandCapacity- The number of On-Demand units that have been provisioned for the instance fleet to fulfillTargetOnDemandCapacity. This provisioned capacity might be less than or greater thanTargetOnDemandCapacity.ifTargetSpotCapacity- The target capacity of Spot units for the instance fleet, which determines how many Spot instances to provision. When the instance fleet launches, Amazon EMR tries to provision Spot instances as specified byInstanceTypeConfig. Each instance configuration has a specifiedWeightedCapacity. When a Spot instance is provisioned, theWeightedCapacityunits count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with aWeightedCapacityof 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units. You can use 'InstanceFleet$ProvisionedSpotCapacity' to determine the Spot capacity units that have been provisioned for the instance fleet.ifId- The unique identifier of the instance fleet.ifLaunchSpecifications- Describes the launch specification for an instance fleet.
ifProvisionedSpotCapacity :: Lens' InstanceFleet (Maybe Natural) #
The number of Spot units that have been provisioned for this instance fleet to fulfill TargetSpotCapacity . This provisioned capacity might be less than or greater than TargetSpotCapacity .
ifStatus :: Lens' InstanceFleet (Maybe InstanceFleetStatus) #
The current status of the instance fleet.
ifTargetOnDemandCapacity :: Lens' InstanceFleet (Maybe Natural) #
The target capacity of On-Demand units for the instance fleet, which determines how many On-Demand instances to provision. When the instance fleet launches, Amazon EMR tries to provision On-Demand instances as specified by InstanceTypeConfig . Each instance configuration has a specified WeightedCapacity . When an On-Demand instance is provisioned, the WeightedCapacity units count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with a WeightedCapacity of 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units. You can use 'InstanceFleet$ProvisionedOnDemandCapacity' to determine the Spot capacity units that have been provisioned for the instance fleet.
ifInstanceFleetType :: Lens' InstanceFleet (Maybe InstanceFleetType) #
The node type that the instance fleet hosts. Valid values are MASTER, CORE, or TASK.
ifInstanceTypeSpecifications :: Lens' InstanceFleet [InstanceTypeSpecification] #
The specification for the instance types that comprise an instance fleet. Up to five unique instance specifications may be defined for each instance fleet.
ifProvisionedOnDemandCapacity :: Lens' InstanceFleet (Maybe Natural) #
The number of On-Demand units that have been provisioned for the instance fleet to fulfill TargetOnDemandCapacity . This provisioned capacity might be less than or greater than TargetOnDemandCapacity .
ifTargetSpotCapacity :: Lens' InstanceFleet (Maybe Natural) #
The target capacity of Spot units for the instance fleet, which determines how many Spot instances to provision. When the instance fleet launches, Amazon EMR tries to provision Spot instances as specified by InstanceTypeConfig . Each instance configuration has a specified WeightedCapacity . When a Spot instance is provisioned, the WeightedCapacity units count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with a WeightedCapacity of 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units. You can use 'InstanceFleet$ProvisionedSpotCapacity' to determine the Spot capacity units that have been provisioned for the instance fleet.
ifLaunchSpecifications :: Lens' InstanceFleet (Maybe InstanceFleetProvisioningSpecifications) #
Describes the launch specification for an instance fleet.
InstanceFleetConfig
data InstanceFleetConfig #
The configuration that defines an instance fleet.
See: instanceFleetConfig smart constructor.
Instances
Arguments
| :: InstanceFleetType | |
| -> InstanceFleetConfig |
Creates a value of InstanceFleetConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ifcInstanceTypeConfigs- The instance type configurations that define the EC2 instances in the instance fleet.ifcTargetOnDemandCapacity- The target capacity of On-Demand units for the instance fleet, which determines how many On-Demand instances to provision. When the instance fleet launches, Amazon EMR tries to provision On-Demand instances as specified byInstanceTypeConfig. Each instance configuration has a specifiedWeightedCapacity. When an On-Demand instance is provisioned, theWeightedCapacityunits count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with aWeightedCapacityof 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units.ifcName- The friendly name of the instance fleet.ifcTargetSpotCapacity- The target capacity of Spot units for the instance fleet, which determines how many Spot instances to provision. When the instance fleet launches, Amazon EMR tries to provision Spot instances as specified byInstanceTypeConfig. Each instance configuration has a specifiedWeightedCapacity. When a Spot instance is provisioned, theWeightedCapacityunits count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with aWeightedCapacityof 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units.ifcLaunchSpecifications- The launch specification for the instance fleet.ifcInstanceFleetType- The node type that the instance fleet hosts. Valid values are MASTER,CORE,and TASK.
ifcInstanceTypeConfigs :: Lens' InstanceFleetConfig [InstanceTypeConfig] #
The instance type configurations that define the EC2 instances in the instance fleet.
ifcTargetOnDemandCapacity :: Lens' InstanceFleetConfig (Maybe Natural) #
The target capacity of On-Demand units for the instance fleet, which determines how many On-Demand instances to provision. When the instance fleet launches, Amazon EMR tries to provision On-Demand instances as specified by InstanceTypeConfig . Each instance configuration has a specified WeightedCapacity . When an On-Demand instance is provisioned, the WeightedCapacity units count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with a WeightedCapacity of 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units.
ifcTargetSpotCapacity :: Lens' InstanceFleetConfig (Maybe Natural) #
The target capacity of Spot units for the instance fleet, which determines how many Spot instances to provision. When the instance fleet launches, Amazon EMR tries to provision Spot instances as specified by InstanceTypeConfig . Each instance configuration has a specified WeightedCapacity . When a Spot instance is provisioned, the WeightedCapacity units count toward the target capacity. Amazon EMR provisions instances until the target capacity is totally fulfilled, even if this results in an overage. For example, if there are 2 units remaining to fulfill capacity, and Amazon EMR can only provision an instance with a WeightedCapacity of 5 units, the instance is provisioned, and the target capacity is exceeded by 3 units.
ifcLaunchSpecifications :: Lens' InstanceFleetConfig (Maybe InstanceFleetProvisioningSpecifications) #
The launch specification for the instance fleet.
ifcInstanceFleetType :: Lens' InstanceFleetConfig InstanceFleetType #
The node type that the instance fleet hosts. Valid values are MASTER,CORE,and TASK.
InstanceFleetModifyConfig
data InstanceFleetModifyConfig #
Configuration parameters for an instance fleet modification request.
See: instanceFleetModifyConfig smart constructor.
Instances
Arguments
| :: Text | |
| -> InstanceFleetModifyConfig |
Creates a value of InstanceFleetModifyConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ifmcTargetOnDemandCapacity- The target capacity of On-Demand units for the instance fleet. For more information see 'InstanceFleetConfig$TargetOnDemandCapacity' .ifmcTargetSpotCapacity- The target capacity of Spot units for the instance fleet. For more information, see 'InstanceFleetConfig$TargetSpotCapacity' .ifmcInstanceFleetId- A unique identifier for the instance fleet.
ifmcTargetOnDemandCapacity :: Lens' InstanceFleetModifyConfig (Maybe Natural) #
The target capacity of On-Demand units for the instance fleet. For more information see 'InstanceFleetConfig$TargetOnDemandCapacity' .
ifmcTargetSpotCapacity :: Lens' InstanceFleetModifyConfig (Maybe Natural) #
The target capacity of Spot units for the instance fleet. For more information, see 'InstanceFleetConfig$TargetSpotCapacity' .
ifmcInstanceFleetId :: Lens' InstanceFleetModifyConfig Text #
A unique identifier for the instance fleet.
InstanceFleetProvisioningSpecifications
data InstanceFleetProvisioningSpecifications #
The launch specification for Spot instances in the fleet, which determines the defined duration and provisioning timeout behavior.
See: instanceFleetProvisioningSpecifications smart constructor.
Instances
instanceFleetProvisioningSpecifications #
Creates a value of InstanceFleetProvisioningSpecifications with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ifpsSpotSpecification- The launch specification for Spot instances in the fleet, which determines the defined duration and provisioning timeout behavior.
ifpsSpotSpecification :: Lens' InstanceFleetProvisioningSpecifications SpotProvisioningSpecification #
The launch specification for Spot instances in the fleet, which determines the defined duration and provisioning timeout behavior.
InstanceFleetStateChangeReason
data InstanceFleetStateChangeReason #
Provides status change reason details for the instance fleet.
See: instanceFleetStateChangeReason smart constructor.
Instances
instanceFleetStateChangeReason :: InstanceFleetStateChangeReason #
Creates a value of InstanceFleetStateChangeReason with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ifscrCode- A code corresponding to the reason the state change occurred.ifscrMessage- An explanatory message.
ifscrCode :: Lens' InstanceFleetStateChangeReason (Maybe InstanceFleetStateChangeReasonCode) #
A code corresponding to the reason the state change occurred.
ifscrMessage :: Lens' InstanceFleetStateChangeReason (Maybe Text) #
An explanatory message.
InstanceFleetStatus
data InstanceFleetStatus #
The status of the instance fleet.
See: instanceFleetStatus smart constructor.
Instances
instanceFleetStatus :: InstanceFleetStatus #
Creates a value of InstanceFleetStatus with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ifsState- A code representing the instance fleet status. *PROVISIONING—The instance fleet is provisioning EC2 resources and is not yet ready to run jobs. *BOOTSTRAPPING—EC2 instances and other resources have been provisioned and the bootstrap actions specified for the instances are underway. *RUNNING—EC2 instances and other resources are running. They are either executing jobs or waiting to execute jobs. *RESIZING—A resize operation is underway. EC2 instances are either being added or removed. *SUSPENDED—A resize operation could not complete. Existing EC2 instances are running, but instances can't be added or removed. *TERMINATING—The instance fleet is terminating EC2 instances. *TERMINATED—The instance fleet is no longer active, and all EC2 instances have been terminated.ifsStateChangeReason- Provides status change reason details for the instance fleet.ifsTimeline- Provides historical timestamps for the instance fleet, including the time of creation, the time it became ready to run jobs, and the time of termination.
ifsState :: Lens' InstanceFleetStatus (Maybe InstanceFleetState) #
A code representing the instance fleet status. * PROVISIONING —The instance fleet is provisioning EC2 resources and is not yet ready to run jobs. * BOOTSTRAPPING —EC2 instances and other resources have been provisioned and the bootstrap actions specified for the instances are underway. * RUNNING —EC2 instances and other resources are running. They are either executing jobs or waiting to execute jobs. * RESIZING —A resize operation is underway. EC2 instances are either being added or removed. * SUSPENDED —A resize operation could not complete. Existing EC2 instances are running, but instances can't be added or removed. * TERMINATING —The instance fleet is terminating EC2 instances. * TERMINATED —The instance fleet is no longer active, and all EC2 instances have been terminated.
ifsStateChangeReason :: Lens' InstanceFleetStatus (Maybe InstanceFleetStateChangeReason) #
Provides status change reason details for the instance fleet.
ifsTimeline :: Lens' InstanceFleetStatus (Maybe InstanceFleetTimeline) #
Provides historical timestamps for the instance fleet, including the time of creation, the time it became ready to run jobs, and the time of termination.
InstanceFleetTimeline
data InstanceFleetTimeline #
Provides historical timestamps for the instance fleet, including the time of creation, the time it became ready to run jobs, and the time of termination.
See: instanceFleetTimeline smart constructor.
Instances
instanceFleetTimeline :: InstanceFleetTimeline #
Creates a value of InstanceFleetTimeline with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
iftReadyDateTime- The time and date the instance fleet was ready to run jobs.iftCreationDateTime- The time and date the instance fleet was created.iftEndDateTime- The time and date the instance fleet terminated.
iftReadyDateTime :: Lens' InstanceFleetTimeline (Maybe UTCTime) #
The time and date the instance fleet was ready to run jobs.
iftCreationDateTime :: Lens' InstanceFleetTimeline (Maybe UTCTime) #
The time and date the instance fleet was created.
iftEndDateTime :: Lens' InstanceFleetTimeline (Maybe UTCTime) #
The time and date the instance fleet terminated.
InstanceGroup
data InstanceGroup #
This entity represents an instance group, which is a group of instances that have common purpose. For example, CORE instance group is used for HDFS.
See: instanceGroup smart constructor.
Instances
instanceGroup :: InstanceGroup #
Creates a value of InstanceGroup with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
igStatus- The current status of the instance group.igBidPrice- The bid price for each EC2 instance in the instance group when launching nodes as Spot Instances, expressed in USD.igRequestedInstanceCount- The target number of instances for the instance group.igRunningInstanceCount- The number of instances currently running in this instance group.igConfigurations- The list of configurations supplied for an EMR cluster instance group. You can specify a separate configuration for each instance group (master, core, and task).igInstanceGroupType- The type of the instance group. Valid values are MASTER, CORE or TASK.igEBSBlockDevices- The EBS block devices that are mapped to this instance group.igInstanceType- The EC2 instance type for all instances in the instance group.igEBSOptimized- If the instance group is EBS-optimized. An Amazon EBS-optimized instance uses an optimized configuration stack and provides additional, dedicated capacity for Amazon EBS I/O.igMarket- The marketplace to provision instances for this group. Valid values are ON_DEMAND or SPOT.igName- The name of the instance group.igAutoScalingPolicy- An automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster. The automatic scaling policy defines how an instance group dynamically adds and terminates EC2 instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy.igShrinkPolicy- Policy for customizing shrink operations.igId- The identifier of the instance group.
igStatus :: Lens' InstanceGroup (Maybe InstanceGroupStatus) #
The current status of the instance group.
igBidPrice :: Lens' InstanceGroup (Maybe Text) #
The bid price for each EC2 instance in the instance group when launching nodes as Spot Instances, expressed in USD.
igRequestedInstanceCount :: Lens' InstanceGroup (Maybe Int) #
The target number of instances for the instance group.
igRunningInstanceCount :: Lens' InstanceGroup (Maybe Int) #
The number of instances currently running in this instance group.
igConfigurations :: Lens' InstanceGroup [Configuration] #
The list of configurations supplied for an EMR cluster instance group. You can specify a separate configuration for each instance group (master, core, and task).
igInstanceGroupType :: Lens' InstanceGroup (Maybe InstanceGroupType) #
The type of the instance group. Valid values are MASTER, CORE or TASK.
igEBSBlockDevices :: Lens' InstanceGroup [EBSBlockDevice] #
The EBS block devices that are mapped to this instance group.
igInstanceType :: Lens' InstanceGroup (Maybe Text) #
The EC2 instance type for all instances in the instance group.
igEBSOptimized :: Lens' InstanceGroup (Maybe Bool) #
If the instance group is EBS-optimized. An Amazon EBS-optimized instance uses an optimized configuration stack and provides additional, dedicated capacity for Amazon EBS I/O.
igMarket :: Lens' InstanceGroup (Maybe MarketType) #
The marketplace to provision instances for this group. Valid values are ON_DEMAND or SPOT.
igAutoScalingPolicy :: Lens' InstanceGroup (Maybe AutoScalingPolicyDescription) #
An automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster. The automatic scaling policy defines how an instance group dynamically adds and terminates EC2 instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy.
igShrinkPolicy :: Lens' InstanceGroup (Maybe ShrinkPolicy) #
Policy for customizing shrink operations.
InstanceGroupConfig
data InstanceGroupConfig #
Configuration defining a new instance group.
See: instanceGroupConfig smart constructor.
Instances
Arguments
| :: InstanceRoleType | |
| -> Text | |
| -> Int | |
| -> InstanceGroupConfig |
Creates a value of InstanceGroupConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
igcEBSConfiguration- EBS configurations that will be attached to each EC2 instance in the instance group.igcBidPrice- Bid price for each EC2 instance in the instance group when launching nodes as Spot Instances, expressed in USD.igcConfigurations- The list of configurations supplied for an EMR cluster instance group. You can specify a separate configuration for each instance group (master, core, and task).igcMarket- Market type of the EC2 instances used to create a cluster node.igcName- Friendly name given to the instance group.igcAutoScalingPolicy- An automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster. The automatic scaling policy defines how an instance group dynamically adds and terminates EC2 instances in response to the value of a CloudWatch metric. SeePutAutoScalingPolicy.igcInstanceRole- The role of the instance group in the cluster.igcInstanceType- The EC2 instance type for all instances in the instance group.igcInstanceCount- Target number of instances for the instance group.
igcEBSConfiguration :: Lens' InstanceGroupConfig (Maybe EBSConfiguration) #
EBS configurations that will be attached to each EC2 instance in the instance group.
igcBidPrice :: Lens' InstanceGroupConfig (Maybe Text) #
Bid price for each EC2 instance in the instance group when launching nodes as Spot Instances, expressed in USD.
igcConfigurations :: Lens' InstanceGroupConfig [Configuration] #
The list of configurations supplied for an EMR cluster instance group. You can specify a separate configuration for each instance group (master, core, and task).
igcMarket :: Lens' InstanceGroupConfig (Maybe MarketType) #
Market type of the EC2 instances used to create a cluster node.
igcAutoScalingPolicy :: Lens' InstanceGroupConfig (Maybe AutoScalingPolicy) #
An automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster. The automatic scaling policy defines how an instance group dynamically adds and terminates EC2 instances in response to the value of a CloudWatch metric. See PutAutoScalingPolicy .
igcInstanceRole :: Lens' InstanceGroupConfig InstanceRoleType #
The role of the instance group in the cluster.
igcInstanceType :: Lens' InstanceGroupConfig Text #
The EC2 instance type for all instances in the instance group.
igcInstanceCount :: Lens' InstanceGroupConfig Int #
Target number of instances for the instance group.
InstanceGroupModifyConfig
data InstanceGroupModifyConfig #
Modify an instance group size.
See: instanceGroupModifyConfig smart constructor.
Instances
Arguments
| :: Text | |
| -> InstanceGroupModifyConfig |
Creates a value of InstanceGroupModifyConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
igmcInstanceCount- Target size for the instance group.igmcEC2InstanceIdsToTerminate- The EC2 InstanceIds to terminate. After you terminate the instances, the instance group will not return to its original requested size.igmcShrinkPolicy- Policy for customizing shrink operations.igmcInstanceGroupId- Unique ID of the instance group to expand or shrink.
igmcInstanceCount :: Lens' InstanceGroupModifyConfig (Maybe Int) #
Target size for the instance group.
igmcEC2InstanceIdsToTerminate :: Lens' InstanceGroupModifyConfig [Text] #
The EC2 InstanceIds to terminate. After you terminate the instances, the instance group will not return to its original requested size.
igmcShrinkPolicy :: Lens' InstanceGroupModifyConfig (Maybe ShrinkPolicy) #
Policy for customizing shrink operations.
igmcInstanceGroupId :: Lens' InstanceGroupModifyConfig Text #
Unique ID of the instance group to expand or shrink.
InstanceGroupStateChangeReason
data InstanceGroupStateChangeReason #
The status change reason details for the instance group.
See: instanceGroupStateChangeReason smart constructor.
Instances
instanceGroupStateChangeReason :: InstanceGroupStateChangeReason #
Creates a value of InstanceGroupStateChangeReason with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
igscrCode- The programmable code for the state change reason.igscrMessage- The status change reason description.
igscrCode :: Lens' InstanceGroupStateChangeReason (Maybe InstanceGroupStateChangeReasonCode) #
The programmable code for the state change reason.
igscrMessage :: Lens' InstanceGroupStateChangeReason (Maybe Text) #
The status change reason description.
InstanceGroupStatus
data InstanceGroupStatus #
The details of the instance group status.
See: instanceGroupStatus smart constructor.
Instances
instanceGroupStatus :: InstanceGroupStatus #
Creates a value of InstanceGroupStatus with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
igsState- The current state of the instance group.igsStateChangeReason- The status change reason details for the instance group.igsTimeline- The timeline of the instance group status over time.
igsState :: Lens' InstanceGroupStatus (Maybe InstanceGroupState) #
The current state of the instance group.
igsStateChangeReason :: Lens' InstanceGroupStatus (Maybe InstanceGroupStateChangeReason) #
The status change reason details for the instance group.
igsTimeline :: Lens' InstanceGroupStatus (Maybe InstanceGroupTimeline) #
The timeline of the instance group status over time.
InstanceGroupTimeline
data InstanceGroupTimeline #
The timeline of the instance group lifecycle.
See: instanceGroupTimeline smart constructor.
Instances
instanceGroupTimeline :: InstanceGroupTimeline #
Creates a value of InstanceGroupTimeline with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
igtReadyDateTime- The date and time when the instance group became ready to perform tasks.igtCreationDateTime- The creation date and time of the instance group.igtEndDateTime- The date and time when the instance group terminated.
igtReadyDateTime :: Lens' InstanceGroupTimeline (Maybe UTCTime) #
The date and time when the instance group became ready to perform tasks.
igtCreationDateTime :: Lens' InstanceGroupTimeline (Maybe UTCTime) #
The creation date and time of the instance group.
igtEndDateTime :: Lens' InstanceGroupTimeline (Maybe UTCTime) #
The date and time when the instance group terminated.
InstanceResizePolicy
data InstanceResizePolicy #
Custom policy for requesting termination protection or termination of specific instances when shrinking an instance group.
See: instanceResizePolicy smart constructor.
Instances
instanceResizePolicy :: InstanceResizePolicy #
Creates a value of InstanceResizePolicy with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
irpInstancesToProtect- Specific list of instances to be protected when shrinking an instance group.irpInstancesToTerminate- Specific list of instances to be terminated when shrinking an instance group.irpInstanceTerminationTimeout- Decommissioning timeout override for the specific list of instances to be terminated.
irpInstancesToProtect :: Lens' InstanceResizePolicy [Text] #
Specific list of instances to be protected when shrinking an instance group.
irpInstancesToTerminate :: Lens' InstanceResizePolicy [Text] #
Specific list of instances to be terminated when shrinking an instance group.
irpInstanceTerminationTimeout :: Lens' InstanceResizePolicy (Maybe Int) #
Decommissioning timeout override for the specific list of instances to be terminated.
InstanceStateChangeReason
data InstanceStateChangeReason #
The details of the status change reason for the instance.
See: instanceStateChangeReason smart constructor.
Instances
instanceStateChangeReason :: InstanceStateChangeReason #
Creates a value of InstanceStateChangeReason with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
iscrCode- The programmable code for the state change reason.iscrMessage- The status change reason description.
iscrCode :: Lens' InstanceStateChangeReason (Maybe InstanceStateChangeReasonCode) #
The programmable code for the state change reason.
iscrMessage :: Lens' InstanceStateChangeReason (Maybe Text) #
The status change reason description.
InstanceStatus
data InstanceStatus #
The instance status details.
See: instanceStatus smart constructor.
Instances
instanceStatus :: InstanceStatus #
Creates a value of InstanceStatus with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
isState- The current state of the instance.isStateChangeReason- The details of the status change reason for the instance.isTimeline- The timeline of the instance status over time.
isState :: Lens' InstanceStatus (Maybe InstanceState) #
The current state of the instance.
isStateChangeReason :: Lens' InstanceStatus (Maybe InstanceStateChangeReason) #
The details of the status change reason for the instance.
isTimeline :: Lens' InstanceStatus (Maybe InstanceTimeline) #
The timeline of the instance status over time.
InstanceTimeline
data InstanceTimeline #
The timeline of the instance lifecycle.
See: instanceTimeline smart constructor.
Instances
instanceTimeline :: InstanceTimeline #
Creates a value of InstanceTimeline with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
itReadyDateTime- The date and time when the instance was ready to perform tasks.itCreationDateTime- The creation date and time of the instance.itEndDateTime- The date and time when the instance was terminated.
itReadyDateTime :: Lens' InstanceTimeline (Maybe UTCTime) #
The date and time when the instance was ready to perform tasks.
itCreationDateTime :: Lens' InstanceTimeline (Maybe UTCTime) #
The creation date and time of the instance.
itEndDateTime :: Lens' InstanceTimeline (Maybe UTCTime) #
The date and time when the instance was terminated.
InstanceTypeConfig
data InstanceTypeConfig #
An instance type configuration for each instance type in an instance fleet, which determines the EC2 instances Amazon EMR attempts to provision to fulfill On-Demand and Spot target capacities. There can be a maximum of 5 instance type configurations in a fleet.
See: instanceTypeConfig smart constructor.
Instances
Arguments
| :: Text | |
| -> InstanceTypeConfig |
Creates a value of InstanceTypeConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
itcEBSConfiguration- The configuration of Amazon Elastic Block Storage (EBS) attached to each instance as defined byInstanceType.itcBidPrice- The bid price for each EC2 Spot instance type as defined byInstanceType. Expressed in USD. If neitherBidPricenorBidPriceAsPercentageOfOnDemandPriceis provided,BidPriceAsPercentageOfOnDemandPricedefaults to 100%.itcWeightedCapacity- The number of units that a provisioned instance of this type provides toward fulfilling the target capacities defined inInstanceFleetConfig. This value is 1 for a master instance fleet, and must be 1 or greater for core and task instance fleets. Defaults to 1 if not specified.itcConfigurations- A configuration classification that applies when provisioning cluster instances, which can include configurations for applications and software that run on the cluster.itcBidPriceAsPercentageOfOnDemandPrice- The bid price, as a percentage of On-Demand price, for each EC2 Spot instance as defined byInstanceType. Expressed as a number (for example, 20 specifies 20%). If neitherBidPricenorBidPriceAsPercentageOfOnDemandPriceis provided,BidPriceAsPercentageOfOnDemandPricedefaults to 100%.itcInstanceType- An EC2 instance type, such asm3.xlarge.
itcEBSConfiguration :: Lens' InstanceTypeConfig (Maybe EBSConfiguration) #
The configuration of Amazon Elastic Block Storage (EBS) attached to each instance as defined by InstanceType .
itcBidPrice :: Lens' InstanceTypeConfig (Maybe Text) #
The bid price for each EC2 Spot instance type as defined by InstanceType . Expressed in USD. If neither BidPrice nor BidPriceAsPercentageOfOnDemandPrice is provided, BidPriceAsPercentageOfOnDemandPrice defaults to 100%.
itcWeightedCapacity :: Lens' InstanceTypeConfig (Maybe Natural) #
The number of units that a provisioned instance of this type provides toward fulfilling the target capacities defined in InstanceFleetConfig . This value is 1 for a master instance fleet, and must be 1 or greater for core and task instance fleets. Defaults to 1 if not specified.
itcConfigurations :: Lens' InstanceTypeConfig [Configuration] #
A configuration classification that applies when provisioning cluster instances, which can include configurations for applications and software that run on the cluster.
itcBidPriceAsPercentageOfOnDemandPrice :: Lens' InstanceTypeConfig (Maybe Double) #
The bid price, as a percentage of On-Demand price, for each EC2 Spot instance as defined by InstanceType . Expressed as a number (for example, 20 specifies 20%). If neither BidPrice nor BidPriceAsPercentageOfOnDemandPrice is provided, BidPriceAsPercentageOfOnDemandPrice defaults to 100%.
itcInstanceType :: Lens' InstanceTypeConfig Text #
An EC2 instance type, such as m3.xlarge .
InstanceTypeSpecification
data InstanceTypeSpecification #
The configuration specification for each instance type in an instance fleet.
See: instanceTypeSpecification smart constructor.
Instances
instanceTypeSpecification :: InstanceTypeSpecification #
Creates a value of InstanceTypeSpecification with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
itsBidPrice- The bid price for each EC2 Spot instance type as defined byInstanceType. Expressed in USD.itsWeightedCapacity- The number of units that a provisioned instance of this type provides toward fulfilling the target capacities defined inInstanceFleetConfig. Capacity values represent performance characteristics such as vCPUs, memory, or I/O. If not specified, the default value is 1.itsConfigurations- A configuration classification that applies when provisioning cluster instances, which can include configurations for applications and software bundled with Amazon EMR.itsEBSBlockDevices- The configuration of Amazon Elastic Block Storage (EBS) attached to each instance as defined byInstanceType.itsInstanceType- The EC2 instance type, for examplem3.xlarge.itsEBSOptimized- Evaluates toTRUEwhen the specifiedInstanceTypeis EBS-optimized.itsBidPriceAsPercentageOfOnDemandPrice- The bid price, as a percentage of On-Demand price, for each EC2 Spot instance as defined byInstanceType. Expressed as a number (for example, 20 specifies 20%).
itsBidPrice :: Lens' InstanceTypeSpecification (Maybe Text) #
The bid price for each EC2 Spot instance type as defined by InstanceType . Expressed in USD.
itsWeightedCapacity :: Lens' InstanceTypeSpecification (Maybe Natural) #
The number of units that a provisioned instance of this type provides toward fulfilling the target capacities defined in InstanceFleetConfig . Capacity values represent performance characteristics such as vCPUs, memory, or I/O. If not specified, the default value is 1.
itsConfigurations :: Lens' InstanceTypeSpecification [Configuration] #
A configuration classification that applies when provisioning cluster instances, which can include configurations for applications and software bundled with Amazon EMR.
itsEBSBlockDevices :: Lens' InstanceTypeSpecification [EBSBlockDevice] #
The configuration of Amazon Elastic Block Storage (EBS) attached to each instance as defined by InstanceType .
itsInstanceType :: Lens' InstanceTypeSpecification (Maybe Text) #
The EC2 instance type, for example m3.xlarge .
itsEBSOptimized :: Lens' InstanceTypeSpecification (Maybe Bool) #
Evaluates to TRUE when the specified InstanceType is EBS-optimized.
itsBidPriceAsPercentageOfOnDemandPrice :: Lens' InstanceTypeSpecification (Maybe Double) #
The bid price, as a percentage of On-Demand price, for each EC2 Spot instance as defined by InstanceType . Expressed as a number (for example, 20 specifies 20%).
JobFlowInstancesConfig
data JobFlowInstancesConfig #
A description of the Amazon EC2 instance on which the cluster (job flow) runs. A valid JobFlowInstancesConfig must contain either InstanceGroups or InstanceFleets, which is the recommended configuration. They cannot be used together. You may also have MasterInstanceType, SlaveInstanceType, and InstanceCount (all three must be present), but we don't recommend this configuration.
See: jobFlowInstancesConfig smart constructor.
Instances
jobFlowInstancesConfig :: JobFlowInstancesConfig #
Creates a value of JobFlowInstancesConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
jficInstanceFleets- Describes the EC2 instances and instance configurations for clusters that use the instance fleet configuration.jficEC2KeyName- The name of the EC2 key pair that can be used to ssh to the master node as the user called "hadoop."jficSlaveInstanceType- The EC2 instance type of the slave nodes.jficInstanceCount- The number of EC2 instances in the cluster.jficEmrManagedSlaveSecurityGroup- The identifier of the Amazon EC2 security group for the slave nodes.jficAdditionalSlaveSecurityGroups- A list of additional Amazon EC2 security group IDs for the slave nodes.jficEC2SubnetIds- Applies to clusters that use the instance fleet configuration. When multiple EC2 subnet IDs are specified, Amazon EMR evaluates them and launches instances in the optimal subnet.jficHadoopVersion- The Hadoop version for the cluster. Valid inputs are "0.18" (deprecated), "0.20" (deprecated), "0.20.205" (deprecated), "1.0.3", "2.2.0", or "2.4.0". If you do not set this value, the default of 0.18 is used, unless the AmiVersion parameter is set in the RunJobFlow call, in which case the default version of Hadoop for that AMI version is used.jficAdditionalMasterSecurityGroups- A list of additional Amazon EC2 security group IDs for the master node.jficEmrManagedMasterSecurityGroup- The identifier of the Amazon EC2 security group for the master node.jficEC2SubnetId- Applies to clusters that use the uniform instance group configuration. To launch the cluster in Amazon Virtual Private Cloud (Amazon VPC), set this parameter to the identifier of the Amazon VPC subnet where you want the cluster to launch. If you do not specify this value, the cluster launches in the normal Amazon Web Services cloud, outside of an Amazon VPC, if the account launching the cluster supports EC2 Classic networks in the region where the cluster launches. Amazon VPC currently does not support cluster compute quadruple extra large (cc1.4xlarge) instances. Thus you cannot specify the cc1.4xlarge instance type for clusters launched in an Amazon VPC.jficMasterInstanceType- The EC2 instance type of the master node.jficInstanceGroups- Configuration for the instance groups in a cluster.jficKeepJobFlowAliveWhenNoSteps- Specifies whether the cluster should remain available after completing all steps.jficServiceAccessSecurityGroup- The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters in VPC private subnets.jficTerminationProtected- Specifies whether to lock the cluster to prevent the Amazon EC2 instances from being terminated by API call, user intervention, or in the event of a job-flow error.jficPlacement- The Availability Zone in which the cluster runs.
jficInstanceFleets :: Lens' JobFlowInstancesConfig [InstanceFleetConfig] #
Describes the EC2 instances and instance configurations for clusters that use the instance fleet configuration.
jficEC2KeyName :: Lens' JobFlowInstancesConfig (Maybe Text) #
The name of the EC2 key pair that can be used to ssh to the master node as the user called "hadoop."
jficSlaveInstanceType :: Lens' JobFlowInstancesConfig (Maybe Text) #
The EC2 instance type of the slave nodes.
jficInstanceCount :: Lens' JobFlowInstancesConfig (Maybe Int) #
The number of EC2 instances in the cluster.
jficEmrManagedSlaveSecurityGroup :: Lens' JobFlowInstancesConfig (Maybe Text) #
The identifier of the Amazon EC2 security group for the slave nodes.
jficAdditionalSlaveSecurityGroups :: Lens' JobFlowInstancesConfig [Text] #
A list of additional Amazon EC2 security group IDs for the slave nodes.
jficEC2SubnetIds :: Lens' JobFlowInstancesConfig [Text] #
Applies to clusters that use the instance fleet configuration. When multiple EC2 subnet IDs are specified, Amazon EMR evaluates them and launches instances in the optimal subnet.
jficHadoopVersion :: Lens' JobFlowInstancesConfig (Maybe Text) #
The Hadoop version for the cluster. Valid inputs are "0.18" (deprecated), "0.20" (deprecated), "0.20.205" (deprecated), "1.0.3", "2.2.0", or "2.4.0". If you do not set this value, the default of 0.18 is used, unless the AmiVersion parameter is set in the RunJobFlow call, in which case the default version of Hadoop for that AMI version is used.
jficAdditionalMasterSecurityGroups :: Lens' JobFlowInstancesConfig [Text] #
A list of additional Amazon EC2 security group IDs for the master node.
jficEmrManagedMasterSecurityGroup :: Lens' JobFlowInstancesConfig (Maybe Text) #
The identifier of the Amazon EC2 security group for the master node.
jficEC2SubnetId :: Lens' JobFlowInstancesConfig (Maybe Text) #
Applies to clusters that use the uniform instance group configuration. To launch the cluster in Amazon Virtual Private Cloud (Amazon VPC), set this parameter to the identifier of the Amazon VPC subnet where you want the cluster to launch. If you do not specify this value, the cluster launches in the normal Amazon Web Services cloud, outside of an Amazon VPC, if the account launching the cluster supports EC2 Classic networks in the region where the cluster launches. Amazon VPC currently does not support cluster compute quadruple extra large (cc1.4xlarge) instances. Thus you cannot specify the cc1.4xlarge instance type for clusters launched in an Amazon VPC.
jficMasterInstanceType :: Lens' JobFlowInstancesConfig (Maybe Text) #
The EC2 instance type of the master node.
jficInstanceGroups :: Lens' JobFlowInstancesConfig [InstanceGroupConfig] #
Configuration for the instance groups in a cluster.
jficKeepJobFlowAliveWhenNoSteps :: Lens' JobFlowInstancesConfig (Maybe Bool) #
Specifies whether the cluster should remain available after completing all steps.
jficServiceAccessSecurityGroup :: Lens' JobFlowInstancesConfig (Maybe Text) #
The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters in VPC private subnets.
jficTerminationProtected :: Lens' JobFlowInstancesConfig (Maybe Bool) #
Specifies whether to lock the cluster to prevent the Amazon EC2 instances from being terminated by API call, user intervention, or in the event of a job-flow error.
jficPlacement :: Lens' JobFlowInstancesConfig (Maybe PlacementType) #
The Availability Zone in which the cluster runs.
KerberosAttributes
data KerberosAttributes #
Attributes for Kerberos configuration when Kerberos authentication is enabled using a security configuration. For more information see Use Kerberos Authentication in the EMR Management Guide .
See: kerberosAttributes smart constructor.
Instances
Arguments
| :: Text | |
| -> Text | |
| -> KerberosAttributes |
Creates a value of KerberosAttributes with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
kaADDomainJoinPassword- The Active Directory password forADDomainJoinUser.kaCrossRealmTrustPrincipalPassword- Required only when establishing a cross-realm trust with a KDC in a different realm. The cross-realm principal password, which must be identical across realms.kaADDomainJoinUser- Required only when establishing a cross-realm trust with an Active Directory domain. A user with sufficient privileges to join resources to the domain.kaRealm- The name of the Kerberos realm to which all nodes in a cluster belong. For example,EC2.INTERNAL.kaKdcAdminPassword- The password used within the cluster for the kadmin service on the cluster-dedicated KDC, which maintains Kerberos principals, password policies, and keytabs for the cluster.
kaADDomainJoinPassword :: Lens' KerberosAttributes (Maybe Text) #
The Active Directory password for ADDomainJoinUser .
kaCrossRealmTrustPrincipalPassword :: Lens' KerberosAttributes (Maybe Text) #
Required only when establishing a cross-realm trust with a KDC in a different realm. The cross-realm principal password, which must be identical across realms.
kaADDomainJoinUser :: Lens' KerberosAttributes (Maybe Text) #
Required only when establishing a cross-realm trust with an Active Directory domain. A user with sufficient privileges to join resources to the domain.
kaRealm :: Lens' KerberosAttributes Text #
The name of the Kerberos realm to which all nodes in a cluster belong. For example, EC2.INTERNAL .
kaKdcAdminPassword :: Lens' KerberosAttributes Text #
The password used within the cluster for the kadmin service on the cluster-dedicated KDC, which maintains Kerberos principals, password policies, and keytabs for the cluster.
KeyValue
A key value pair.
See: keyValue smart constructor.
Instances
| Eq KeyValue # | |
| Data KeyValue # | |
Defined in Network.AWS.EMR.Types.Product Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> KeyValue -> c KeyValue # gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c KeyValue # toConstr :: KeyValue -> Constr # dataTypeOf :: KeyValue -> DataType # dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c KeyValue) # dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c KeyValue) # gmapT :: (forall b. Data b => b -> b) -> KeyValue -> KeyValue # gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> KeyValue -> r # gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> KeyValue -> r # gmapQ :: (forall d. Data d => d -> u) -> KeyValue -> [u] # gmapQi :: Int -> (forall d. Data d => d -> u) -> KeyValue -> u # gmapM :: Monad m => (forall d. Data d => d -> m d) -> KeyValue -> m KeyValue # gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> KeyValue -> m KeyValue # gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> KeyValue -> m KeyValue # | |
| Read KeyValue # | |
| Show KeyValue # | |
| Generic KeyValue # | |
| Hashable KeyValue # | |
Defined in Network.AWS.EMR.Types.Product | |
| ToJSON KeyValue # | |
Defined in Network.AWS.EMR.Types.Product | |
| NFData KeyValue # | |
Defined in Network.AWS.EMR.Types.Product | |
| type Rep KeyValue # | |
Defined in Network.AWS.EMR.Types.Product type Rep KeyValue = D1 (MetaData "KeyValue" "Network.AWS.EMR.Types.Product" "amazonka-emr-1.6.0-FYKfcui3Ox72PqQzDiwDXJ" False) (C1 (MetaCons "KeyValue'" PrefixI True) (S1 (MetaSel (Just "_kvValue") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)) :*: S1 (MetaSel (Just "_kvKey") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)))) | |
MetricDimension
data MetricDimension #
A CloudWatch dimension, which is specified using a Key (known as a Name in CloudWatch), Value pair. By default, Amazon EMR uses one dimension whose Key is JobFlowID and Value is a variable representing the cluster ID, which is > {emr.clusterId} . This enables the rule to bootstrap when the cluster ID becomes available.
See: metricDimension smart constructor.
Instances
metricDimension :: MetricDimension #
Creates a value of MetricDimension with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
PlacementType
data PlacementType #
The Amazon EC2 Availability Zone configuration of the cluster (job flow).
See: placementType smart constructor.
Instances
placementType :: PlacementType #
Creates a value of PlacementType with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ptAvailabilityZones- When multiple Availability Zones are specified, Amazon EMR evaluates them and launches instances in the optimal Availability Zone.AvailabilityZonesis used for instance fleets, whileAvailabilityZone(singular) is used for uniform instance groups.ptAvailabilityZone- The Amazon EC2 Availability Zone for the cluster.AvailabilityZoneis used for uniform instance groups, whileAvailabilityZones(plural) is used for instance fleets.
ptAvailabilityZones :: Lens' PlacementType [Text] #
When multiple Availability Zones are specified, Amazon EMR evaluates them and launches instances in the optimal Availability Zone. AvailabilityZones is used for instance fleets, while AvailabilityZone (singular) is used for uniform instance groups.
ptAvailabilityZone :: Lens' PlacementType (Maybe Text) #
The Amazon EC2 Availability Zone for the cluster. AvailabilityZone is used for uniform instance groups, while AvailabilityZones (plural) is used for instance fleets.
ScalingAction
data ScalingAction #
The type of adjustment the automatic scaling activity makes when triggered, and the periodicity of the adjustment.
See: scalingAction smart constructor.
Instances
Creates a value of ScalingAction with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
saMarket- Not available for instance groups. Instance groups use the market type specified for the group.saSimpleScalingPolicyConfiguration- The type of adjustment the automatic scaling activity makes when triggered, and the periodicity of the adjustment.
saMarket :: Lens' ScalingAction (Maybe MarketType) #
Not available for instance groups. Instance groups use the market type specified for the group.
saSimpleScalingPolicyConfiguration :: Lens' ScalingAction SimpleScalingPolicyConfiguration #
The type of adjustment the automatic scaling activity makes when triggered, and the periodicity of the adjustment.
ScalingConstraints
data ScalingConstraints #
The upper and lower EC2 instance limits for an automatic scaling policy. Automatic scaling activities triggered by automatic scaling rules will not cause an instance group to grow above or below these limits.
See: scalingConstraints smart constructor.
Instances
Arguments
| :: Int | |
| -> Int | |
| -> ScalingConstraints |
Creates a value of ScalingConstraints with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
scMinCapacity- The lower boundary of EC2 instances in an instance group below which scaling activities are not allowed to shrink. Scale-in activities will not terminate instances below this boundary.scMaxCapacity- The upper boundary of EC2 instances in an instance group beyond which scaling activities are not allowed to grow. Scale-out activities will not add instances beyond this boundary.
scMinCapacity :: Lens' ScalingConstraints Int #
The lower boundary of EC2 instances in an instance group below which scaling activities are not allowed to shrink. Scale-in activities will not terminate instances below this boundary.
scMaxCapacity :: Lens' ScalingConstraints Int #
The upper boundary of EC2 instances in an instance group beyond which scaling activities are not allowed to grow. Scale-out activities will not add instances beyond this boundary.
ScalingRule
data ScalingRule #
A scale-in or scale-out rule that defines scaling activity, including the CloudWatch metric alarm that triggers activity, how EC2 instances are added or removed, and the periodicity of adjustments. The automatic scaling policy for an instance group can comprise one or more automatic scaling rules.
See: scalingRule smart constructor.
Instances
Arguments
| :: Text | |
| -> ScalingAction | |
| -> ScalingTrigger | |
| -> ScalingRule |
Creates a value of ScalingRule with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
srDescription- A friendly, more verbose description of the automatic scaling rule.srName- The name used to identify an automatic scaling rule. Rule names must be unique within a scaling policy.srAction- The conditions that trigger an automatic scaling activity.srTrigger- The CloudWatch alarm definition that determines when automatic scaling activity is triggered.
srDescription :: Lens' ScalingRule (Maybe Text) #
A friendly, more verbose description of the automatic scaling rule.
srName :: Lens' ScalingRule Text #
The name used to identify an automatic scaling rule. Rule names must be unique within a scaling policy.
srAction :: Lens' ScalingRule ScalingAction #
The conditions that trigger an automatic scaling activity.
srTrigger :: Lens' ScalingRule ScalingTrigger #
The CloudWatch alarm definition that determines when automatic scaling activity is triggered.
ScalingTrigger
data ScalingTrigger #
The conditions that trigger an automatic scaling activity.
See: scalingTrigger smart constructor.
Instances
Creates a value of ScalingTrigger with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
stCloudWatchAlarmDefinition- The definition of a CloudWatch metric alarm. When the defined alarm conditions are met along with other trigger parameters, scaling activity begins.
stCloudWatchAlarmDefinition :: Lens' ScalingTrigger CloudWatchAlarmDefinition #
The definition of a CloudWatch metric alarm. When the defined alarm conditions are met along with other trigger parameters, scaling activity begins.
ScriptBootstrapActionConfig
data ScriptBootstrapActionConfig #
Configuration of the script to run during a bootstrap action.
See: scriptBootstrapActionConfig smart constructor.
Instances
Arguments
| :: Text | |
| -> ScriptBootstrapActionConfig |
Creates a value of ScriptBootstrapActionConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
sbacArgs :: Lens' ScriptBootstrapActionConfig [Text] #
A list of command line arguments to pass to the bootstrap action script.
sbacPath :: Lens' ScriptBootstrapActionConfig Text #
Location of the script to run during a bootstrap action. Can be either a location in Amazon S3 or on a local file system.
SecurityConfigurationSummary
data SecurityConfigurationSummary #
The creation date and time, and name, of a security configuration.
See: securityConfigurationSummary smart constructor.
Instances
securityConfigurationSummary :: SecurityConfigurationSummary #
Creates a value of SecurityConfigurationSummary with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
scsName- The name of the security configuration.scsCreationDateTime- The date and time the security configuration was created.
scsCreationDateTime :: Lens' SecurityConfigurationSummary (Maybe UTCTime) #
The date and time the security configuration was created.
ShrinkPolicy
data ShrinkPolicy #
Policy for customizing shrink operations. Allows configuration of decommissioning timeout and targeted instance shrinking.
See: shrinkPolicy smart constructor.
Instances
shrinkPolicy :: ShrinkPolicy #
Creates a value of ShrinkPolicy with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
spDecommissionTimeout- The desired timeout for decommissioning an instance. Overrides the default YARN decommissioning timeout.spInstanceResizePolicy- Custom policy for requesting termination protection or termination of specific instances when shrinking an instance group.
spDecommissionTimeout :: Lens' ShrinkPolicy (Maybe Int) #
The desired timeout for decommissioning an instance. Overrides the default YARN decommissioning timeout.
spInstanceResizePolicy :: Lens' ShrinkPolicy (Maybe InstanceResizePolicy) #
Custom policy for requesting termination protection or termination of specific instances when shrinking an instance group.
SimpleScalingPolicyConfiguration
data SimpleScalingPolicyConfiguration #
An automatic scaling configuration, which describes how the policy adds or removes instances, the cooldown period, and the number of EC2 instances that will be added each time the CloudWatch metric alarm condition is satisfied.
See: simpleScalingPolicyConfiguration smart constructor.
Instances
simpleScalingPolicyConfiguration #
Arguments
| :: Int | |
| -> SimpleScalingPolicyConfiguration |
Creates a value of SimpleScalingPolicyConfiguration with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
sspcAdjustmentType- The way in which EC2 instances are added (ifScalingAdjustmentis a positive number) or terminated (ifScalingAdjustmentis a negative number) each time the scaling activity is triggered.CHANGE_IN_CAPACITYis the default.CHANGE_IN_CAPACITYindicates that the EC2 instance count increments or decrements byScalingAdjustment, which should be expressed as an integer.PERCENT_CHANGE_IN_CAPACITYindicates the instance count increments or decrements by the percentage specified byScalingAdjustment, which should be expressed as an integer. For example, 20 indicates an increase in 20% increments of cluster capacity.EXACT_CAPACITYindicates the scaling activity results in an instance group with the number of EC2 instances specified byScalingAdjustment, which should be expressed as a positive integer.sspcCoolDown- The amount of time, in seconds, after a scaling activity completes before any further trigger-related scaling activities can start. The default value is 0.sspcScalingAdjustment- The amount by which to scale in or scale out, based on the specifiedAdjustmentType. A positive value adds to the instance group's EC2 instance count while a negative number removes instances. IfAdjustmentTypeis set toEXACT_CAPACITY, the number should only be a positive integer. IfAdjustmentTypeis set toPERCENT_CHANGE_IN_CAPACITY, the value should express the percentage as an integer. For example, -20 indicates a decrease in 20% increments of cluster capacity.
sspcAdjustmentType :: Lens' SimpleScalingPolicyConfiguration (Maybe AdjustmentType) #
The way in which EC2 instances are added (if ScalingAdjustment is a positive number) or terminated (if ScalingAdjustment is a negative number) each time the scaling activity is triggered. CHANGE_IN_CAPACITY is the default. CHANGE_IN_CAPACITY indicates that the EC2 instance count increments or decrements by ScalingAdjustment , which should be expressed as an integer. PERCENT_CHANGE_IN_CAPACITY indicates the instance count increments or decrements by the percentage specified by ScalingAdjustment , which should be expressed as an integer. For example, 20 indicates an increase in 20% increments of cluster capacity. EXACT_CAPACITY indicates the scaling activity results in an instance group with the number of EC2 instances specified by ScalingAdjustment , which should be expressed as a positive integer.
sspcCoolDown :: Lens' SimpleScalingPolicyConfiguration (Maybe Int) #
The amount of time, in seconds, after a scaling activity completes before any further trigger-related scaling activities can start. The default value is 0.
sspcScalingAdjustment :: Lens' SimpleScalingPolicyConfiguration Int #
The amount by which to scale in or scale out, based on the specified AdjustmentType . A positive value adds to the instance group's EC2 instance count while a negative number removes instances. If AdjustmentType is set to EXACT_CAPACITY , the number should only be a positive integer. If AdjustmentType is set to PERCENT_CHANGE_IN_CAPACITY , the value should express the percentage as an integer. For example, -20 indicates a decrease in 20% increments of cluster capacity.
SpotProvisioningSpecification
data SpotProvisioningSpecification #
The launch specification for Spot instances in the instance fleet, which determines the defined duration and provisioning timeout behavior.
See: spotProvisioningSpecification smart constructor.
Instances
spotProvisioningSpecification #
Arguments
| :: Natural | |
| -> SpotProvisioningTimeoutAction | |
| -> SpotProvisioningSpecification |
Creates a value of SpotProvisioningSpecification with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
spsBlockDurationMinutes- The defined duration for Spot instances (also known as Spot blocks) in minutes. When specified, the Spot instance does not terminate before the defined duration expires, and defined duration pricing for Spot instances applies. Valid values are 60, 120, 180, 240, 300, or 360. The duration period starts as soon as a Spot instance receives its instance ID. At the end of the duration, Amazon EC2 marks the Spot instance for termination and provides a Spot instance termination notice, which gives the instance a two-minute warning before it terminates.spsTimeoutDurationMinutes- The spot provisioning timeout period in minutes. If Spot instances are not provisioned within this time period, theTimeOutActionis taken. Minimum value is 5 and maximum value is 1440. The timeout applies only during initial provisioning, when the cluster is first created.spsTimeoutAction- The action to take whenTargetSpotCapacityhas not been fulfilled when theTimeoutDurationMinuteshas expired. Spot instances are not uprovisioned within the Spot provisioining timeout. Valid values areTERMINATE_CLUSTERandSWITCH_TO_ON_DEMAND. SWITCH_TO_ON_DEMAND specifies that if no Spot instances are available, On-Demand Instances should be provisioned to fulfill any remaining Spot capacity.
spsBlockDurationMinutes :: Lens' SpotProvisioningSpecification (Maybe Natural) #
The defined duration for Spot instances (also known as Spot blocks) in minutes. When specified, the Spot instance does not terminate before the defined duration expires, and defined duration pricing for Spot instances applies. Valid values are 60, 120, 180, 240, 300, or 360. The duration period starts as soon as a Spot instance receives its instance ID. At the end of the duration, Amazon EC2 marks the Spot instance for termination and provides a Spot instance termination notice, which gives the instance a two-minute warning before it terminates.
spsTimeoutDurationMinutes :: Lens' SpotProvisioningSpecification Natural #
The spot provisioning timeout period in minutes. If Spot instances are not provisioned within this time period, the TimeOutAction is taken. Minimum value is 5 and maximum value is 1440. The timeout applies only during initial provisioning, when the cluster is first created.
spsTimeoutAction :: Lens' SpotProvisioningSpecification SpotProvisioningTimeoutAction #
The action to take when TargetSpotCapacity has not been fulfilled when the TimeoutDurationMinutes has expired. Spot instances are not uprovisioned within the Spot provisioining timeout. Valid values are TERMINATE_CLUSTER and SWITCH_TO_ON_DEMAND . SWITCH_TO_ON_DEMAND specifies that if no Spot instances are available, On-Demand Instances should be provisioned to fulfill any remaining Spot capacity.
Step
This represents a step in a cluster.
See: step smart constructor.
Instances
| Eq Step # | |
| Data Step # | |
Defined in Network.AWS.EMR.Types.Product Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> Step -> c Step # gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c Step # dataTypeOf :: Step -> DataType # dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c Step) # dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c Step) # gmapT :: (forall b. Data b => b -> b) -> Step -> Step # gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> Step -> r # gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> Step -> r # gmapQ :: (forall d. Data d => d -> u) -> Step -> [u] # gmapQi :: Int -> (forall d. Data d => d -> u) -> Step -> u # gmapM :: Monad m => (forall d. Data d => d -> m d) -> Step -> m Step # gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> Step -> m Step # gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> Step -> m Step # | |
| Read Step # | |
| Show Step # | |
| Generic Step # | |
| Hashable Step # | |
Defined in Network.AWS.EMR.Types.Product | |
| FromJSON Step # | |
| NFData Step # | |
Defined in Network.AWS.EMR.Types.Product | |
| type Rep Step # | |
Defined in Network.AWS.EMR.Types.Product type Rep Step = D1 (MetaData "Step" "Network.AWS.EMR.Types.Product" "amazonka-emr-1.6.0-FYKfcui3Ox72PqQzDiwDXJ" False) (C1 (MetaCons "Step'" PrefixI True) ((S1 (MetaSel (Just "_sStatus") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe StepStatus)) :*: S1 (MetaSel (Just "_sActionOnFailure") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe ActionOnFailure))) :*: (S1 (MetaSel (Just "_sConfig") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe HadoopStepConfig)) :*: (S1 (MetaSel (Just "_sName") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)) :*: S1 (MetaSel (Just "_sId") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)))))) | |
Creates a value of Step with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
sStatus- The current execution status details of the cluster step.sActionOnFailure- This specifies what action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER, CANCEL_AND_WAIT, and CONTINUE.sConfig- The Hadoop job configuration of the cluster step.sName- The name of the cluster step.sId- The identifier of the cluster step.
sActionOnFailure :: Lens' Step (Maybe ActionOnFailure) #
This specifies what action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER, CANCEL_AND_WAIT, and CONTINUE.
StepConfig
data StepConfig #
Specification of a cluster (job flow) step.
See: stepConfig smart constructor.
Instances
Arguments
| :: Text | |
| -> HadoopJARStepConfig | |
| -> StepConfig |
Creates a value of StepConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
scActionOnFailure- The action to take if the step fails.scName- The name of the step.scHadoopJARStep- The JAR file used for the step.
scActionOnFailure :: Lens' StepConfig (Maybe ActionOnFailure) #
The action to take if the step fails.
scName :: Lens' StepConfig Text #
The name of the step.
scHadoopJARStep :: Lens' StepConfig HadoopJARStepConfig #
The JAR file used for the step.
StepStateChangeReason
data StepStateChangeReason #
The details of the step state change reason.
See: stepStateChangeReason smart constructor.
Instances
stepStateChangeReason :: StepStateChangeReason #
Creates a value of StepStateChangeReason with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
sscrCode- The programmable code for the state change reason. Note: Currently, the service provides no code for the state change.sscrMessage- The descriptive message for the state change reason.
sscrCode :: Lens' StepStateChangeReason (Maybe StepStateChangeReasonCode) #
The programmable code for the state change reason. Note: Currently, the service provides no code for the state change.
sscrMessage :: Lens' StepStateChangeReason (Maybe Text) #
The descriptive message for the state change reason.
StepStatus
data StepStatus #
The execution status details of the cluster step.
See: stepStatus smart constructor.
Instances
Creates a value of StepStatus with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ssState- The execution state of the cluster step.ssFailureDetails- The details for the step failure including reason, message, and log file path where the root cause was identified.ssStateChangeReason- The reason for the step execution status change.ssTimeline- The timeline of the cluster step status over time.
ssFailureDetails :: Lens' StepStatus (Maybe FailureDetails) #
The details for the step failure including reason, message, and log file path where the root cause was identified.
ssStateChangeReason :: Lens' StepStatus (Maybe StepStateChangeReason) #
The reason for the step execution status change.
ssTimeline :: Lens' StepStatus (Maybe StepTimeline) #
The timeline of the cluster step status over time.
StepSummary
data StepSummary #
The summary of the cluster step.
See: stepSummary smart constructor.
Instances
Creates a value of StepSummary with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
ssStatus- The current execution status details of the cluster step.ssActionOnFailure- This specifies what action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER, CANCEL_AND_WAIT, and CONTINUE.ssConfig- The Hadoop job configuration of the cluster step.ssName- The name of the cluster step.ssId- The identifier of the cluster step.
ssStatus :: Lens' StepSummary (Maybe StepStatus) #
The current execution status details of the cluster step.
ssActionOnFailure :: Lens' StepSummary (Maybe ActionOnFailure) #
This specifies what action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER, CANCEL_AND_WAIT, and CONTINUE.
ssConfig :: Lens' StepSummary (Maybe HadoopStepConfig) #
The Hadoop job configuration of the cluster step.
StepTimeline
data StepTimeline #
The timeline of the cluster step lifecycle.
See: stepTimeline smart constructor.
Instances
stepTimeline :: StepTimeline #
Creates a value of StepTimeline with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
stCreationDateTime- The date and time when the cluster step was created.stEndDateTime- The date and time when the cluster step execution completed or failed.stStartDateTime- The date and time when the cluster step execution started.
stCreationDateTime :: Lens' StepTimeline (Maybe UTCTime) #
The date and time when the cluster step was created.
stEndDateTime :: Lens' StepTimeline (Maybe UTCTime) #
The date and time when the cluster step execution completed or failed.
stStartDateTime :: Lens' StepTimeline (Maybe UTCTime) #
The date and time when the cluster step execution started.
SupportedProductConfig
data SupportedProductConfig #
The list of supported product configurations which allow user-supplied arguments. EMR accepts these arguments and forwards them to the corresponding installation script as bootstrap action arguments.
See: supportedProductConfig smart constructor.
Instances
supportedProductConfig :: SupportedProductConfig #
Creates a value of SupportedProductConfig with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
spcArgs :: Lens' SupportedProductConfig [Text] #
The list of user-supplied arguments.
Tag
A keyvalue pair containing user-defined metadata that you can associate with an Amazon EMR resource. Tags make it easier to associate clusters in various ways, such as grouping clusters to track your Amazon EMR resource allocation costs. For more information, see <http:docs.aws.amazon.comemrlatestManagementGuide/emr-plan-tags.html Tag Clusters> .
See: tag smart constructor.
Instances
| Eq Tag # | |
| Data Tag # | |
Defined in Network.AWS.EMR.Types.Product Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> Tag -> c Tag # gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c Tag # dataTypeOf :: Tag -> DataType # dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c Tag) # dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c Tag) # gmapT :: (forall b. Data b => b -> b) -> Tag -> Tag # gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> Tag -> r # gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> Tag -> r # gmapQ :: (forall d. Data d => d -> u) -> Tag -> [u] # gmapQi :: Int -> (forall d. Data d => d -> u) -> Tag -> u # gmapM :: Monad m => (forall d. Data d => d -> m d) -> Tag -> m Tag # gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> Tag -> m Tag # gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> Tag -> m Tag # | |
| Read Tag # | |
| Show Tag # | |
| Generic Tag # | |
| Hashable Tag # | |
Defined in Network.AWS.EMR.Types.Product | |
| ToJSON Tag # | |
Defined in Network.AWS.EMR.Types.Product | |
| FromJSON Tag # | |
| NFData Tag # | |
Defined in Network.AWS.EMR.Types.Product | |
| type Rep Tag # | |
Defined in Network.AWS.EMR.Types.Product type Rep Tag = D1 (MetaData "Tag" "Network.AWS.EMR.Types.Product" "amazonka-emr-1.6.0-FYKfcui3Ox72PqQzDiwDXJ" False) (C1 (MetaCons "Tag'" PrefixI True) (S1 (MetaSel (Just "_tagValue") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)) :*: S1 (MetaSel (Just "_tagKey") NoSourceUnpackedness SourceStrict DecidedStrict) (Rec0 (Maybe Text)))) | |
Creates a value of Tag with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
tagValue- A user-defined value, which is optional in a tag. For more information, see Tag Clusters .tagKey- A user-defined key, which is the minimum required information for a valid tag. For more information, see Tag .
tagValue :: Lens' Tag (Maybe Text) #
A user-defined value, which is optional in a tag. For more information, see Tag Clusters .
tagKey :: Lens' Tag (Maybe Text) #
A user-defined key, which is the minimum required information for a valid tag. For more information, see Tag .
VolumeSpecification
data VolumeSpecification #
EBS volume specifications such as volume type, IOPS, and size (GiB) that will be requested for the EBS volume attached to an EC2 instance in the cluster.
See: volumeSpecification smart constructor.
Instances
Arguments
| :: Text | |
| -> Int | |
| -> VolumeSpecification |
Creates a value of VolumeSpecification with the minimum fields required to make a request.
Use one of the following lenses to modify other fields as desired:
vsIOPS- The number of I/O operations per second (IOPS) that the volume supports.vsVolumeType- The volume type. Volume types supported are gp2, io1, standard.vsSizeInGB- The volume size, in gibibytes (GiB). This can be a number from 1 - 1024. If the volume type is EBS-optimized, the minimum value is 10.
vsIOPS :: Lens' VolumeSpecification (Maybe Int) #
The number of I/O operations per second (IOPS) that the volume supports.
vsVolumeType :: Lens' VolumeSpecification Text #
The volume type. Volume types supported are gp2, io1, standard.
vsSizeInGB :: Lens' VolumeSpecification Int #
The volume size, in gibibytes (GiB). This can be a number from 1 - 1024. If the volume type is EBS-optimized, the minimum value is 10.