ETLJobPost

pydantic model openapi_client.models.etl_job_post.ETLJobPost

Create-job request body. Required fields are JobName and ETLJobType. DatasetAccess is required for a full create (not when quickCreate=yes). Unknown keys are rejected (IPV-1040).

Fields:
field job_name: StrictStr [Required] (alias 'JobName')

Unique job name stored in Glue and Amorphic metadata. Required on create. Cannot be changed after create.

Constraints:

  • strict = True

field description: Optional[StrictStr] = None (alias 'Description')

Optional free-text description shown in job details.

field allocated_capacity: Optional[Union[StrictFloat, StrictInt]] = None (alias 'AllocatedCapacity')

Legacy capacity field; remapped to MaxCapacity when used.

field default_arguments: Optional[Dict[str, StrictStr]] = None (alias 'DefaultArguments')

Glue default arguments. Reserved keys such as –TempDir, –job-bookmark-option, –extra-py-files, and –enable-auto-scaling cannot be set by the client (JOB-1002).

field etl_job_type: StrictStr [Required] (alias 'ETLJobType')

Job runtime type. Cannot be changed after create.

Constraints:

  • strict = True

field dataset_access: Optional[DatasetAccess] = None (alias 'DatasetAccess')
field tags_attached: Optional[List[TbacTag]] = None (alias 'TagsAttached')
field parameter_access: Optional[List[StrictStr]] = None (alias 'ParameterAccess')

ParameterKey values the job may read. Create allows at most 25 parameters (JOB-1003).

field max_retries: Optional[StrictInt] = None (alias 'MaxRetries')

Number of automatic Glue retries after a failed run.

field timeout: Optional[StrictInt] = None (alias 'Timeout')

Job timeout in minutes.

field max_concurrent_runs: Optional[StrictInt] = None (alias 'MaxConcurrentRuns')

Maximum concurrent Glue runs allowed for this job.

field notify_delay_after: Optional[StrictInt] = None (alias 'NotifyDelayAfter')

Minutes to wait before Glue delay notifications.

field python_version: Optional[StrictStr] = None (alias 'PythonVersion')

Defaults to 3 for spark and 3.9 for pythonshell. Pythonshell accepts 3.9 only.

field glue_version: Optional[StrictStr] = None (alias 'GlueVersion')

Glue version for spark jobs (for example 4.0). Not valid for pythonshell.

field worker_type: Optional[StrictStr] = None (alias 'WorkerType')

Spark worker type used with NumberOfWorkers (for example G.1X). Not used for pythonshell.

field number_of_workers: Optional[StrictInt] = None (alias 'NumberOfWorkers')

Spark worker count. Must be sent with WorkerType. Not used for pythonshell (use MaxCapacity).

field network_configuration: Optional[StrictStr] = None (alias 'NetworkConfiguration')

Network/VPC configuration mapped to a Glue connection

field domain_access: Optional[DomainAccess] = None (alias 'DomainAccess')
field is_auto_scaling_enabled: Optional[StrictBool] = None (alias 'IsAutoScalingEnabled')

Must be a boolean. When true, requires Glue >= 3.0 and a supported worker type.

field is_data_lineage_enabled: Optional[StrictStr] = None (alias 'IsDataLineageEnabled')

Stored as yes/no. Default no.

field shared_libraries: Optional[List[StrictStr]] = None (alias 'SharedLibraries')

Shared library IDs. Maximum 25.

field python_lib_paths: Optional[List[StrictStr]] = None (alias 'PythonLibPaths')

S3 URIs of Python libraries uploaded for this job (under {jobId}/libs/python). Shared common-libs paths cannot be changed via PUT /jobs/{id}/libs.

field keywords: Optional[List[StrictStr]] = None (alias 'Keywords')

Optional tags stored on the job metadata.

field max_capacity: Optional[Union[StrictFloat, StrictInt]] = None (alias 'MaxCapacity')

DPUs. For pythonshell must be in [0.0625, 1]. Deprecated for spark Glue 2.0+ (use WorkerType/NumberOfWorkers).

field code_template_id: Optional[StrictStr] = None (alias 'CodeTemplateId')

Optional template ID; when set, RegistrationStatus becomes completed.

field job_bookmark_option: Optional[StrictStr] = None (alias 'JobBookmarkOption')

Job bookmark mode; enable/pause are not supported for pythonshell

field cost_tags: Optional[List[ETLJobPostCostTagsInner]] = None (alias 'CostTags')

Included when cost management is enabled.

to_str()

Returns the string representation of the model using alias

Return type:

str

to_json()

Returns the JSON representation of the model using alias

Return type:

str

classmethod from_json(json_str)

Create an instance of ETLJobPost from a JSON string

Return type:

Optional[Self]

to_dict()

Return the dictionary representation of the model using alias.

This has the following differences from calling pydantic’s self.model_dump(by_alias=True):

  • None is only added to the output dict for nullable fields that were set at model initialization. Other fields with value None are ignored.

Return type:

Dict[str, Any]

classmethod from_dict(obj)

Create an instance of ETLJobPost from a dict

Return type:

Optional[Self]