DynamicSchemaLoader

(This component is experimental. Use at your own risk.) Loads a schema by extracting data from retrieved records.

• type: object
• required: ["type","retriever","schema_type_identifier"]

type

• Required: Yes
• type: string
• enum: ["DynamicSchemaLoader"]

retriever

Component used to coordinate how records are extracted across stream slices and request pages.

• Required: Yes

• anyOf:

  • Allowed type: SimpleRetriever

• anyOf:

  • Allowed type: AsyncRetriever

• anyOf:

  • Allowed type: CustomRetriever

schema_filter

Responsible for filtering fields to be added to json schema.

• Required: No

• anyOf:

  • Allowed type: RecordFilter

• anyOf:

  • Allowed type: CustomRecordFilter

schema_transformations

A list of transformations to be applied to the schema.

• Required: No

• type: array

• items:

  • anyOf:

    • Allowed type: AddFields

  • anyOf:

    • Allowed type: RemoveFields

  • anyOf:

    • Allowed type: KeysToLower

  • anyOf:

    • Allowed type: KeysToSnakeCase

  • anyOf:

    • Allowed type: FlattenFields

  • anyOf:

    • Allowed type: DpathFlattenFields

  • anyOf:

    • Allowed type: KeysReplace

  • anyOf:

    • Allowed type: CustomTransformation

schema_type_identifier

• Required: Yes
• Allowed type: SchemaTypeIdentifier

$parameters

• Required: No
• type: object