Extract data from an API and load it to S3 on schedule (every Friday afternoon)

About this blueprint

S3 Ingest API

This flow extracts data from an HTTP API and loads it to S3 as a JSON file on every Friday afternoon at 5pm.

yaml

id: api_to_s3
namespace: company.team
tasks:
  - id: get_pokemon
    type: io.kestra.plugin.core.http.Download
    method: GET
    uri: https://pokeapi.co/api/v2/pokemon/psyduck
  - id: upload
    type: io.kestra.plugin.aws.s3.Upload
    bucket: kestraio
    from: "{{ outputs.get_pokemon.uri }}"
    key: psyduck.json
    accessKeyId: "{{ secret('AWS_ACCESS_KEY_ID') }}"
    secretKeyId: "{{ secret('AWS_SECRET_ACCESS_KEY') }}"
    region: "{{ secret('AWS_DEFAULT_REGION') }}"
triggers:
  - id: every_friday_afternoon
    type: io.kestra.plugin.core.trigger.Schedule
    timezone: Europe/Berlin
    cron: 0 17 * * FRI

Download

Upload

Schedule

New to Kestra?

Use blueprints to kickstart your first workflows.

Get started with Kestra