Meet the TheyDo Agent

Read more in our blog→

Pull in surveys and feedback from Amazon S3

Reviewer note: Beta feature, available on Management and Strategic plans. Ask your CSM

Overview

This article is for teams who already use the Amazon S3 integration and want to bring qualitative data, such as survey responses and open-text feedback, into the Data Hub. Until now the S3 pipeline imported structured records: solutions, insights, opportunities, and metrics. It can now also import survey and feedback responses, which land in the Data Hub as Quotes, ready to explore with the TheyDo Agent and to turn into insights with AI mining. This article covers what the feedback import adds, how to prepare your export, and how the data flows in.

Before you start

The feedback import runs on top of your existing Amazon S3 integration, so you need that connection in place first. If you have not set up Amazon S3 yet, follow Amazon S3 integration, then come back here.

Like the rest of the S3 integration, this is set up together with the TheyDo team, and you will need your IT or data team to prepare the export. What is new is that you now also export a survey or feedback file, formatted to TheyDo's survey and feedback schema, alongside any structured files you already send.

How survey and feedback data lands in TheyDo

When you import a survey or feedback file, each response becomes one or more Quotes in the Data Hub, rather than a structured record. You control how that happens:

  • Let TheyDo's AI extract one or more Quotes from a longer response, so a single detailed answer can yield several distinct Quotes.
  • Or import each row verbatim as a single Quote, when you want the response preserved exactly as written.

Field mapping is flexible. You can bring each column in as plain text, map it to a tag group, or map it to a persona, and you can ignore columns you do not need. This means the tags and personas you already maintain in your source data carry through, so Quotes arrive already organized.

How the import works

  1. Set up the Amazon S3 integration with the TheyDo team if you have not already. Select Contact us on the Amazon S3 card in Settings > Integrations to start.
  2. Prepare your survey or feedback export as JSON, formatted to TheyDo's survey and feedback schema (see the next section).
  3. Validate the export with the TheyDo team, so you can confirm the Quotes, tags, and personas come through as expected before it goes live.
  4. Upload your files to the S3 bucket at the frequency you choose. Most teams sync daily.
  5. TheyDo validates each file against the schema and ingests it. The responses appear in the Data Hub as Quotes in the Quotes Library.

Note: The Amazon S3 integration validates every file against the schema on upload. If a file does not match, the errors are reported so your team can fix and re-upload.

Prepare your export

Your survey or feedback file follows a published JSON schema. At a high level it includes:

  • Source metadata: a display name and a stable source identifier for the survey or feedback stream, plus the field definitions.
  • Response data: for each response, a unique response identifier, a UTC submission timestamp, and the mapped field values.
  • Field mapping: for each field, whether it comes in as plain text, a tag group, or a persona, or is ignored.

To update an existing source, re-upload a file that uses the same survey or feedback identifier. TheyDo updates the existing data source rather than creating a duplicate.

You can find the schema definitions, example files, and a command-line tool for validation and upload in TheyDo's public repository at github.com/theydo/theydo-s3-integrations.

Tip: Have your data team run the export through the CLI tool before the first real upload. It validates the file against the schema and tests the connection, so mapping problems surface on their machine rather than after ingestion.

Work with the imported feedback

Once your responses are in the Data Hub, they behave like any other Quotes there. You can:

  • Explore and analyze the Quotes with the TheyDo Agent.
  • Run AI mining to turn the feedback into insights mapped onto journey steps.
  • Select the source when you create a new journey, or use it to enrich an existing one.

Because you can re-upload on a schedule, new responses keep flowing in, and AI mining can keep surfacing insights as fresh feedback arrives.

Tip: Amazon S3 already brings your structured data, such as metrics from a BI tool, into TheyDo. Adding survey and feedback responses through the same pipeline means the numbers and the reasons behind them arrive side by side, ready to sit together on a journey.