Data refresh settings: Achieve better and smarter data management with this brand-new feature

Data-driven marketers and data engineers know the struggle to efficiently manage massive datasets, especially when dealing with non-aggregatable metrics like reach and frequency. Pulling, processing, and analyzing this data can feel like navigating a maze, consuming precious time and resources.

But what if there were a way to streamline the process, gaining agility and unlocking deeper insights? Introducing a new feature in Supermetrics’ Marketing Intelligence Platform—data refresh settings.

The challenge with managing data

Digital marketing produces tons of data. But finding just the right information, without all the noise, can be tough for both marketers and data engineers. Some common problems include:

• Data overload: Pulling more historical data than necessary slows transfers and consumes valuable API quotas.
• Limited control: Lack of granular control over date ranges limits the ability to focus on precisely the data points required for specific analyses.
• Non-aggregatable metric headaches: Reach, frequency, and other non-aggregatable metrics present unique hurdles for efficient data management.
• Manual data wrangling: Tracking changes over time, like follower growth on social media, often involves time-consuming manual tasks.

Improve your data workflow with data refresh setting

Supermetrics' new data refresh settings make managing data in your data war easier. This feature lets you fine-tune your data extraction process for maximum efficiency and insights.

• Smarter data pulls: Get exactly the data you need, exactly when you need it—nothing more, nothing less.
• Faster performance: Smaller data loads mean lightning-fast transfers, so you can analyze sooner and act quicker.
• Lower costs: Use your data warehouse and API quotas more efficiently to reduce storage and usage costs.
• Simplified metrics: Work seamlessly with tricky metrics like reach and frequency, and get clearer insights into performance.
• Automated tracking: Monitoring trends like rolling averages or lifetime value automatically.

Three refresh modes to suit your needs:

Append + deduplicate by date

What it does: Updates data for specific dates by replacing only the changed data.

Use it when: You want to keep your time-series data fresh without reloading everything—just update the parts that changed.

Append only

What it does: Adds the latest data to your existing dataset. If Supermetrics refreshed data for the same day, those rows are updated—others stay the same.

Use it when: You’re tracking rolling metrics like 28-day reach or frequency and want to add new data without touching historical records.

Full overwrite

What it does: Replaces your entire dataset with the latest version.

Use it when: You’re working with non-time-series data, like CRM records, where you always want the freshest full snapshot.

The power of the lookback window:

The Lookback Window lets you choose exactly how far back you want to pull data—7 days, 30 days, or whatever you need. This helps avoid pulling extra data, making everything run faster and more efficiently. (Heads up: It's not fully available with Append + Deduplicate mode just yet, but it will be soon)

Getting started with data refresh settings

To access this new feature:

Navigate to transfer settings: In hub.supermetrics.com, click ‘Storage’ >> ‘Transfer’

Edit your transfer: Select a transfer and choose ‘Edit transfer’

Select your table: Go to the Tables section and choose the desired table.

Choose your refresh mode and lookback window: Tailor the settings to your specific needs.

Save it: Sit back and watch your data transfers become faster and more efficient.

The data refresh setting feature gives marketers and data engineers the power to control their data. They enable faster insights, reduced costs, and a significantly more efficient data workflow.

Learn more about this feature from our support articles:

• About default refresh types and lookback windows
• About lookback windows in data warehouse transfers
• About refresh modes in data warehouse transfers