--- title: "Validating Big Data at Scale" description: "A talk from CEO/co-founder Spenser Skates on the key data challenges that we face collecting data from hundreds of millions of devices" canonical: "https://amplitude.com/en-us/blog/validating-big-data-at-scale" --- # Validating Big Data at Scale A talk from CEO/co-founder Spenser Skates on the key data challenges that we face collecting data from hundreds of millions of devices Source: https://amplitude.com/en-us/blog/validating-big-data-at-scale --- [Data Monster](/blog/author/datamonster) [Mascot, Amplitude](/blog/author/datamonster) [](https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Famplitude.com%2Fblog%2F%2Fblog%2Fvalidating-big-data-at-scale)[](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Famplitude.com%2Fblog%2F%2Fblog%2Fvalidating-big-data-at-scale)[](https://twitter.com/intent/tweet?url=https%3A%2F%2Famplitude.com%2Fblog%2F%2Fblog%2Fvalidating-big-data-at-scale\&text=Validating%20big%20data%20at%20scale)[](mailto:?subject=Checkout%20this%20Amplitude%20Article\&body=Check%20this%20out%3A%20https%3A%2F%2Famplitude.com%2Fblog%2F%2Fblog%2Fvalidating-big-data-at-scale) A couple months ago, our co-founder and CEO Spenser had the pleasure of giving a tech talk hosted by our good friends at KeepSafe. He went over some of the key data challenges that we face when we’re simultaneously collecting data from hundreds of millions of devices, including: - data getting mangled in transit - client sending the same data twice - device clocks being inaccurate Check out the video and slides if you’re a data scientist facing similar problems — or if you’re just interested in how we clean up our customers’ user data! [**Validating big data at scale**](//www.slideshare.net/amplitudemobile/validating-big-data-at-scale) from [**Amplitude Analytics**](https://www.slideshare.net/amplitudemobile) About the author Data Monster Mascot, Amplitude [More from Data](/blog/author/datamonster) Data Monster spends most of its time nom nomming data and fulfilling duties as a cultural icon and brand ambassador for Amplitude. Data Monster wants everyone to know that there's a little data monster in all of us. [More from Data](/blog/author/datamonster) Topics #### Recommended Reading [Read ](/blog/holiday-checkout-friction) [Product](/blog/holiday-checkout-friction) ###### [Find Your Holiday Checkout Friction Before Peak Traffic Does](/blog/holiday-checkout-friction) [Oct 26, 2026](/blog/holiday-checkout-friction) [8 min read](/blog/holiday-checkout-friction) [Read ](/blog/amplitude-github-learning-loop) [Product](/blog/amplitude-github-learning-loop) ###### [Amplitude + GitHub Agents: Closing the Product Learning Loop](/blog/amplitude-github-learning-loop) [Oct 19, 2026](/blog/amplitude-github-learning-loop) [4 min read](/blog/amplitude-github-learning-loop) [Read ](/blog/lessons-from-consolidating-our-mcp-server) [Insights](/blog/lessons-from-consolidating-our-mcp-server) ###### [Lessons from consolidating our MCP server](/blog/lessons-from-consolidating-our-mcp-server) [Oct 6, 2026](/blog/lessons-from-consolidating-our-mcp-server) [10 min read](/blog/lessons-from-consolidating-our-mcp-server) [Read ](/blog/what-ai-engineers-do) [Insights](/blog/what-ai-engineers-do) ###### [What AI engineers do in the age of agentic code](/blog/what-ai-engineers-do) [Oct 1, 2026](/blog/what-ai-engineers-do) [14 min read](/blog/what-ai-engineers-do) #### Explore Related Content [101](/compare/top-feature-flag-solutions-for-product-teams) ###### [9 Top Feature Flag Solutions for Modern Product Teams in 2026](/compare/top-feature-flag-solutions-for-product-teams) [Jan 27, 2026](/compare/top-feature-flag-solutions-for-product-teams) [Integration](/blog/amplitude-hubspot-behavioral-analytics) ###### [Using behavioral analytics for growth with the Amplitude app on HubSpot](/blog/amplitude-hubspot-behavioral-analytics) [Jun 17, 2024](/blog/amplitude-hubspot-behavioral-analytics) [10 min read](/blog/amplitude-hubspot-behavioral-analytics) [Personalization](/blog/identity-resolution-insights) ###### [Identity resolution: The secret to a 360-degree customer view](/blog/identity-resolution-insights) [Feb 16, 2024](/blog/identity-resolution-insights) [10 min read](/blog/identity-resolution-insights) [Product](/blog/warehouse-native-technical-deep-dive) ###### [Inside warehouse-native Amplitude: A technical deep dive](/blog/warehouse-native-technical-deep-dive) [Jun 27, 2023](/blog/warehouse-native-technical-deep-dive) [15 min read](/blog/warehouse-native-technical-deep-dive) [Guide](/resources/boost-customer-engagement) ###### [5 Proven Strategies to Boost Customer Engagement](/resources/boost-customer-engagement) [Jul 12, 2023](/resources/boost-customer-engagement) [Video](/designing-high-impact-experiments) ###### [Designing High-Impact Experiments](/designing-high-impact-experiments) [May 13, 2024](/designing-high-impact-experiments) [Startup](/blog/direct-to-consumer-marketing-tactics) ###### [9 direct-to-consumer marketing tactics to accelerate ecommerce growth](/blog/direct-to-consumer-marketing-tactics) [Feb 20, 2024](/blog/direct-to-consumer-marketing-tactics) [10 min read](/blog/direct-to-consumer-marketing-tactics) [Growth](/blog/analytics-product-market-fit) ###### [Leveraging analytics to achieve product-market fit](/blog/analytics-product-market-fit) [Jul 20, 2023](/blog/analytics-product-market-fit) [10 min read](/blog/analytics-product-market-fit)