🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 89 (from laksa123)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄
INDEXABLE
CRAWLED
1 month ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH1.3 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://clickhouse.com/videos/lost-in-the-haystack-optimizing-high-cardinality-aggregations
Last Crawled2026-03-03 10:49:08 (1 month ago)
First Indexed2024-06-08 19:59:53 (1 year ago)
HTTP Status Code200
Meta TitleLost in the Haystack - Optimizing High Cardinality Aggregations
Meta Descriptionnull
Meta Canonicalnull
Boilerpipe Text
Download full logo Download logomark English Japanese Products Products ClickHouse Cloud The best way to use ClickHouse. Available on AWS, GCP, and Azure. Bring Your Own Cloud A fully managed ClickHouse service, deployed in your own AWS and GCP account. Postgres managed by ClickHouse Unified data stack for transactions and analytics. Managed ClickStack Managed observability with high-performance queries and long-term retention. Langfuse Cloud LLM observability and evaluations for reliable AI applications and agents. Open source ClickHouse Fast open-source OLAP database for real-time analytics. ClickStack Open-source observability stack for logs, metrics, traces, and session replays. Agentic Data Stack Build AI-powered applications with ClickHouse. Solutions Use cases Real-time analytics Observability Data warehousing Machine learning and GenAI All use cases All use cases  -> -> Industries Cybersecurity Gaming and entertainment E-commerce and retail Automotive Energy All industries All industries  -> -> Docs Resources User stories Blog Events News Learning and certification Comparisons Benchmark hub BigQuery PostgreSQL Redshift Snowflake Elastic Observability Splunk OpenSearch For observability Videos Demos Pricing Contact us English Japanese 46.1k Sign in Videos Meetups Previous video Scaling ClickHouse to petabytes of logs at OpenAI Next video ClickHouse v24.5 Community Call Colton Allen, Sentry.io This presentation was given at the ClickHouse Community Meetup in San Francisco - https://www.meetup.com/clickhouse-silicon-valley-meetup-group/events/296334923/ If you are interested in attending a future event, please join a Meetup Group near you at https://www.meetup.com/pro/clickhouse To get started with ClickHouse, visit https://clickhouse.com/ to download or start a free ClickHouse Cloud Trial Recent videos Meetups Clickhouse Meetups NYC Moment Presented by Ottavio Hartman- Platform Team Lead @ Moment at our New York Meetup. Meetups Clickhouse Meetups NYC Gliss.sh Presented by Ryan Adami @ Gliss.sh at our New York Meetup. Meetups Clickhouse Meetups NYC Clay Presented by Paul Noble Tech Lead Audiences @ Clay at our New York Meetup. Follow us X Bluesky Slack GitHub Telegram Meetup Rss
Markdown
[![ClickHouse logo](https://clickhouse.com/_next/static/media/logo-full.ac8102d5.svg)](https://clickhouse.com/) Copy logo as SVG [Download full logo](https://clickhouse.com/brand-assets/clickhouse-logo.zip)[Download logomark](https://clickhouse.com/brand-assets/clickhouse-logomark.zip) Open search Open region selector - [English](https://clickhouse.com/?country=en) - [Japanese](https://clickhouse.com/jp?country=jp) Open menu - [Products](https://clickhouse.com/videos/[slug]) **Products** - [![ClickHouse Cloud](https://clickhouse.com/images/nav/icon-clickhouse-cloud.svg)ClickHouse Cloud The best way to use ClickHouse. Available on AWS, GCP, and Azure.](https://clickhouse.com/cloud) - [![ClickHouse BYOC](https://clickhouse.com/images/nav/icon-byoc.svg)Bring Your Own Cloud A fully managed ClickHouse service, deployed in your own AWS and GCP account.](https://clickhouse.com/cloud/bring-your-own-cloud) - [![Postgres ClickHouse Cloud](https://clickhouse.com/images/nav/icon-postgres.svg)Postgres managed by ClickHouse Unified data stack for transactions and analytics.](https://clickhouse.com/cloud/postgres) - [![Managed ClickStack](https://clickhouse.com/images/nav/icon-managed-clickstack.svg)Managed ClickStack Managed observability with high-performance queries and long-term retention.](https://clickhouse.com/cloud/clickstack) - [![Langfuse Cloud](https://clickhouse.com/images/nav/icon-langfuse.svg)Langfuse Cloud LLM observability and evaluations for reliable AI applications and agents.](https://langfuse.com/?utm_source=clickhouse_topnav) **Open source** - [![ClickHouse](https://clickhouse.com/images/nav/icon-clickhouse.svg)ClickHouse Fast open-source OLAP database for real-time analytics.](https://clickhouse.com/clickhouse) - [![ClickStack](https://clickhouse.com/images/nav/icon-clickstack.svg)ClickStack Open-source observability stack for logs, metrics, traces, and session replays.](https://clickhouse.com/clickstack) - [![Agentic Data Stack](https://clickhouse.com/images/nav/icon-agentic-data-stack.svg)Agentic Data Stack Build AI-powered applications with ClickHouse.](https://clickhouse.com/ai) - [Solutions](https://clickhouse.com/videos/[slug]) **Use cases** - [Real-time analytics](https://clickhouse.com/use-cases/real-time-analytics) - [Observability](https://clickhouse.com/cloud/clickstack) - [Data warehousing](https://clickhouse.com/use-cases/data-warehousing) - [Machine learning and GenAI](https://clickhouse.com/use-cases/machine-learning-and-data-science) - [All use cases](https://clickhouse.com/use-cases) [All use cases \-\>\-\>](https://clickhouse.com/use-cases) **Industries** - [Cybersecurity](https://clickhouse.com/industries/cybersecurity) - [Gaming and entertainment](https://clickhouse.com/industries/gaming) - [E-commerce and retail](https://clickhouse.com/industries/retail) - [Automotive](https://clickhouse.com/industries/automotive) - [Energy](https://clickhouse.com/industries/energy) - [All industries](https://clickhouse.com/industries) [All industries \-\>\-\>](https://clickhouse.com/industries) - [Docs](https://clickhouse.com/docs) - [Resources](https://clickhouse.com/videos/[slug]) - [User stories](https://clickhouse.com/user-stories) - [Blog](https://clickhouse.com/blog) - [Events](https://clickhouse.com/company/events) - [News](https://clickhouse.com/company/news) - [Learning and certification](https://clickhouse.com/learn) - [Comparisons](https://clickhouse.com/videos/lost-in-the-haystack-optimizing-high-cardinality-aggregations) - [Benchmark hub](https://clickhouse.com/benchmarks) - [BigQuery](https://clickhouse.com/comparison/bigquery) - [PostgreSQL](https://clickhouse.com/comparison/postgresql) - [Redshift](https://clickhouse.com/comparison/redshift) - [Snowflake](https://clickhouse.com/comparison/snowflake) - [Elastic Observability](https://clickhouse.com/comparison/elastic-for-observability) - [Splunk](https://clickhouse.com/comparison/splunk-for-observability) - [OpenSearch For observability](https://clickhouse.com/comparison/opensearch-for-observability) - [Videos](https://clickhouse.com/videos) - [Demos](https://clickhouse.com/demos) - [Pricing](https://clickhouse.com/pricing) - [Contact us](https://clickhouse.com/company/contact?loc=nav) Open search Open region selector - [English](https://clickhouse.com/?country=en) - [Japanese](https://clickhouse.com/jp?country=jp) [46\.1k](https://github.com/ClickHouse/ClickHouse?utm_source=clickhouse&utm_medium=website&utm_campaign=website-nav) [Sign in](https://console.clickhouse.cloud/signIn) [Get started](https://console.clickhouse.cloud/signUp?loc=nav-get-started) - [Videos](https://clickhouse.com/videos) - / - [Meetups](https://clickhouse.com/videos?category=meetups) # Lost in the Haystack - Optimizing High Cardinality Aggregations [**Previous video**Scaling ClickHouse to petabytes of logs at OpenAI](https://clickhouse.com/videos/openai) [**Next video**ClickHouse v24.5 Community Call](https://clickhouse.com/videos/community-call-24-05) ## Colton Allen, Sentry.io This presentation was given at the ClickHouse Community Meetup in San Francisco - <https://www.meetup.com/clickhouse-silicon-valley-meetup-group/events/296334923/> If you are interested in attending a future event, please join a Meetup Group near you at <https://www.meetup.com/pro/clickhouse> To get started with ClickHouse, visit <https://clickhouse.com/> to download or start a free ClickHouse Cloud Trial ## Recent videos [View all Videos](https://clickhouse.com/videos) [![YouTube Video: geit7C3RuwQ](https://clickhouse.com/_next/image?url=https%3A%2F%2Fimg.youtube.com%2Fvi%2Fgeit7C3RuwQ%2Fmaxresdefault.jpg&w=3840&q=75) Meetups Clickhouse Meetups NYC Moment Presented by Ottavio Hartman- Platform Team Lead @ Moment at our New York Meetup.](https://clickhouse.com/videos/meetupny20263) [![YouTube Video: fScr9GXB1t8](https://clickhouse.com/_next/image?url=https%3A%2F%2Fimg.youtube.com%2Fvi%2FfScr9GXB1t8%2Fmaxresdefault.jpg&w=3840&q=75) Meetups Clickhouse Meetups NYC Gliss.sh Presented by Ryan Adami @ Gliss.sh at our New York Meetup.](https://clickhouse.com/videos/meetupnyjan20262) [![YouTube Video: LeomE29B1cY](https://clickhouse.com/_next/image?url=https%3A%2F%2Fimg.youtube.com%2Fvi%2FLeomE29B1cY%2Fmaxresdefault.jpg&w=3840&q=75) Meetups Clickhouse Meetups NYC Clay Presented by Paul Noble Tech Lead Audiences @ Clay at our New York Meetup.](https://clickhouse.com/videos/meetupnyjan20261) Follow us [![X](https://clickhouse.com/socials/x.svg)X](https://x.com/ClickhouseDB "X")[![Bluesky](https://clickhouse.com/socials/bluesky.svg)Bluesky](https://bsky.app/profile/clickhouse.com "Bluesky")[![Slack](https://clickhouse.com/socials/slack.svg)Slack](https://clickhouse.com/slack "Slack") [![GitHub](https://clickhouse.com/socials/github.svg)GitHub](https://github.com/ClickHouse/ClickHouse "GitHub")[![Telegram](https://clickhouse.com/socials/telegram.svg)Telegram](https://telegram.me/clickhouse_en "Telegram")[![Meetup](https://clickhouse.com/socials/meetup.svg)Meetup](https://www.meetup.com/pro/clickhouse "Meetup") [![Rss](https://clickhouse.com/socials/rss.svg)Rss](https://clickhouse.com/rss.xml "Rss") - - Product - [ClickHouse Cloud](https://clickhouse.com/cloud) - [Bring Your Own Cloud](https://clickhouse.com/cloud/bring-your-own-cloud) - [Postgres managed by ClickHouse](https://clickhouse.com/cloud/postgres) - [Managed ClickStack](https://clickhouse.com/cloud/clickstack) - [ClickHouse](https://clickhouse.com/clickhouse) - [ClickStack](https://clickhouse.com/clickstack) - [Agentic Data Stack](https://clickhouse.com/ai) - [ClickHouse Government](https://clickhouse.com/government) - [ClickHouse Keeper](https://clickhouse.com/clickhouse/keeper) - [ClickPipes](https://clickhouse.com/cloud/clickpipes) - [Integrations](https://clickhouse.com/integrations) - [chDB](https://clickhouse.com/chdb) - [Pricing](https://clickhouse.com/pricing) - - Resources - [Documentation](https://clickhouse.com/docs) - [Trust center](https://trust.clickhouse.com/) - [Training](https://clickhouse.com/learn) - [Support](https://clickhouse.com/support/program) - [Benchmarks](https://clickhouse.com/benchmarks) - [Use cases](https://clickhouse.com/use-cases) - [Videos](https://clickhouse.com/videos) - [Demos](https://clickhouse.com/demos) - [Presentations](https://presentations.clickhouse.com/) - [Real-time data warehouse](https://clickhouse.com/real-time-data-warehouse) - [Engineering resources](https://clickhouse.com/resources/engineering) - - Company - [Blog](https://clickhouse.com/blog) - [Our story](https://clickhouse.com/company/our-story) - [Careers](https://clickhouse.com/company/careers) - [Contact us](https://clickhouse.com/company/contact?loc=footer) - [Events](https://clickhouse.com/company/events) - [News](https://clickhouse.com/company/news) - [Media](https://clickhouse.com/media) - - Join our community - [GitHub](https://github.com/ClickHouse/ClickHouse) - [Slack](https://clickhouse.com/slack) - [LinkedIn](https://www.linkedin.com/company/clickhouseinc) - [X](https://x.com/ClickhouseDB) - [Bluesky](https://bsky.app/profile/clickhouse.com) - [Telegram](https://telegram.me/clickhouse_en) - [Meetup](https://www.meetup.com/pro/clickhouse) - - Comparisons - [BigQuery](https://clickhouse.com/comparison/bigquery) - [PostgreSQL](https://clickhouse.com/comparison/postgresql) - [Redshift](https://clickhouse.com/comparison/redshift) - [Snowflake](https://clickhouse.com/comparison/snowflake) - [Elastic](https://clickhouse.com/comparison/elastic-for-observability) - [Splunk](https://clickhouse.com/comparison/splunk-for-observability) - [OpenSearch](https://clickhouse.com/comparison/opensearch-for-observability) - Partners - [AWS](https://clickhouse.com/partners/aws) - [Azure](https://clickhouse.com/partners/azure) ![ClickHouse logo](https://clickhouse.com/_next/static/media/logo-full.ac8102d5.svg) Stay informed on feature releases, product roadmap, support, and cloud offerings\! Loading form... [Star us on Github](https://github.com/ClickHouse/ClickHouse) © 2026 ClickHouse, Inc. HQ in the Bay Area, CA and Amsterdam, NL. [Trademark](https://clickhouse.com/legal/trademark-policy)[Privacy](https://clickhouse.com/legal/privacy-policy)[Security](https://trust.clickhouse.com/)[Legal](https://clickhouse.com/legal)[Cookie policy](https://clickhouse.com/legal/cookie-policy) ![Opt-out logo](https://clickhouse.com/images/opt-out-logo.svg)Your privacy choices
Readable Markdown
[![ClickHouse logo](https://clickhouse.com/_next/static/media/logo-full.ac8102d5.svg)](https://clickhouse.com/) [Download full logo](https://clickhouse.com/brand-assets/clickhouse-logo.zip)[Download logomark](https://clickhouse.com/brand-assets/clickhouse-logomark.zip) - [English](https://clickhouse.com/?country=en) - [Japanese](https://clickhouse.com/jp?country=jp) - [Products](https://clickhouse.com/videos/[slug]) **Products** - [![ClickHouse Cloud](https://clickhouse.com/images/nav/icon-clickhouse-cloud.svg)ClickHouse Cloud The best way to use ClickHouse. Available on AWS, GCP, and Azure.](https://clickhouse.com/cloud) - [![ClickHouse BYOC](https://clickhouse.com/images/nav/icon-byoc.svg)Bring Your Own Cloud A fully managed ClickHouse service, deployed in your own AWS and GCP account.](https://clickhouse.com/cloud/bring-your-own-cloud) - [![Postgres ClickHouse Cloud](https://clickhouse.com/images/nav/icon-postgres.svg)Postgres managed by ClickHouse Unified data stack for transactions and analytics.](https://clickhouse.com/cloud/postgres) - [![Managed ClickStack](https://clickhouse.com/images/nav/icon-managed-clickstack.svg)Managed ClickStack Managed observability with high-performance queries and long-term retention.](https://clickhouse.com/cloud/clickstack) - [![Langfuse Cloud](https://clickhouse.com/images/nav/icon-langfuse.svg)Langfuse Cloud LLM observability and evaluations for reliable AI applications and agents.](https://langfuse.com/?utm_source=clickhouse_topnav) **Open source** - [![ClickHouse](https://clickhouse.com/images/nav/icon-clickhouse.svg)ClickHouse Fast open-source OLAP database for real-time analytics.](https://clickhouse.com/clickhouse) - [![ClickStack](https://clickhouse.com/images/nav/icon-clickstack.svg)ClickStack Open-source observability stack for logs, metrics, traces, and session replays.](https://clickhouse.com/clickstack) - [![Agentic Data Stack](https://clickhouse.com/images/nav/icon-agentic-data-stack.svg)Agentic Data Stack Build AI-powered applications with ClickHouse.](https://clickhouse.com/ai) - [Solutions](https://clickhouse.com/videos/[slug]) **Use cases** - [Real-time analytics](https://clickhouse.com/use-cases/real-time-analytics) - [Observability](https://clickhouse.com/cloud/clickstack) - [Data warehousing](https://clickhouse.com/use-cases/data-warehousing) - [Machine learning and GenAI](https://clickhouse.com/use-cases/machine-learning-and-data-science) - [All use cases](https://clickhouse.com/use-cases) [All use cases \-\>\-\>](https://clickhouse.com/use-cases) **Industries** - [Cybersecurity](https://clickhouse.com/industries/cybersecurity) - [Gaming and entertainment](https://clickhouse.com/industries/gaming) - [E-commerce and retail](https://clickhouse.com/industries/retail) - [Automotive](https://clickhouse.com/industries/automotive) - [Energy](https://clickhouse.com/industries/energy) - [All industries](https://clickhouse.com/industries) [All industries \-\>\-\>](https://clickhouse.com/industries) - [Docs](https://clickhouse.com/docs) - [Resources](https://clickhouse.com/videos/[slug]) - [User stories](https://clickhouse.com/user-stories) - [Blog](https://clickhouse.com/blog) - [Events](https://clickhouse.com/company/events) - [News](https://clickhouse.com/company/news) - [Learning and certification](https://clickhouse.com/learn) - [Comparisons](https://clickhouse.com/videos/lost-in-the-haystack-optimizing-high-cardinality-aggregations) - [Benchmark hub](https://clickhouse.com/benchmarks) - [BigQuery](https://clickhouse.com/comparison/bigquery) - [PostgreSQL](https://clickhouse.com/comparison/postgresql) - [Redshift](https://clickhouse.com/comparison/redshift) - [Snowflake](https://clickhouse.com/comparison/snowflake) - [Elastic Observability](https://clickhouse.com/comparison/elastic-for-observability) - [Splunk](https://clickhouse.com/comparison/splunk-for-observability) - [OpenSearch For observability](https://clickhouse.com/comparison/opensearch-for-observability) - [Videos](https://clickhouse.com/videos) - [Demos](https://clickhouse.com/demos) - [Pricing](https://clickhouse.com/pricing) - [Contact us](https://clickhouse.com/company/contact?loc=nav) - [English](https://clickhouse.com/?country=en) - [Japanese](https://clickhouse.com/jp?country=jp) [46\.1k](https://github.com/ClickHouse/ClickHouse?utm_source=clickhouse&utm_medium=website&utm_campaign=website-nav) [Sign in](https://console.clickhouse.cloud/signIn) - [Videos](https://clickhouse.com/videos) - [Meetups](https://clickhouse.com/videos?category=meetups) [**Previous video**Scaling ClickHouse to petabytes of logs at OpenAI](https://clickhouse.com/videos/openai) [**Next video**ClickHouse v24.5 Community Call](https://clickhouse.com/videos/community-call-24-05) ## Colton Allen, Sentry.io This presentation was given at the ClickHouse Community Meetup in San Francisco - <https://www.meetup.com/clickhouse-silicon-valley-meetup-group/events/296334923/> If you are interested in attending a future event, please join a Meetup Group near you at <https://www.meetup.com/pro/clickhouse> To get started with ClickHouse, visit <https://clickhouse.com/> to download or start a free ClickHouse Cloud Trial ## Recent videos [![YouTube Video: geit7C3RuwQ](https://clickhouse.com/_next/image?url=https%3A%2F%2Fimg.youtube.com%2Fvi%2Fgeit7C3RuwQ%2Fmaxresdefault.jpg&w=3840&q=75) Meetups Clickhouse Meetups NYC Moment Presented by Ottavio Hartman- Platform Team Lead @ Moment at our New York Meetup.](https://clickhouse.com/videos/meetupny20263) [![YouTube Video: fScr9GXB1t8](https://clickhouse.com/_next/image?url=https%3A%2F%2Fimg.youtube.com%2Fvi%2FfScr9GXB1t8%2Fmaxresdefault.jpg&w=3840&q=75) Meetups Clickhouse Meetups NYC Gliss.sh Presented by Ryan Adami @ Gliss.sh at our New York Meetup.](https://clickhouse.com/videos/meetupnyjan20262) [![YouTube Video: LeomE29B1cY](https://clickhouse.com/_next/image?url=https%3A%2F%2Fimg.youtube.com%2Fvi%2FLeomE29B1cY%2Fmaxresdefault.jpg&w=3840&q=75) Meetups Clickhouse Meetups NYC Clay Presented by Paul Noble Tech Lead Audiences @ Clay at our New York Meetup.](https://clickhouse.com/videos/meetupnyjan20261) Follow us [![X](https://clickhouse.com/socials/x.svg)X](https://x.com/ClickhouseDB "X")[![Bluesky](https://clickhouse.com/socials/bluesky.svg)Bluesky](https://bsky.app/profile/clickhouse.com "Bluesky")[![Slack](https://clickhouse.com/socials/slack.svg)Slack](https://clickhouse.com/slack "Slack") [![GitHub](https://clickhouse.com/socials/github.svg)GitHub](https://github.com/ClickHouse/ClickHouse "GitHub")[![Telegram](https://clickhouse.com/socials/telegram.svg)Telegram](https://telegram.me/clickhouse_en "Telegram")[![Meetup](https://clickhouse.com/socials/meetup.svg)Meetup](https://www.meetup.com/pro/clickhouse "Meetup") [![Rss](https://clickhouse.com/socials/rss.svg)Rss](https://clickhouse.com/rss.xml "Rss")
Shard89 (laksa)
Root Hash12633450985039531489
Unparsed URLcom,clickhouse!/videos/lost-in-the-haystack-optimizing-high-cardinality-aggregations s443