🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 161 (from laksa023)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa161.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://observablehq.com/@katirg/test_catalogue_json\')), getAhrefsUnparsedNoserviceFromURL(\'https://observablehq.com/@katirg/test_catalogue_json\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/observablehq.com\/@katirg\/test_catalogue_json","crawl_time":1775798687,"first_indexed_time":1639225986,"http_code":200,"src_unparsed":"com,observablehq!\/@katirg\/test_catalogue_json s443","src_root_hash":"17843809617602386761","history_drop_reason":null,"meta_title":"Display JSON as Table \/ katirg | Observable","meta_descriptions":["This is a test notebook to plot data from a JSON file into an HTML table using Google Charts (https:\/\/developers.google.com\/chart\/interactive\/docs\/reference#dataparam). 1. Setup 1.1 Load Data Use Flu Shot Clinics JSON file: https:\/\/stage.data.ontario.ca\/dataset\/flu-shot-clinics This data is only provided in JSON format, which cannot automatically be plotted by the ckan Data Viewer. Only the data defined in the `properties.language.en` object key are displayed in the table. These data consist of `10` rows, w"],"attrs_boilerpipe_text":"Pricing","attrs_markdown":"[![The avatar for @katirg](https:\/\/observablehq.com\/_next\/image?url=https%3A%2F%2Favatars-next.observableusercontent.com%2Fa052328a04d246ecd3076cd023a5aade2b30d382f43a2ddfcaa1227ede3e85fd&w=64&q=85)](https:\/\/observablehq.com\/@katirg)\n\n[katirg](https:\/\/observablehq.com\/@katirg)\n\n[Workspace](https:\/\/observablehq.com\/)\n\nFork\n\nPublished\n\nBy\n\n![The avatar for @katirg](https:\/\/observablehq.com\/_next\/image?url=https%3A%2F%2Favatars-next.observableusercontent.com%2Fa052328a04d246ecd3076cd023a5aade2b30d382f43a2ddfcaa1227ede3e85fd&w=32&q=85)\n\nkatirg\n\nEdited\n\nImporters\n\n1\n\nPlatform\n\n- [Observable Canvases](https:\/\/observablehq.com\/platform\/canvases)\n- [Observable Notebooks](https:\/\/observablehq.com\/platform\/notebooks)\n- [Pricing](https:\/\/observablehq.com\/pricing)\n\nDocs\n\n- [Observable](https:\/\/observablehq.com\/documentation\/)\n- [Observable Framework](https:\/\/observablehq.com\/framework\/)\n- [Observable Plot](https:\/\/observablehq.com\/plot\/)\n- [D3](https:\/\/d3js.org\/)\n- [Release notes](https:\/\/observablehq.com\/release-notes)\n\nResources\n\n- [Blog](https:\/\/observablehq.com\/blog)\n- [Webinars](https:\/\/observablehq.com\/resource-center#webinars)\n- [Videos](https:\/\/observablehq.com\/resource-center#videos)\n- [Customer stories](https:\/\/observablehq.com\/customer-stories)\n- [Community Slack](https:\/\/observablehq.com\/slack\/join)\n- [Forum](https:\/\/talk.observablehq.com\/)\n\nCompany\n\n- [About](https:\/\/observablehq.com\/about)\n- [Careers](https:\/\/observablehq.com\/about#jobs)\n- Contact us\n- Newsletter signup\n- [GitHub](https:\/\/github.com\/observablehq)\n\nPlatform\n\n- [Observable Canvases](https:\/\/observablehq.com\/platform\/canvases)\n- [Observable Notebooks](https:\/\/observablehq.com\/platform\/notebooks)\n- [Pricing](https:\/\/observablehq.com\/pricing)\n\nDocs\n\n- [Observable](https:\/\/observablehq.com\/documentation\/)\n- [Observable Framework](https:\/\/observablehq.com\/framework\/)\n- [Observable Plot](https:\/\/observablehq.com\/plot\/)\n- [D3](https:\/\/d3js.org\/)\n- [Release notes](https:\/\/observablehq.com\/release-notes)\n\nResources\n\n- [Blog](https:\/\/observablehq.com\/blog)\n- [Webinars](https:\/\/observablehq.com\/resource-center#webinars)\n- [Videos](https:\/\/observablehq.com\/resource-center#videos)\n- [Customer stories](https:\/\/observablehq.com\/customer-stories)\n- [Community Slack](https:\/\/observablehq.com\/slack\/join)\n- [Forum](https:\/\/talk.observablehq.com\/)\n\nCompany\n\n- [About](https:\/\/observablehq.com\/about)\n- [Careers](https:\/\/observablehq.com\/about#jobs)\n- Contact us\n- Newsletter signup\n- [GitHub](https:\/\/github.com\/observablehq)\n\n© 2026 Observable, Inc.[Privacy](https:\/\/observablehq.com\/privacy-policy)[Security](https:\/\/observablehq.com\/security)[Terms of Service](https:\/\/observablehq.com\/terms-of-service)[Vulnerability Disclosure](https:\/\/observablehq.com\/responsible-disclosure)","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

4 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://observablehq.com/@katirg/test_catalogue_json
Last Crawled	2026-04-10 05:24:47 (4 hours ago)
First Indexed	2021-12-11 12:33:06 (4 years ago)
HTTP Status Code	200
Meta Title	Display JSON as Table / katirg \| Observable
Meta Description	This is a test notebook to plot data from a JSON file into an HTML table using Google Charts (https://developers.google.com/chart/interactive/docs/reference#dataparam). 1. Setup 1.1 Load Data Use Flu Shot Clinics JSON file: https://stage.data.ontario.ca/dataset/flu-shot-clinics This data is only provided in JSON format, which cannot automatically be plotted by the ckan Data Viewer. Only the data defined in the `properties.language.en` object key are displayed in the table. These data consist of `10` rows, w
Meta Canonical	null
Boilerpipe Text	Pricing
Markdown	[![The avatar for @katirg](https://observablehq.com/_next/image?url=https%3A%2F%2Favatars-next.observableusercontent.com%2Fa052328a04d246ecd3076cd023a5aade2b30d382f43a2ddfcaa1227ede3e85fd&w=64&q=85)](https://observablehq.com/@katirg) [katirg](https://observablehq.com/@katirg) [Workspace](https://observablehq.com/) Fork Published By ![The avatar for @katirg](https://observablehq.com/_next/image?url=https%3A%2F%2Favatars-next.observableusercontent.com%2Fa052328a04d246ecd3076cd023a5aade2b30d382f43a2ddfcaa1227ede3e85fd&w=32&q=85) katirg Edited Importers 1 Platform - [Observable Canvases](https://observablehq.com/platform/canvases) - [Observable Notebooks](https://observablehq.com/platform/notebooks) - [Pricing](https://observablehq.com/pricing) Docs - [Observable](https://observablehq.com/documentation/) - [Observable Framework](https://observablehq.com/framework/) - [Observable Plot](https://observablehq.com/plot/) - [D3](https://d3js.org/) - [Release notes](https://observablehq.com/release-notes) Resources - [Blog](https://observablehq.com/blog) - [Webinars](https://observablehq.com/resource-center#webinars) - [Videos](https://observablehq.com/resource-center#videos) - [Customer stories](https://observablehq.com/customer-stories) - [Community Slack](https://observablehq.com/slack/join) - [Forum](https://talk.observablehq.com/) Company - [About](https://observablehq.com/about) - [Careers](https://observablehq.com/about#jobs) - Contact us - Newsletter signup - [GitHub](https://github.com/observablehq) Platform - [Observable Canvases](https://observablehq.com/platform/canvases) - [Observable Notebooks](https://observablehq.com/platform/notebooks) - [Pricing](https://observablehq.com/pricing) Docs - [Observable](https://observablehq.com/documentation/) - [Observable Framework](https://observablehq.com/framework/) - [Observable Plot](https://observablehq.com/plot/) - [D3](https://d3js.org/) - [Release notes](https://observablehq.com/release-notes) Resources - [Blog](https://observablehq.com/blog) - [Webinars](https://observablehq.com/resource-center#webinars) - [Videos](https://observablehq.com/resource-center#videos) - [Customer stories](https://observablehq.com/customer-stories) - [Community Slack](https://observablehq.com/slack/join) - [Forum](https://talk.observablehq.com/) Company - [About](https://observablehq.com/about) - [Careers](https://observablehq.com/about#jobs) - Contact us - Newsletter signup - [GitHub](https://github.com/observablehq) © 2026 Observable, Inc.[Privacy](https://observablehq.com/privacy-policy)[Security](https://observablehq.com/security)[Terms of Service](https://observablehq.com/terms-of-service)[Vulnerability Disclosure](https://observablehq.com/responsible-disclosure)
Readable Markdown	null
Shard	161 (laksa)
Root Hash	17843809617602386761
Unparsed URL	com,observablehq!/@katirg/test_catalogue_json s443