🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 56 (from laksa029)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa056.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://spacetelescopelive.org/webb\')), getAhrefsUnparsedNoserviceFromURL(\'https://spacetelescopelive.org/webb\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/spacetelescopelive.org\/webb","crawl_time":1775548692,"first_indexed_time":1709833034,"http_code":200,"src_unparsed":"org,spacetelescopelive!\/webb s443","src_root_hash":"1714265284978227256","history_drop_reason":null,"meta_title":"Webb - Space Telescope Live","meta_descriptions":["Explore official, up-to-date information on current, past, and upcoming investigations by NASA’s Hubble and James Webb space telescopes."],"attrs_boilerpipe_text":"What is Webb observing?\nNext Scheduled Observation\n3 hours, 0 minutes, 41 seconds\nNext Scheduled Observation\nTarget:\nDIVER_targets_prism_3mask_v6new\nTarget Category:\nHigh-Redshift Galaxies And The Distant Universe\nResearch Program:\nDIVER: Deep Insights into UV Spectroscopy at the Epoch of Reionization\nSky Map\n12 36 48.781 +62 14 00.64\nFoV: 30'","attrs_markdown":"[Skip to main content](https:\/\/spacetelescopelive.org\/webb#main-content)\n\n[![Space Telescope Live logo](https:\/\/spacetelescopelive.org\/img\/STL_Logo.svg)](https:\/\/spacetelescopelive.org\/ \"homepage\")\n\nWebb\n\nWebb\n\n# What is Webb observing?\n**Next Scheduled Observation**\n\n3 hours, 0 minutes, 41 seconds\n\nhide\n\nNext Scheduled Observation\n\nViewing Latest\n\n![Line drawing of the Webb Space Telescope](https:\/\/spacetelescopelive.org\/img\/webb-vector.svg)\n\n## Target: DIVER\\_targets\\_prism\\_3mask\\_v6new\nTarget Category: **High-Redshift Galaxies And The Distant Universe**\n\nResearch Program: **DIVER: Deep Insights into UV Spectroscopy at the Epoch of Reionization**\n\nPrevious Target\n\nNext Target\n\n### Observation Status & Details\nIn Progress\n\nStart Time:\n\nFetching Target...\n\nTuesday, April 7, 2026 at 7:45:21 (UTC)\n\nObservation Details\n### Sky Map\n12 36 48.781 +62 14 00.64\n\nFoV: 30'\n\n[×]()\n\n[×]()\n\nStack\n\nImage layers\n\nBase\n\nðŸ‘ï¸\n\nðŸ”\n\nâŒ\n\nColormap\n\nReverse\n\nStretch\n\nFormat\n\nMin cut\n\nMax cut\n\nGamma\n\nColor Sat.\n\nContrast\n\nBrightness\n\nBlending mode\n\nOpacity\n\nAdd survey\n\nOpen image ðŸ“‚\n\nOverlay layers\n\nAdd catalogue\n\nReticle\n\nHEALPix grid\n\nBackground color\n\nTools\n\nExport view as PNG\n\n[×]()\n\nCoo grid options\n\n|   |   |\n|---|---|\n| Color |   |\n| Opacity |   |\n| Thickness |   |\n| Label size |   |\n\n### Sky Map Details\n**Background:** Two Micron All Sky Survey\n\n**Field of View:** 30 arcminutes\n\n**Coordinates:**\\+12 36 48.78 +62 14 00.6\n\nSky Map Details\n\n- April 3, 2026\n- April 4, 2026\n- April 5, 2026\n- April 6, 2026\n- April 7, 2026\n- April 8, 2026\n- April 9, 2026\n- April 10, 2026\n- April 11, 2026\n\n12am\n\n4am\n\n8am\n\n12pm\n\n4pm\n\n8pm\n\n12am\n\n- 2\n- 3\n\nLocal\n\n24 hours\n\n## Footer\n[![NASA logo](https:\/\/spacetelescopelive.org\/_next\/image?url=%2Fimg%2FNASA_logo.png&w=256&q=75)](https:\/\/nasa.gov\/ \"NASA site (external link)\")\n\n[Official NASA Hubble Website](https:\/\/science.nasa.gov\/mission\/hubble)\n\n[Official NASA Webb Website](https:\/\/science.nasa.gov\/mission\/webb)\n\n[![Space Telescope Live logo](https:\/\/spacetelescopelive.org\/_next\/image?url=%2Fimg%2Fstsci_logo.png&w=640&q=75)](https:\/\/stsci.edu\/ \"Space Telescope Science Institute site (external link)\")\n\n[hubblesite.org](https:\/\/hubblesite.org\/)\n\n[webbtelescope.org](https:\/\/webbtelescope.org\/)\n\n[User Guide](https:\/\/spacetelescopelive.org\/user-guide)\n\n[Content Use](https:\/\/spacetelescopelive.org\/content-use-policy)\n\n[Privacy](https:\/\/webbtelescope.org\/privacy)\n\nFollow [@spacetelelive](https:\/\/twitter.com\/spacetelelive)\n\n- Telescopes\n- Hubble\n- Webb\n\n- UTC\n- Local\n\n- 24 hours\n- 12 hours\n- 6 hours\n- 3 hours\n- 0\\.5 hours","attrs_readable_markdown":"## What is Webb observing?\n**Next Scheduled Observation**\n\n3 hours, 0 minutes, 41 seconds\n\nNext Scheduled Observation\n\n![Line drawing of the Webb Space Telescope](https:\/\/spacetelescopelive.org\/img\/webb-vector.svg)\n\n## Target: DIVER\\_targets\\_prism\\_3mask\\_v6new\nTarget Category: **High-Redshift Galaxies And The Distant Universe**\n\nResearch Program: **DIVER: Deep Insights into UV Spectroscopy at the Epoch of Reionization**\n### Sky Map\n12 36 48.781 +62 14 00.64\n\nFoV: 30'","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

22 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://spacetelescopelive.org/webb
Last Crawled	2026-04-07 07:58:12 (22 hours ago)
First Indexed	2024-03-07 17:37:14 (2 years ago)
HTTP Status Code	200
Meta Title	Webb - Space Telescope Live
Meta Description	Explore official, up-to-date information on current, past, and upcoming investigations by NASA’s Hubble and James Webb space telescopes.
Meta Canonical	null
Boilerpipe Text	What is Webb observing? Next Scheduled Observation 3 hours, 0 minutes, 41 seconds Next Scheduled Observation Target: DIVER_targets_prism_3mask_v6new Target Category: High-Redshift Galaxies And The Distant Universe Research Program: DIVER: Deep Insights into UV Spectroscopy at the Epoch of Reionization Sky Map 12 36 48.781 +62 14 00.64 FoV: 30'
Markdown	[Skip to main content](https://spacetelescopelive.org/webb#main-content) [![Space Telescope Live logo](https://spacetelescopelive.org/img/STL_Logo.svg)](https://spacetelescopelive.org/ "homepage") Webb Webb # What is Webb observing? Next Scheduled Observation 3 hours, 0 minutes, 41 seconds hide Next Scheduled Observation Viewing Latest ![Line drawing of the Webb Space Telescope](https://spacetelescopelive.org/img/webb-vector.svg) ## Target: DIVER\_targets\_prism\_3mask\_v6new Target Category: High-Redshift Galaxies And The Distant Universe Research Program: DIVER: Deep Insights into UV Spectroscopy at the Epoch of Reionization Previous Target Next Target ### Observation Status & Details In Progress Start Time: Fetching Target... Tuesday, April 7, 2026 at 7:45:21 (UTC) Observation Details ### Sky Map 12 36 48.781 +62 14 00.64 FoV: 30' [×]() [×]() Stack Image layers Base ðŸ‘ï¸ ðŸ” âŒ Colormap Reverse Stretch Format Min cut Max cut Gamma Color Sat. Contrast Brightness Blending mode Opacity Add survey Open image ðŸ“‚ Overlay layers Add catalogue Reticle HEALPix grid Background color Tools Export view as PNG [×]() Coo grid options \| \| \| \|---\|---\| \| Color \| \| \| Opacity \| \| \| Thickness \| \| \| Label size \| \| ### Sky Map Details Background: Two Micron All Sky Survey Field of View: 30 arcminutes Coordinates:\+12 36 48.78 +62 14 00.6 Sky Map Details - April 3, 2026 - April 4, 2026 - April 5, 2026 - April 6, 2026 - April 7, 2026 - April 8, 2026 - April 9, 2026 - April 10, 2026 - April 11, 2026 12am 4am 8am 12pm 4pm 8pm 12am - 2 - 3 Local 24 hours ## Footer [![NASA logo](https://spacetelescopelive.org/_next/image?url=%2Fimg%2FNASA_logo.png&w=256&q=75)](https://nasa.gov/ "NASA site (external link)") [Official NASA Hubble Website](https://science.nasa.gov/mission/hubble) [Official NASA Webb Website](https://science.nasa.gov/mission/webb) [![Space Telescope Live logo](https://spacetelescopelive.org/_next/image?url=%2Fimg%2Fstsci_logo.png&w=640&q=75)](https://stsci.edu/ "Space Telescope Science Institute site (external link)") [hubblesite.org](https://hubblesite.org/) [webbtelescope.org](https://webbtelescope.org/) [User Guide](https://spacetelescopelive.org/user-guide) [Content Use](https://spacetelescopelive.org/content-use-policy) [Privacy](https://webbtelescope.org/privacy) Follow [@spacetelelive](https://twitter.com/spacetelelive) - Telescopes - Hubble - Webb - UTC - Local - 24 hours - 12 hours - 6 hours - 3 hours - 0\.5 hours
Readable Markdown	## What is Webb observing? Next Scheduled Observation 3 hours, 0 minutes, 41 seconds Next Scheduled Observation ![Line drawing of the Webb Space Telescope](https://spacetelescopelive.org/img/webb-vector.svg) ## Target: DIVER\_targets\_prism\_3mask\_v6new Target Category: High-Redshift Galaxies And The Distant Universe Research Program: DIVER: Deep Insights into UV Spectroscopy at the Epoch of Reionization ### Sky Map 12 36 48.781 +62 14 00.64 FoV: 30'
Shard	56 (laksa)
Root Hash	1714265284978227256
Unparsed URL	org,spacetelescopelive!/webb s443