🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 157 (from laksa009)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa157.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.foxnews.com/video/6391088435112\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.foxnews.com/video/6391088435112\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.foxnews.com\/video\/6391088435112","crawl_time":1776400279,"first_indexed_time":1773846767,"http_code":200,"src_unparsed":"com,foxnews!www,\/video\/6391088435112 s443","src_root_hash":"1511671639469378157","history_drop_reason":null,"meta_title":"California Republican gubernatorial candidate sounds off on Newsom leadership | Fox News Video","meta_descriptions":["California Republican gubernatorial candidate Steve Hilton sounded off Gov. Gavin Newsom’s leadership calling him an “absolute failure on every front.”"],"attrs_boilerpipe_text":"Video\nThis video is playing in picture-in-picture.\nLive Now\nAll times eastern\nNOW - 6:00 AM\n6:00 AM\n6:30 AM\n7:00 AM\n7:30 AM\n8:00 AM\nFox News Channel\nFox & Friends First\n5:00 AM - 6:00 AM\nFox & Friends\n6:00 AM - 7:00 AM\nFox & Friends\n7:00 AM - 8:00 AM\nFox & Friends\n8:00 AM - 8:30 AM\nFox Business Channel\nFox Weather First\n5:00 AM - 6:00 AM\nMornings With Maria\n6:00 AM - 7:00 AM\nMornings With Maria\n7:00 AM - 8:00 AM\nMornings With Maria\n8:00 AM - 8:30 AM\nFox Weather Channel\nFox Weather\nLive Stream\nFox News Radio\nFOX News Radio Live Channel Coverage\nLive Stream\nFox News Channel Live\nFox Weather\nLive Stream","attrs_markdown":"[Menu](https:\/\/www.foxnews.com\/video\/6391088435112)\n\n[Fox News Videos](https:\/\/www.foxnews.com\/)\n\n- [Home](https:\/\/www.foxnews.com\/video)\n- [Watch Live](https:\/\/www.foxnews.com\/video\/5614615980001)\n- [Shows](https:\/\/www.foxnews.com\/video\/shows)\n- [Topics](https:\/\/www.foxnews.com\/video\/topics)\n\n[Log In](https:\/\/www.foxnews.com\/video\/6391088435112)\n\n[Avatar](https:\/\/www.foxnews.com\/video\/6391088435112)\n\n**Join the conversation**\n\nLog in to comment on videos and join in on the fun.\n\nLog In\n\n**Watch Live TV**\n\nWatch the live stream of Fox News and full episodes.\n\n[Authorize](https:\/\/www.foxnews.com\/video\/5614615980001)\n\n**Dark Mode**\n\nReduce eye strain and focus on the content that matters.\n\n[to top](https:\/\/www.foxnews.com\/video\/6391088435112) [close](https:\/\/www.foxnews.com\/video\/6391088435112)\n\n![California Republican gubernatorial candidate sounds off on Newsom leadership](https:\/\/a57.foxnews.com\/cf-images.us-east-1.prod.boltdns.net\/v1\/static\/694940094001\/df6b49de-a720-4f88-8285-7d0c4c3131c4\/7d1e0e67-be1e-47da-8f74-5d78f1d94344\/1280x720\/match\/896\/500\/image.jpg?ve=1&tl=1)\n\nVideo\n\nThis video is playing in picture-in-picture.\n\nPrimary Politics\n\n[March 18, 2026](https:\/\/www.foxnews.com\/html-video-sitemap\/2026\/march\/18)\n\n05:42\n\nCLIP\n\n# California Republican gubernatorial candidate sounds off on Newsom leadership\nCalifornia Republican gubernatorial candidate Steve Hilton sounded off Gov. Gavin Newsom’s leadership calling him an “absolute failure on every front.”\n\nTags\n\n- [POLITICS](https:\/\/www.foxnews.com\/video\/topics\/politics)\n- [DIGITAL ORIGINALS](https:\/\/www.foxnews.com\/video\/topics\/us\/digital-originals)\n- [V-VIDEO](https:\/\/www.foxnews.com\/video\/topics\/v-video)\n\n## Live Now\nAll times eastern\n\nNOW - 6:00 AM\n\n6:00 AM\n\n6:30 AM\n\n7:00 AM\n\n7:30 AM\n\n8:00 AM\n\nFox News Channel\n\nFox & Friends First\n\n5:00 AM - 6:00 AM\n\n[Watch](https:\/\/www.foxnews.com\/video\/5614615980001)\n\nFox & Friends\n\n6:00 AM - 7:00 AM\n\nFox & Friends\n\n7:00 AM - 8:00 AM\n\nFox & Friends\n\n8:00 AM - 8:30 AM\n\nFox Business Channel\n\nFox Weather First\n\n5:00 AM - 6:00 AM\n\n[Watch](https:\/\/www.foxnews.com\/video\/5614626175001)\n\nMornings With Maria\n\n6:00 AM - 7:00 AM\n\nMornings With Maria\n\n7:00 AM - 8:00 AM\n\nMornings With Maria\n\n8:00 AM - 8:30 AM\n\nFox Weather Channel\n\nFox Weather\n\nLive Stream\n\n[Watch](https:\/\/www.foxnews.com\/video\/6275127689001)\n\nFox News Radio\n\nFOX News Radio Live Channel Coverage\n\nLive Stream\n\n[Watch](https:\/\/www.foxnews.com\/video\/5599024308001)\n\nFox News Channel Live\n\nFox Weather\n\nLive Stream\n\n[Watch](https:\/\/www.foxnews.com\/video\/6275127689001)\n\n[Fox News](https:\/\/www.foxnews.com\/ \"Breaking News Today Fox News\")\n\n- [New Privacy Policy](https:\/\/www.foxnews.com\/privacy-policy)\n- [Updated Terms of Use](https:\/\/www.foxnews.com\/terms-of-use)\n- [Your Privacy Choices](http:\/\/privacy.foxnews.com\/main\/web\/main)\n- [Closed Caption Policy](https:\/\/www.foxnews.com\/closed-captioning)\n- [Stream Safely](https:\/\/streamsafely.com\/)\n- [News Sitemap](https:\/\/www.foxnews.com\/html-sitemap)\n- [Video Sitemap](https:\/\/www.foxnews.com\/html-video-sitemap)\n\n©2026 FOX News Network, LLC. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed. All market data delayed 20 minutes.","attrs_readable_markdown":"![California Republican gubernatorial candidate sounds off on Newsom leadership](https:\/\/a57.foxnews.com\/cf-images.us-east-1.prod.boltdns.net\/v1\/static\/694940094001\/df6b49de-a720-4f88-8285-7d0c4c3131c4\/7d1e0e67-be1e-47da-8f74-5d78f1d94344\/1280x720\/match\/896\/500\/image.jpg?ve=1&tl=1)\n\nVideo\n\nThis video is playing in picture-in-picture.\n\n## Live Now\nAll times eastern\n\nNOW - 6:00 AM\n\n6:00 AM\n\n6:30 AM\n\n7:00 AM\n\n7:30 AM\n\n8:00 AM\n\nFox News Channel\n\nFox & Friends First\n\n5:00 AM - 6:00 AM\n\nFox & Friends\n\n6:00 AM - 7:00 AM\n\nFox & Friends\n\n7:00 AM - 8:00 AM\n\nFox & Friends\n\n8:00 AM - 8:30 AM\n\nFox Business Channel\n\nFox Weather First\n\n5:00 AM - 6:00 AM\n\nMornings With Maria\n\n6:00 AM - 7:00 AM\n\nMornings With Maria\n\n7:00 AM - 8:00 AM\n\nMornings With Maria\n\n8:00 AM - 8:30 AM\n\nFox Weather Channel\n\nFox Weather\n\nLive Stream\n\nFox News Radio\n\nFOX News Radio Live Channel Coverage\n\nLive Stream\n\nFox News Channel Live\n\nFox Weather\n\nLive Stream","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

1 day ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.foxnews.com/video/6391088435112
Last Crawled	2026-04-17 04:31:19 (1 day ago)
First Indexed	2026-03-18 15:12:47 (1 month ago)
HTTP Status Code	200
Meta Title	California Republican gubernatorial candidate sounds off on Newsom leadership \| Fox News Video
Meta Description	California Republican gubernatorial candidate Steve Hilton sounded off Gov. Gavin Newsom’s leadership calling him an “absolute failure on every front.”
Meta Canonical	null
Boilerpipe Text	Video This video is playing in picture-in-picture. Live Now All times eastern NOW - 6:00 AM 6:00 AM 6:30 AM 7:00 AM 7:30 AM 8:00 AM Fox News Channel Fox & Friends First 5:00 AM - 6:00 AM Fox & Friends 6:00 AM - 7:00 AM Fox & Friends 7:00 AM - 8:00 AM Fox & Friends 8:00 AM - 8:30 AM Fox Business Channel Fox Weather First 5:00 AM - 6:00 AM Mornings With Maria 6:00 AM - 7:00 AM Mornings With Maria 7:00 AM - 8:00 AM Mornings With Maria 8:00 AM - 8:30 AM Fox Weather Channel Fox Weather Live Stream Fox News Radio FOX News Radio Live Channel Coverage Live Stream Fox News Channel Live Fox Weather Live Stream
Markdown	[Menu](https://www.foxnews.com/video/6391088435112) [Fox News Videos](https://www.foxnews.com/) - [Home](https://www.foxnews.com/video) - [Watch Live](https://www.foxnews.com/video/5614615980001) - [Shows](https://www.foxnews.com/video/shows) - [Topics](https://www.foxnews.com/video/topics) [Log In](https://www.foxnews.com/video/6391088435112) [Avatar](https://www.foxnews.com/video/6391088435112) Join the conversation Log in to comment on videos and join in on the fun. Log In Watch Live TV Watch the live stream of Fox News and full episodes. [Authorize](https://www.foxnews.com/video/5614615980001) Dark Mode Reduce eye strain and focus on the content that matters. [to top](https://www.foxnews.com/video/6391088435112) [close](https://www.foxnews.com/video/6391088435112) ![California Republican gubernatorial candidate sounds off on Newsom leadership](https://a57.foxnews.com/cf-images.us-east-1.prod.boltdns.net/v1/static/694940094001/df6b49de-a720-4f88-8285-7d0c4c3131c4/7d1e0e67-be1e-47da-8f74-5d78f1d94344/1280x720/match/896/500/image.jpg?ve=1&tl=1) Video This video is playing in picture-in-picture. Primary Politics [March 18, 2026](https://www.foxnews.com/html-video-sitemap/2026/march/18) 05:42 CLIP # California Republican gubernatorial candidate sounds off on Newsom leadership California Republican gubernatorial candidate Steve Hilton sounded off Gov. Gavin Newsom’s leadership calling him an “absolute failure on every front.” Tags - [POLITICS](https://www.foxnews.com/video/topics/politics) - [DIGITAL ORIGINALS](https://www.foxnews.com/video/topics/us/digital-originals) - [V-VIDEO](https://www.foxnews.com/video/topics/v-video) ## Live Now All times eastern NOW - 6:00 AM 6:00 AM 6:30 AM 7:00 AM 7:30 AM 8:00 AM Fox News Channel Fox & Friends First 5:00 AM - 6:00 AM [Watch](https://www.foxnews.com/video/5614615980001) Fox & Friends 6:00 AM - 7:00 AM Fox & Friends 7:00 AM - 8:00 AM Fox & Friends 8:00 AM - 8:30 AM Fox Business Channel Fox Weather First 5:00 AM - 6:00 AM [Watch](https://www.foxnews.com/video/5614626175001) Mornings With Maria 6:00 AM - 7:00 AM Mornings With Maria 7:00 AM - 8:00 AM Mornings With Maria 8:00 AM - 8:30 AM Fox Weather Channel Fox Weather Live Stream [Watch](https://www.foxnews.com/video/6275127689001) Fox News Radio FOX News Radio Live Channel Coverage Live Stream [Watch](https://www.foxnews.com/video/5599024308001) Fox News Channel Live Fox Weather Live Stream [Watch](https://www.foxnews.com/video/6275127689001) [Fox News](https://www.foxnews.com/ "Breaking News Today Fox News") - [New Privacy Policy](https://www.foxnews.com/privacy-policy) - [Updated Terms of Use](https://www.foxnews.com/terms-of-use) - [Your Privacy Choices](http://privacy.foxnews.com/main/web/main) - [Closed Caption Policy](https://www.foxnews.com/closed-captioning) - [Stream Safely](https://streamsafely.com/) - [News Sitemap](https://www.foxnews.com/html-sitemap) - [Video Sitemap](https://www.foxnews.com/html-video-sitemap) ©2026 FOX News Network, LLC. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed. All market data delayed 20 minutes.
Readable Markdown	![California Republican gubernatorial candidate sounds off on Newsom leadership](https://a57.foxnews.com/cf-images.us-east-1.prod.boltdns.net/v1/static/694940094001/df6b49de-a720-4f88-8285-7d0c4c3131c4/7d1e0e67-be1e-47da-8f74-5d78f1d94344/1280x720/match/896/500/image.jpg?ve=1&tl=1) Video This video is playing in picture-in-picture. ## Live Now All times eastern NOW - 6:00 AM 6:00 AM 6:30 AM 7:00 AM 7:30 AM 8:00 AM Fox News Channel Fox & Friends First 5:00 AM - 6:00 AM Fox & Friends 6:00 AM - 7:00 AM Fox & Friends 7:00 AM - 8:00 AM Fox & Friends 8:00 AM - 8:30 AM Fox Business Channel Fox Weather First 5:00 AM - 6:00 AM Mornings With Maria 6:00 AM - 7:00 AM Mornings With Maria 7:00 AM - 8:00 AM Mornings With Maria 8:00 AM - 8:30 AM Fox Weather Channel Fox Weather Live Stream Fox News Radio FOX News Radio Live Channel Coverage Live Stream Fox News Channel Live Fox Weather Live Stream
Shard	157 (laksa)
Root Hash	1511671639469378157
Unparsed URL	com,foxnews!www,/video/6391088435112 s443