🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 77 (from laksa050)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa077.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.mprnews.org/story/2016/06/12/orlando-club-shooting\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.mprnews.org/story/2016/06/12/orlando-club-shooting\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.mprnews.org\/story\/2016\/06\/12\/orlando-club-shooting","crawl_time":1767214501,"first_indexed_time":1466008420,"http_code":200,"src_unparsed":"org,mprnews!www,\/story\/2016\/06\/12\/orlando-club-shooting s443","src_root_hash":"7666323032944388877","history_drop_reason":null,"meta_title":"Deadliest shooting in US history: Suspect purchased guns legally, ATF says | MPR News","meta_descriptions":["Omar Mateen, the suspected shooter, was previously interviewed by the FBI several times over possible ties to terrorism. Authorities say he pledged allegiance to ISIS before attacking a gay nightclub in Orlando, killing 50."],"attrs_boilerpipe_text":"Sign up\nFirst Name\nLast Name\nEmail Address\nCreate User Name\nCreate Password\n*\nPassword must be at least 8 characters and contain one uppercase letter, one lowercase letter, one number and one symbol.\nAlready have an account?\nSign in\nBy submitting, you consent that you are at least 18 years of age and to receive information about MPR's or APMG entities' programs and offerings. The personally identifying information you provide will not be sold, shared, or used for purposes other than to communicate with you about MPR, APMG entities, and its sponsors. You may opt-out at any time clicking the unsubscribe link at the bottom of any email communication. View our\nPrivacy Policy\n.","attrs_markdown":"- [Skip to Main Content](https:\/\/www.mprnews.org\/story\/2016\/06\/12\/orlando-club-shooting#mainContent)\n- [Skip to audio player to listen live](https:\/\/www.mprnews.org\/story\/2016\/06\/12\/orlando-club-shooting#playbutton)\n\n[![MPR News](https:\/\/www.mprnews.org\/img\/mpr-news-logo-thumbnail.svg)Stay Curious. Stay Connected.](https:\/\/www.mprnews.org\/)\n\n[Newsletters](https:\/\/www.mprnews.org\/newsletters)\n\n[♡Donate Now](https:\/\/support.mpr.org\/news-web)\n\n- Menu\n- [Search](https:\/\/www.mprnews.org\/search)\n- Sign in\n\n- Menu\n- [Programs & Podcasts](https:\/\/www.mprnews.org\/podcasts)\n- [Schedule](https:\/\/www.mprnews.org\/schedule)\n- Ways to Give\n- [Search](https:\/\/www.mprnews.org\/search)\n- Sign in\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles3.svg)\n\nCreate a Free MPR\n\nnews profile\n\nfor you\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles4.svg)\n\nSign up\n\n**Already have an account?**\n\n[Sign in]()\n\nBy submitting, you consent that you are at least 18 years of age and to receive information about MPR's or APMG entities' programs and offerings. The personally identifying information you provide will not be sold, shared, or used for purposes other than to communicate with you about MPR, APMG entities, and its sponsors. You may opt-out at any time clicking the unsubscribe link at the bottom of any email communication. View our [Privacy Policy](https:\/\/www.americanpublicmedia.org\/privacy).\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles3.svg)\n\nWelcome back\n\nto news for you\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles4.svg)\n\nSign in to your profile\n\n**New to MPR News?**\n\n[Sign up]()\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles3.svg)\n\nWelcome back\n\nto news\n\nfor you\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles4.svg)\n\nReset Password\n\n**Still require assistance or not sure what your User Name is?**\n\n[Contact us](https:\/\/www.mpr.org\/contact)\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles3.svg)\n\nWelcome back\n\nto news\n\nfor you\n\n![](https:\/\/www.mprnews.org\/img\/column-of-colored-triangles4.svg)\n\nEmail Verification\n\nA verification code has been emailed to\n\nStill awaiting the code?\n\nSend another\n\n[Emma Bowman, NPR](https:\/\/www.mprnews.org\/people\/npr-543959056)\n\nJune 12, 2016 7:39 AM\n# Deadliest shooting in US history: Suspect purchased guns legally, ATF says\n\n### Go Deeper.\nCreate an account or log in to save stories.\n\n[Log in](https:\/\/www.mprnews.org\/auth\/signin)[Create a free Account](https:\/\/www.mprnews.org\/auth\/new-user)\n\n### Like this?\nThanks for liking this story! We have added it to a list of your favorite stories.\n\n[Show me\\!](https:\/\/www.mprnews.org\/for-you\/stories)\n\n**Save**\n\nShare\n\n![Copy link](https:\/\/www.mprnews.org\/img\/icon-link.svg)\n\n[![](https:\/\/www.mprnews.org\/img\/icon-linkedin.svg)](https:\/\/www.linkedin.com\/feed\/?shareActive=true&text=Deadliest%20shooting%20in%20US%20history%3A%20Suspect%20purchased%20guns%20legally%2C%20ATF%20says%20https:\/\/www.mprnews.org\/story\/2016\/06\/12\/orlando-club-shooting)[![](https:\/\/www.mprnews.org\/img\/icon-bluesky.svg)](https:\/\/bsky.app\/intent\/compose?text=Deadliest%20shooting%20in%20US%20history%3A%20Suspect%20purchased%20guns%20legally%2C%20ATF%20says%20https:\/\/www.mprnews.org\/story\/2016\/06\/12\/orlando-club-shooting)\n\n[Program Schedule](https:\/\/www.mprnews.org\/schedule)[Station Directory](https:\/\/www.mpr.org\/listen\/stations)\n\n[Providing Support for MPR. Learn More](https:\/\/www.mprnews.org\/underwriting)","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

3 months ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	3.5 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.mprnews.org/story/2016/06/12/orlando-club-shooting
Last Crawled	2025-12-31 20:55:01 (3 months ago)
First Indexed	2016-06-15 16:33:40 (9 years ago)
HTTP Status Code	200
Meta Title	Deadliest shooting in US history: Suspect purchased guns legally, ATF says \| MPR News
Meta Description	Omar Mateen, the suspected shooter, was previously interviewed by the FBI several times over possible ties to terrorism. Authorities say he pledged allegiance to ISIS before attacking a gay nightclub in Orlando, killing 50.
Meta Canonical	null
Boilerpipe Text	Sign up First Name Last Name Email Address Create User Name Create Password * Password must be at least 8 characters and contain one uppercase letter, one lowercase letter, one number and one symbol. Already have an account? Sign in By submitting, you consent that you are at least 18 years of age and to receive information about MPR's or APMG entities' programs and offerings. The personally identifying information you provide will not be sold, shared, or used for purposes other than to communicate with you about MPR, APMG entities, and its sponsors. You may opt-out at any time clicking the unsubscribe link at the bottom of any email communication. View our Privacy Policy .
Markdown	- [Skip to Main Content](https://www.mprnews.org/story/2016/06/12/orlando-club-shooting#mainContent) - [Skip to audio player to listen live](https://www.mprnews.org/story/2016/06/12/orlando-club-shooting#playbutton) [![MPR News](https://www.mprnews.org/img/mpr-news-logo-thumbnail.svg)Stay Curious. Stay Connected.](https://www.mprnews.org/) [Newsletters](https://www.mprnews.org/newsletters) [♡Donate Now](https://support.mpr.org/news-web) - Menu - [Search](https://www.mprnews.org/search) - Sign in - Menu - [Programs & Podcasts](https://www.mprnews.org/podcasts) - [Schedule](https://www.mprnews.org/schedule) - Ways to Give - [Search](https://www.mprnews.org/search) - Sign in ![](https://www.mprnews.org/img/column-of-colored-triangles3.svg) Create a Free MPR news profile for you ![](https://www.mprnews.org/img/column-of-colored-triangles4.svg) Sign up Already have an account? [Sign in]() By submitting, you consent that you are at least 18 years of age and to receive information about MPR's or APMG entities' programs and offerings. The personally identifying information you provide will not be sold, shared, or used for purposes other than to communicate with you about MPR, APMG entities, and its sponsors. You may opt-out at any time clicking the unsubscribe link at the bottom of any email communication. View our [Privacy Policy](https://www.americanpublicmedia.org/privacy). ![](https://www.mprnews.org/img/column-of-colored-triangles3.svg) Welcome back to news for you ![](https://www.mprnews.org/img/column-of-colored-triangles4.svg) Sign in to your profile New to MPR News? [Sign up]() ![](https://www.mprnews.org/img/column-of-colored-triangles3.svg) Welcome back to news for you ![](https://www.mprnews.org/img/column-of-colored-triangles4.svg) Reset Password Still require assistance or not sure what your User Name is? [Contact us](https://www.mpr.org/contact) ![](https://www.mprnews.org/img/column-of-colored-triangles3.svg) Welcome back to news for you ![](https://www.mprnews.org/img/column-of-colored-triangles4.svg) Email Verification A verification code has been emailed to Still awaiting the code? Send another [Emma Bowman, NPR](https://www.mprnews.org/people/npr-543959056) June 12, 2016 7:39 AM # Deadliest shooting in US history: Suspect purchased guns legally, ATF says ### Go Deeper. Create an account or log in to save stories. [Log in](https://www.mprnews.org/auth/signin)[Create a free Account](https://www.mprnews.org/auth/new-user) ### Like this? Thanks for liking this story! We have added it to a list of your favorite stories. [Show me\!](https://www.mprnews.org/for-you/stories) Save Share ![Copy link](https://www.mprnews.org/img/icon-link.svg) [![](https://www.mprnews.org/img/icon-linkedin.svg)](https://www.linkedin.com/feed/?shareActive=true&text=Deadliest%20shooting%20in%20US%20history%3A%20Suspect%20purchased%20guns%20legally%2C%20ATF%20says%20https://www.mprnews.org/story/2016/06/12/orlando-club-shooting)[![](https://www.mprnews.org/img/icon-bluesky.svg)](https://bsky.app/intent/compose?text=Deadliest%20shooting%20in%20US%20history%3A%20Suspect%20purchased%20guns%20legally%2C%20ATF%20says%20https://www.mprnews.org/story/2016/06/12/orlando-club-shooting) [Program Schedule](https://www.mprnews.org/schedule)[Station Directory](https://www.mpr.org/listen/stations) [Providing Support for MPR. Learn More](https://www.mprnews.org/underwriting)
Readable Markdown	null
Shard	77 (laksa)
Root Hash	7666323032944388877
Unparsed URL	org,mprnews!www,/story/2016/06/12/orlando-club-shooting s443