🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 21 (from laksa031)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa021.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://tcij.org/person/edward-snowden/\')), getAhrefsUnparsedNoserviceFromURL(\'https://tcij.org/person/edward-snowden/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/tcij.org\/person\/edward-snowden\/","crawl_time":1775120256,"first_indexed_time":1605493080,"http_code":200,"src_unparsed":"org,tcij!\/person\/edward-snowden\/ s443","src_root_hash":"5962176659371737421","history_drop_reason":null,"meta_title":"Centre for Investigative Journalism","meta_descriptions":[],"attrs_boilerpipe_text":"Edward Snowden is a former intelligence officer who served the CIA, NSA, and DIA for nearly a decade as a subject matter expert on technology and cybersecurity. In 2013, he revealed the NSA was unconstitutionally seizing the private records of billions of individuals who had not been suspected of any wrongdoing, resulting in the largest debate about reforms to US surveillance policy since 1978. He has received awards for courage, integrity, and public service, and was named the top global thinker of 2013 by Foreign Policy magazine. Today, he works on methods of enforcing human rights through the application and development of new technologies. He joined the board of Freedom of the Press Foundation in February 2014 and was named the president of the board in 2016.\nPast courses\n© Laura Poitras\nPresident  at Freedom of The Press Foundation","attrs_markdown":"[![](https:\/\/tcij.org\/wp-content\/themes\/tcij\/images\/cij_logo-small-grey.svg)](https:\/\/tcij.org\/)\n\n[The Centre for Investigative Journalism](https:\/\/tcij.org\/)\n\nThe Centre for Investigative Journalism\n\n- Training\n  - [Scheduled Training](https:\/\/tcij.org\/scheduled-training)\n  - [Bespoke Training](https:\/\/tcij.org\/bespoke-training)\n- Events\n  - [Summer Conference](https:\/\/tcij.org\/summer-conference)\n  - [Logan Symposium](https:\/\/tcij.org\/logan-symposium)\n  - [Regional Conference](https:\/\/tcij.org\/regional-conference)\n  - [Talks and Screenings](https:\/\/tcij.org\/talks-and-screenings)\n- Initiatives\n  - [Access to Tools](https:\/\/tcij.org\/access-to-tools\/open-source-intelligence\/)\n  - [Open Climate Reporting Initiative](https:\/\/tcij.org\/ocri\/)\n  - [Journalist Security Training](https:\/\/tcij.org\/initiative\/journalist-security-training\/)\n  - [Dark Green](https:\/\/tcij.org\/initiative\/dark-green\/)\n  - [Deep Focus](https:\/\/tcij.org\/initiative\/deep-focus\/)\n  - [Climate Change in News Media](https:\/\/tcij.org\/initiative\/climate-change-in-news-media\/)\n  - [Intl. Investigative Practice](https:\/\/tcij.org\/initiative\/international-investigative-practice\/)\n  - [Lyra McKee Bursary](https:\/\/tcij.org\/initiative\/lyra-mckee-investigative-journalism-training-bursary\/)\n  - [Community Journalism](https:\/\/tcij.org\/initiative\/community-journalism\/)\n  - [Source Protection Programme](https:\/\/tcij.org\/source-protection-programme\/spp)\n  - [Masterclass](https:\/\/tcij.org\/masterclass\/masterclasses-2021\/)\n- Resources\n  - [Handbooks](https:\/\/tcij.org\/handbooks)\n  - [Videos](https:\/\/tcij.org\/videos)\n- About\n  - [About Us](https:\/\/tcij.org\/about\/who-we-are\/)\n  - [Board](https:\/\/tcij.org\/about\/board\/)\n  - [Funders](https:\/\/tcij.org\/about\/funders\/)\n  - [Opportunities](https:\/\/tcij.org\/about\/opportunities\/)\n  - [Legal](https:\/\/tcij.org\/about\/legal\/)\n- [Donate](https:\/\/tcij.org\/donate)\n\n[Donate](https:\/\/tcij.org\/donate)\n\nMenu\n\n# Edward Snowden\nEdward Snowden is a former intelligence officer who served the CIA, NSA, and DIA for nearly a decade as a subject matter expert on technology and cybersecurity. In 2013, he revealed the NSA was unconstitutionally seizing the private records of billions of individuals who had not been suspected of any wrongdoing, resulting in the largest debate about reforms to US surveillance policy since 1978. He has received awards for courage, integrity, and public service, and was named the top global thinker of 2013 by Foreign Policy magazine. Today, he works on methods of enforcing human rights through the application and development of new technologies. He joined the board of Freedom of the Press Foundation in February 2014 and was named the president of the board in 2016.\n\n#### Past courses\n##### Symposium Event\n##### — Discussion Keynote\n16 November 2020\n### [Ai Weiwei in Conversation with Edward Snowden: Dissidence, Exile and how to Fight for Truth from afar.](https:\/\/tcij.org\/logan-symposium-event\/conversation-with-ai-wei-wei\/)\n##### People\n- [Ai Weiwei](https:\/\/tcij.org\/person\/ai-weiwei\/)\n- [Edward Snowden](https:\/\/tcij.org\/person\/edward-snowden\/)\n\n![](https:\/\/tcij.org\/wp-content\/uploads\/2020\/11\/Edward-Snowden-300x169.jpg)\n\n© Laura Poitras\n\nPresident at Freedom of The Press Foundation\n\n[freedom.press](https:\/\/freedom.press\/)\n\n[@FreedomofPress](https:\/\/twitter.com\/FreedomofPress)\n\n[X](https:\/\/twitter.com\/Snowden)\n\n[![](https:\/\/tcij.org\/wp-content\/themes\/tcij\/images\/cij_logo-white.svg)](https:\/\/tcij.org\/)\n\nThe Centre for Investigative Journalism (CIJ) is a think-tank, alternative university and an experimental laboratory set up to train a new generation of reporters in the tools of investigative, in-depth, and long-form journalism across all media. Registered as a charity, we robustly defend investigative journalists and those who work with them.\n\nCopyright © 2026 The Centre for Investigative Journalism.  \n UK Registered charity number 1118602.\n\n[Legal Information](https:\/\/tcij.org\/about\/legal) Site by [Rectangle](https:\/\/rectangle.design\/)\n\n##### Contact\nThe Centre for Investigative Journalism  \n Goldsmiths, University of London  \n Department of Media, Communications and Cultural Studies  \n 8 Lewisham Way, London SE14 6NW  \n United Kingdom  \n   \n [info@tcij.org](mailto:info@tcij.org)\n\n[Donate](https:\/\/tcij.org\/donate)\n\n[Facebook](https:\/\/www.facebook.com\/CIJournalism\/)\n\n[Instagram](https:\/\/www.instagram.com\/cijournalismuk\/)\n\n[Twitter](https:\/\/twitter.com\/cijournalism)\n\n[Bluesky](https:\/\/bsky.app\/profile\/tcij.org)\n\n[Mastodon](https:\/\/journa.host\/@cijournalism)\n\n[LinkedIn](https:\/\/uk.linkedin.com\/company\/centre-for-investigative-journalism)\n\n[Newsletter](https:\/\/tcij.org\/newsletter)","attrs_readable_markdown":"Edward Snowden is a former intelligence officer who served the CIA, NSA, and DIA for nearly a decade as a subject matter expert on technology and cybersecurity. In 2013, he revealed the NSA was unconstitutionally seizing the private records of billions of individuals who had not been suspected of any wrongdoing, resulting in the largest debate about reforms to US surveillance policy since 1978. He has received awards for courage, integrity, and public service, and was named the top global thinker of 2013 by Foreign Policy magazine. Today, he works on methods of enforcing human rights through the application and development of new technologies. He joined the board of Freedom of the Press Foundation in February 2014 and was named the president of the board in 2016.\n\nPast courses\n\n![](https:\/\/tcij.org\/wp-content\/uploads\/2020\/11\/Edward-Snowden-300x169.jpg)\n\n© Laura Poitras\n\nPresident at Freedom of The Press Foundation","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

7 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.2 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://tcij.org/person/edward-snowden/
Last Crawled	2026-04-02 08:57:36 (7 days ago)
First Indexed	2020-11-16 02:18:00 (5 years ago)
HTTP Status Code	200
Meta Title	Centre for Investigative Journalism
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Edward Snowden is a former intelligence officer who served the CIA, NSA, and DIA for nearly a decade as a subject matter expert on technology and cybersecurity. In 2013, he revealed the NSA was unconstitutionally seizing the private records of billions of individuals who had not been suspected of any wrongdoing, resulting in the largest debate about reforms to US surveillance policy since 1978. He has received awards for courage, integrity, and public service, and was named the top global thinker of 2013 by Foreign Policy magazine. Today, he works on methods of enforcing human rights through the application and development of new technologies. He joined the board of Freedom of the Press Foundation in February 2014 and was named the president of the board in 2016. Past courses © Laura Poitras President at Freedom of The Press Foundation
Markdown	[![](https://tcij.org/wp-content/themes/tcij/images/cij_logo-small-grey.svg)](https://tcij.org/) [The Centre for Investigative Journalism](https://tcij.org/) The Centre for Investigative Journalism - Training - [Scheduled Training](https://tcij.org/scheduled-training) - [Bespoke Training](https://tcij.org/bespoke-training) - Events - [Summer Conference](https://tcij.org/summer-conference) - [Logan Symposium](https://tcij.org/logan-symposium) - [Regional Conference](https://tcij.org/regional-conference) - [Talks and Screenings](https://tcij.org/talks-and-screenings) - Initiatives - [Access to Tools](https://tcij.org/access-to-tools/open-source-intelligence/) - [Open Climate Reporting Initiative](https://tcij.org/ocri/) - [Journalist Security Training](https://tcij.org/initiative/journalist-security-training/) - [Dark Green](https://tcij.org/initiative/dark-green/) - [Deep Focus](https://tcij.org/initiative/deep-focus/) - [Climate Change in News Media](https://tcij.org/initiative/climate-change-in-news-media/) - [Intl. Investigative Practice](https://tcij.org/initiative/international-investigative-practice/) - [Lyra McKee Bursary](https://tcij.org/initiative/lyra-mckee-investigative-journalism-training-bursary/) - [Community Journalism](https://tcij.org/initiative/community-journalism/) - [Source Protection Programme](https://tcij.org/source-protection-programme/spp) - [Masterclass](https://tcij.org/masterclass/masterclasses-2021/) - Resources - [Handbooks](https://tcij.org/handbooks) - [Videos](https://tcij.org/videos) - About - [About Us](https://tcij.org/about/who-we-are/) - [Board](https://tcij.org/about/board/) - [Funders](https://tcij.org/about/funders/) - [Opportunities](https://tcij.org/about/opportunities/) - [Legal](https://tcij.org/about/legal/) - [Donate](https://tcij.org/donate) [Donate](https://tcij.org/donate) Menu # Edward Snowden Edward Snowden is a former intelligence officer who served the CIA, NSA, and DIA for nearly a decade as a subject matter expert on technology and cybersecurity. In 2013, he revealed the NSA was unconstitutionally seizing the private records of billions of individuals who had not been suspected of any wrongdoing, resulting in the largest debate about reforms to US surveillance policy since 1978. He has received awards for courage, integrity, and public service, and was named the top global thinker of 2013 by Foreign Policy magazine. Today, he works on methods of enforcing human rights through the application and development of new technologies. He joined the board of Freedom of the Press Foundation in February 2014 and was named the president of the board in 2016. #### Past courses ##### Symposium Event ##### — Discussion Keynote 16 November 2020 ### [Ai Weiwei in Conversation with Edward Snowden: Dissidence, Exile and how to Fight for Truth from afar.](https://tcij.org/logan-symposium-event/conversation-with-ai-wei-wei/) ##### People - [Ai Weiwei](https://tcij.org/person/ai-weiwei/) - [Edward Snowden](https://tcij.org/person/edward-snowden/) ![](https://tcij.org/wp-content/uploads/2020/11/Edward-Snowden-300x169.jpg) © Laura Poitras President at Freedom of The Press Foundation [freedom.press](https://freedom.press/) [@FreedomofPress](https://twitter.com/FreedomofPress) [X](https://twitter.com/Snowden) [![](https://tcij.org/wp-content/themes/tcij/images/cij_logo-white.svg)](https://tcij.org/) The Centre for Investigative Journalism (CIJ) is a think-tank, alternative university and an experimental laboratory set up to train a new generation of reporters in the tools of investigative, in-depth, and long-form journalism across all media. Registered as a charity, we robustly defend investigative journalists and those who work with them. Copyright © 2026 The Centre for Investigative Journalism. UK Registered charity number 1118602. [Legal Information](https://tcij.org/about/legal) Site by [Rectangle](https://rectangle.design/) ##### Contact The Centre for Investigative Journalism Goldsmiths, University of London Department of Media, Communications and Cultural Studies 8 Lewisham Way, London SE14 6NW United Kingdom [info@tcij.org](mailto:info@tcij.org) [Donate](https://tcij.org/donate) [Facebook](https://www.facebook.com/CIJournalism/) [Instagram](https://www.instagram.com/cijournalismuk/) [Twitter](https://twitter.com/cijournalism) [Bluesky](https://bsky.app/profile/tcij.org) [Mastodon](https://journa.host/@cijournalism) [LinkedIn](https://uk.linkedin.com/company/centre-for-investigative-journalism) [Newsletter](https://tcij.org/newsletter)
Readable Markdown	Edward Snowden is a former intelligence officer who served the CIA, NSA, and DIA for nearly a decade as a subject matter expert on technology and cybersecurity. In 2013, he revealed the NSA was unconstitutionally seizing the private records of billions of individuals who had not been suspected of any wrongdoing, resulting in the largest debate about reforms to US surveillance policy since 1978. He has received awards for courage, integrity, and public service, and was named the top global thinker of 2013 by Foreign Policy magazine. Today, he works on methods of enforcing human rights through the application and development of new technologies. He joined the board of Freedom of the Press Foundation in February 2014 and was named the president of the board in 2016. Past courses ![](https://tcij.org/wp-content/uploads/2020/11/Edward-Snowden-300x169.jpg) © Laura Poitras President at Freedom of The Press Foundation
Shard	21 (laksa)
Root Hash	5962176659371737421
Unparsed URL	org,tcij!/person/edward-snowden/ s443