🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 133 (from laksa057)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa133.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.newyorker.com/goings-on-about-town/movies/the-big-short\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.newyorker.com/goings-on-about-town/movies/the-big-short\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.newyorker.com\/goings-on-about-town\/movies\/the-big-short","crawl_time":1775416772,"first_indexed_time":1510058328,"http_code":200,"src_unparsed":"com,newyorker!www,\/goings-on-about-town\/movies\/the-big-short s443","src_root_hash":"16027205805525588333","history_drop_reason":null,"meta_title":"The Big Short | The New Yorker","meta_descriptions":[""],"attrs_boilerpipe_text":"February 11, 2016\nYears before the financial crisis of 2008, early rumblings are detected by Michael Burry (Christian Bale), whose investment skills are in sharp contrast to his social unease. Unlike most of his peers, he spies the cracks in the housing market and wagers that, before too long, it will all come tumbling down. Word of his gamble inspires a few more players to take the plunge, including a miserable hedge-fund manager (Steve Carell), a pair of greenhorns from out of town (John Magaro and Finn Wittrock), and our sly narrator (Ryan Gosling), who works at Deutsche Bank. These are just some of the unlovely figures who pace back and forth through Adam McKay’s new film, based on the nonfiction book by Michael Lewis. The movie pops and fizzes with invention, and even takes time out, now and then, to educate—screeching to a halt and summoning a celebrity (Selena Gomez, say, or Margot Robbie) to steer us through the economic verbiage. Everything you always wanted to know about credit-default swaps but were afraid to ask: it’s all here. So winning are these tactics, and so cheerfully headlong is the mood, that we’re hardly aware of rooting for a bunch of utter cynics who are poised to make tens of millions of dollars from the misfortunes of others.\n(In wide release.)","attrs_markdown":"[Skip to main content](https:\/\/www.newyorker.com\/goings-on-about-town\/movies\/the-big-short#main-content)\n\n[![The New Yorker](https:\/\/www.newyorker.com\/verso\/static\/thenewyorker-us\/assets\/logo.svg)](https:\/\/www.newyorker.com\/)\n\n- [Newsletter](https:\/\/www.newyorker.com\/newsletters?sourceCode=navbar)\n\nSearch\n\n- [The Latest](https:\/\/www.newyorker.com\/latest)\n- [News](https:\/\/www.newyorker.com\/news)\n- [Books & Culture](https:\/\/www.newyorker.com\/culture)\n- [Fiction & Poetry](https:\/\/www.newyorker.com\/fiction-and-poetry)\n- [Humor & Cartoons](https:\/\/www.newyorker.com\/humor)\n- [Magazine](https:\/\/www.newyorker.com\/archive)\n- [Puzzles & Games](https:\/\/www.newyorker.com\/crossword-puzzles-and-games)\n- [Video](https:\/\/www.newyorker.com\/video)\n- [Podcasts](https:\/\/www.newyorker.com\/podcasts)\n- [Goings On](https:\/\/www.newyorker.com\/goings-on)\n- [Shop](https:\/\/store.newyorker.com\/)\n\nOpen Navigation Menu\n\n[![The New Yorker](https:\/\/www.newyorker.com\/verso\/static\/thenewyorker-us\/assets\/logo-header.svg)](https:\/\/www.newyorker.com\/)\n\n[Movies](\/\/)\n\n# The Big Short\n\nBy [Anthony Lane](https:\/\/www.newyorker.com\/contributors\/anthony-lane)\n\nFebruary 11, 2016\n\nYears before the financial crisis of 2008, early rumblings are detected by Michael Burry (Christian Bale), whose investment skills are in sharp contrast to his social unease. Unlike most of his peers, he spies the cracks in the housing market and wagers that, before too long, it will all come tumbling down. Word of his gamble inspires a few more players to take the plunge, including a miserable hedge-fund manager (Steve Carell), a pair of greenhorns from out of town (John Magaro and Finn Wittrock), and our sly narrator (Ryan Gosling), who works at Deutsche Bank. These are just some of the unlovely figures who pace back and forth through Adam McKay’s new film, based on the nonfiction book by Michael Lewis. The movie pops and fizzes with invention, and even takes time out, now and then, to educate—screeching to a halt and summoning a celebrity (Selena Gomez, say, or Margot Robbie) to steer us through the economic verbiage. Everything you always wanted to know about credit-default swaps but were afraid to ask: it’s all here. So winning are these tactics, and so cheerfully headlong is the mood, that we’re hardly aware of rooting for a bunch of utter cynics who are poised to make tens of millions of dollars from the misfortunes of others.*(In wide release.)*\n\nPublished in the print edition of the [February 22, 2016](https:\/\/www.newyorker.com\/magazine\/2016\/02\/22), issue.\n\n[![The New Yorker](https:\/\/www.newyorker.com\/verso\/static\/thenewyorker-us\/assets\/logo-reverse.svg)](https:\/\/www.newyorker.com\/)\n\nSections\n\n- [News](https:\/\/www.newyorker.com\/news)\n- [Books & Culture](https:\/\/www.newyorker.com\/culture)\n- [Fiction & Poetry](https:\/\/www.newyorker.com\/fiction-and-poetry)\n- [Humor & Cartoons](https:\/\/www.newyorker.com\/humor)\n- [Magazine](https:\/\/www.newyorker.com\/archive)\n- [Crossword](https:\/\/www.newyorker.com\/crossword-puzzles-and-games)\n- [Video](https:\/\/www.newyorker.com\/video)\n- [Podcasts](https:\/\/www.newyorker.com\/podcast)\n- [100th Anniversary](https:\/\/www.newyorker.com\/100)\n- [Goings On](https:\/\/www.newyorker.com\/goings-on)\n\nMore\n\n- [Manage Account](https:\/\/www.newyorker.com\/account\/profile)\n- [Shop The New Yorker](https:\/\/store.newyorker.com\/)\n- [Buy Covers and Cartoons](https:\/\/condenaststore.com\/art\/new+yorker+covers)\n- [Condé Nast Store](https:\/\/condenaststore.com\/conde-nast-brand\/thenewyorker)\n- [Digital Access](https:\/\/www.newyorker.com\/about\/digital-access)\n- [Subscribe](https:\/\/www.newyorker.com\/subscribe)\n- [Newsletters](https:\/\/www.newyorker.com\/newsletter)\n- [Jigsaw Puzzle](https:\/\/www.newyorker.com\/jigsaw)\n- [RSS](https:\/\/www.newyorker.com\/about\/feeds)\n- [Site Map](https:\/\/www.newyorker.com\/sitemap)\n\n- [About](https:\/\/www.newyorker.com\/about\/us)\n- [Careers](https:\/\/www.newyorker.com\/about\/careers)\n- [Contact](https:\/\/www.newyorker.com\/about\/contact)\n- [F.A.Q.](https:\/\/www.newyorker.com\/about\/faq)\n- [Media Kit](https:\/\/www.condenast.com\/advertising)\n- [Press](https:\/\/www.newyorker.com\/about\/press)\n- [Accessibility Help](https:\/\/www.newyorker.com\/about\/accessibility-help)\n- [User Agreement](https:\/\/www.condenast.com\/user-agreement\/)\n- [Privacy Policy](http:\/\/www.condenast.com\/privacy-policy#privacypolicy)\n- [Your California Privacy Rights](http:\/\/www.condenast.com\/privacy-policy#privacypolicy-california)\n\n© 2026 Condé Nast. All rights reserved. *The New Yorker* may earn a portion of sales from products that are purchased through our site as part of our Affiliate Partnerships with retailers. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of Condé Nast. [Ad Choices](http:\/\/www.aboutads.info\/)","attrs_readable_markdown":"February 11, 2016\n\nYears before the financial crisis of 2008, early rumblings are detected by Michael Burry (Christian Bale), whose investment skills are in sharp contrast to his social unease. Unlike most of his peers, he spies the cracks in the housing market and wagers that, before too long, it will all come tumbling down. Word of his gamble inspires a few more players to take the plunge, including a miserable hedge-fund manager (Steve Carell), a pair of greenhorns from out of town (John Magaro and Finn Wittrock), and our sly narrator (Ryan Gosling), who works at Deutsche Bank. These are just some of the unlovely figures who pace back and forth through Adam McKay’s new film, based on the nonfiction book by Michael Lewis. The movie pops and fizzes with invention, and even takes time out, now and then, to educate—screeching to a halt and summoning a celebrity (Selena Gomez, say, or Margot Robbie) to steer us through the economic verbiage. Everything you always wanted to know about credit-default swaps but were afraid to ask: it’s all here. So winning are these tactics, and so cheerfully headlong is the mood, that we’re hardly aware of rooting for a bunch of utter cynics who are poised to make tens of millions of dollars from the misfortunes of others.*(In wide release.)*","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

11 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.4 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.newyorker.com/goings-on-about-town/movies/the-big-short
Last Crawled	2026-04-05 19:19:32 (11 days ago)
First Indexed	2017-11-07 12:38:48 (8 years ago)
HTTP Status Code	200
Meta Title	The Big Short \| The New Yorker
Meta Description	null
Meta Canonical	null
Boilerpipe Text	February 11, 2016 Years before the financial crisis of 2008, early rumblings are detected by Michael Burry (Christian Bale), whose investment skills are in sharp contrast to his social unease. Unlike most of his peers, he spies the cracks in the housing market and wagers that, before too long, it will all come tumbling down. Word of his gamble inspires a few more players to take the plunge, including a miserable hedge-fund manager (Steve Carell), a pair of greenhorns from out of town (John Magaro and Finn Wittrock), and our sly narrator (Ryan Gosling), who works at Deutsche Bank. These are just some of the unlovely figures who pace back and forth through Adam McKay’s new film, based on the nonfiction book by Michael Lewis. The movie pops and fizzes with invention, and even takes time out, now and then, to educate—screeching to a halt and summoning a celebrity (Selena Gomez, say, or Margot Robbie) to steer us through the economic verbiage. Everything you always wanted to know about credit-default swaps but were afraid to ask: it’s all here. So winning are these tactics, and so cheerfully headlong is the mood, that we’re hardly aware of rooting for a bunch of utter cynics who are poised to make tens of millions of dollars from the misfortunes of others. (In wide release.)
Markdown	[Skip to main content](https://www.newyorker.com/goings-on-about-town/movies/the-big-short#main-content) [![The New Yorker](https://www.newyorker.com/verso/static/thenewyorker-us/assets/logo.svg)](https://www.newyorker.com/) - [Newsletter](https://www.newyorker.com/newsletters?sourceCode=navbar) Search - [The Latest](https://www.newyorker.com/latest) - [News](https://www.newyorker.com/news) - [Books & Culture](https://www.newyorker.com/culture) - [Fiction & Poetry](https://www.newyorker.com/fiction-and-poetry) - [Humor & Cartoons](https://www.newyorker.com/humor) - [Magazine](https://www.newyorker.com/archive) - [Puzzles & Games](https://www.newyorker.com/crossword-puzzles-and-games) - [Video](https://www.newyorker.com/video) - [Podcasts](https://www.newyorker.com/podcasts) - [Goings On](https://www.newyorker.com/goings-on) - [Shop](https://store.newyorker.com/) Open Navigation Menu [![The New Yorker](https://www.newyorker.com/verso/static/thenewyorker-us/assets/logo-header.svg)](https://www.newyorker.com/) [Movies](//) # The Big Short By [Anthony Lane](https://www.newyorker.com/contributors/anthony-lane) February 11, 2016 Years before the financial crisis of 2008, early rumblings are detected by Michael Burry (Christian Bale), whose investment skills are in sharp contrast to his social unease. Unlike most of his peers, he spies the cracks in the housing market and wagers that, before too long, it will all come tumbling down. Word of his gamble inspires a few more players to take the plunge, including a miserable hedge-fund manager (Steve Carell), a pair of greenhorns from out of town (John Magaro and Finn Wittrock), and our sly narrator (Ryan Gosling), who works at Deutsche Bank. These are just some of the unlovely figures who pace back and forth through Adam McKay’s new film, based on the nonfiction book by Michael Lewis. The movie pops and fizzes with invention, and even takes time out, now and then, to educate—screeching to a halt and summoning a celebrity (Selena Gomez, say, or Margot Robbie) to steer us through the economic verbiage. Everything you always wanted to know about credit-default swaps but were afraid to ask: it’s all here. So winning are these tactics, and so cheerfully headlong is the mood, that we’re hardly aware of rooting for a bunch of utter cynics who are poised to make tens of millions of dollars from the misfortunes of others.(In wide release.) Published in the print edition of the [February 22, 2016](https://www.newyorker.com/magazine/2016/02/22), issue. [![The New Yorker](https://www.newyorker.com/verso/static/thenewyorker-us/assets/logo-reverse.svg)](https://www.newyorker.com/) Sections - [News](https://www.newyorker.com/news) - [Books & Culture](https://www.newyorker.com/culture) - [Fiction & Poetry](https://www.newyorker.com/fiction-and-poetry) - [Humor & Cartoons](https://www.newyorker.com/humor) - [Magazine](https://www.newyorker.com/archive) - [Crossword](https://www.newyorker.com/crossword-puzzles-and-games) - [Video](https://www.newyorker.com/video) - [Podcasts](https://www.newyorker.com/podcast) - [100th Anniversary](https://www.newyorker.com/100) - [Goings On](https://www.newyorker.com/goings-on) More - [Manage Account](https://www.newyorker.com/account/profile) - [Shop The New Yorker](https://store.newyorker.com/) - [Buy Covers and Cartoons](https://condenaststore.com/art/new+yorker+covers) - [Condé Nast Store](https://condenaststore.com/conde-nast-brand/thenewyorker) - [Digital Access](https://www.newyorker.com/about/digital-access) - [Subscribe](https://www.newyorker.com/subscribe) - [Newsletters](https://www.newyorker.com/newsletter) - [Jigsaw Puzzle](https://www.newyorker.com/jigsaw) - [RSS](https://www.newyorker.com/about/feeds) - [Site Map](https://www.newyorker.com/sitemap) - [About](https://www.newyorker.com/about/us) - [Careers](https://www.newyorker.com/about/careers) - [Contact](https://www.newyorker.com/about/contact) - [F.A.Q.](https://www.newyorker.com/about/faq) - [Media Kit](https://www.condenast.com/advertising) - [Press](https://www.newyorker.com/about/press) - [Accessibility Help](https://www.newyorker.com/about/accessibility-help) - [User Agreement](https://www.condenast.com/user-agreement/) - [Privacy Policy](http://www.condenast.com/privacy-policy#privacypolicy) - [Your California Privacy Rights](http://www.condenast.com/privacy-policy#privacypolicy-california) © 2026 Condé Nast. All rights reserved. The New Yorker may earn a portion of sales from products that are purchased through our site as part of our Affiliate Partnerships with retailers. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of Condé Nast. [Ad Choices](http://www.aboutads.info/)
Readable Markdown	February 11, 2016 Years before the financial crisis of 2008, early rumblings are detected by Michael Burry (Christian Bale), whose investment skills are in sharp contrast to his social unease. Unlike most of his peers, he spies the cracks in the housing market and wagers that, before too long, it will all come tumbling down. Word of his gamble inspires a few more players to take the plunge, including a miserable hedge-fund manager (Steve Carell), a pair of greenhorns from out of town (John Magaro and Finn Wittrock), and our sly narrator (Ryan Gosling), who works at Deutsche Bank. These are just some of the unlovely figures who pace back and forth through Adam McKay’s new film, based on the nonfiction book by Michael Lewis. The movie pops and fizzes with invention, and even takes time out, now and then, to educate—screeching to a halt and summoning a celebrity (Selena Gomez, say, or Margot Robbie) to steer us through the economic verbiage. Everything you always wanted to know about credit-default swaps but were afraid to ask: it’s all here. So winning are these tactics, and so cheerfully headlong is the mood, that we’re hardly aware of rooting for a bunch of utter cynics who are poised to make tens of millions of dollars from the misfortunes of others.(In wide release.)
Shard	133 (laksa)
Root Hash	16027205805525588333
Unparsed URL	com,newyorker!www,/goings-on-about-town/movies/the-big-short s443