🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 125 (from laksa128)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa125.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.imdb.com/video/vi3070165273/\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.imdb.com/video/vi3070165273/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.imdb.com\/video\/vi3070165273\/","crawl_time":1749507910,"first_indexed_time":1691882139,"http_code":200,"src_unparsed":"com,imdb!www,\/video\/vi3070165273\/ s443","src_root_hash":"15645940993429321725","history_drop_reason":"tooold","meta_title":"Frankenstein junior - Young Frankenstein | IMDb","meta_descriptions":["Home Video Trailer from 20th Century Fox Home Entertainment"],"attrs_boilerpipe_text":"Back to top Video playback muted automatically, click unmute button for sound. Update browser settings to allow video playback with sound on this page in the future.","attrs_markdown":"Menu\n\nMovies\n\nTV Shows\n\nWatch\n\nAwards & Events\n\nCelebs\n\nCommunity\n\n[For Industry Professionals](https:\/\/pro.imdb.com\/?ref_=cons_nb_hm&rf=cons_nb_hm)\n\nLanguage English (United States)\n\n- Language\n\n- Fully supported\n- English (United States)\n\n- Français (Canada)\n- Français (France)\n- Deutsch (Deutschland)\n- हिंदी (भारत)\n- Italiano (Italia)\n- Português (Brasil)\n- Español (España)\n- Español (México)\n\n[Watchlist](https:\/\/www.imdb.com\/list\/watchlist\/?ref_=nv_usr_wl_all_0)\n\n[Sign In](https:\/\/www.imdb.com\/registration\/signin\/?ref=nv_generic_lgin&u=%2Fvideo%2Fvi3070165273%2F)\n\n[Sign In](https:\/\/www.imdb.com\/registration\/signin?ref_=signup_cm_nc_ca_btn&u=%2Fvideo%2Fvi3070165273%2F)\n\nNew Customer? [Create account](https:\/\/www.imdb.com\/registration\/signin?ref_=signup_cm_nc_ca&u=%2Fvideo%2Fvi3070165273%2F)\n\nEN\n\n- Fully supported\n- English (United States)\n\n- Français (Canada)\n- Français (France)\n- Deutsch (Deutschland)\n- हिंदी (भारत)\n- Italiano (Italia)\n- Português (Brasil)\n- Español (España)\n- Español (México)\n\n[Use app](https:\/\/slyb.app.link\/vtz1COZnXAb?$canonical_url=https:\/\/m.imdb.com\/video\/vi3070165273\/)\n\n[Home](https:\/\/www.imdb.com\/?ref_=vp_close)\n\nTap to unmute\n\nThis video file cannot be played.(Error Code: 224003)\n\n![Teri Garr, Gene Wilder, Marty Feldman, Madeline Kahn, and Peter Boyle in Frankenstein junior (1974)](https:\/\/m.media-amazon.com\/images\/M\/MV5BNWQwMWNmZGEtOGEzMy00NGE1LTg2ZGUtYWFiNjA4MWVlYWJkXkEyXkFqcGc@._V1_QL75_UY133_CR0,0,90,133_.jpg)\n\n[Frankenstein junior (1974)Tous publics \\| Comedy](https:\/\/www.imdb.com\/title\/tt0072431\/?ref_=vp_ov_t \"Frankenstein junior\")\n***\nYoung Frankenstein\n\nHome Video Trailer from 20th Century Fox Home Entertainment\n\n![](https:\/\/sb.scorecardresearch.com\/p?c1=2&c2=6034961&cj=1&cs_ucfr=)\n\n[Get the IMDb app](https:\/\/slyb.app.link\/SKdyQ6A449)\n\n[Sign in for more access](https:\/\/www.imdb.com\/registration\/signin\/?ref_=reg_ftr&u=%2Fvideo%2Fvi3070165273%2F)[Sign in for more access](https:\/\/www.imdb.com\/registration\/signin\/?ref_=reg_ftr&u=%2Fvideo%2Fvi3070165273%2F)\n\nFollow IMDb on social\n\nGet the IMDb app\n\nFor Android and iOS\n\n![Get the IMDb app](https:\/\/m.media-amazon.com\/images\/G\/01\/IMDb\/Mobile\/DesktopQRCode-png.png)\n\n- [Help](https:\/\/help.imdb.com\/imdb)\n- [Site Index](https:\/\/help.imdb.com\/article\/imdb\/general-information\/imdb-site-index\/GNCX7BHNSPBTFALQ#so)\n- [IMDbPro](https:\/\/pro.imdb.com\/?ref_=cons_tf_pro&rf=cons_tf_pro)\n- [Box Office Mojo](https:\/\/www.boxofficemojo.com\/)\n- [License IMDb Data](https:\/\/developer.imdb.com\/)\n\n- [Press Room](https:\/\/www.imdb.com\/pressroom\/?ref_=ft_pr)\n- [Advertising](https:\/\/advertising.amazon.com\/resources\/ad-specs\/imdb\/)\n- [Jobs](https:\/\/www.amazon.jobs\/en\/teams\/imdb)\n- [Conditions of Use](https:\/\/www.imdb.com\/conditions\/?ref_=ft_cou)\n- [Privacy Policy](https:\/\/www.imdb.com\/privacy\/?ref_=ft_pvc)\n- [Your Ads Privacy Choices](https:\/\/www.imdb.com\/privacy\/redirect\/?ref_=ft_redir)\n\n© 1990-2025 by IMDb.com, Inc.\n\nBack to top\n\nVideo playback muted automatically, click unmute button for sound. Update browser settings to allow video playback with sound on this page in the future.\n\nVideo playback muted automatically, click unmute button for sound. Update browser settings to allow video playback with sound on this page in the future.","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

🚫

NOT INDEXABLE

✅

CRAWLED

10 months ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	FAIL	`download_stamp > now() - 6 MONTH`	10.1 months ago
History drop	FAIL	`isNull(history_drop_reason)`	tooold
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.imdb.com/video/vi3070165273/
Last Crawled	2025-06-09 22:25:10 (10 months ago)
First Indexed	2023-08-12 23:15:39 (2 years ago)
HTTP Status Code	200
Meta Title	Frankenstein junior - Young Frankenstein \| IMDb
Meta Description	Home Video Trailer from 20th Century Fox Home Entertainment
Meta Canonical	null
Boilerpipe Text	Back to top Video playback muted automatically, click unmute button for sound. Update browser settings to allow video playback with sound on this page in the future.
Markdown	Menu Movies TV Shows Watch Awards & Events Celebs Community [For Industry Professionals](https://pro.imdb.com/?ref_=cons_nb_hm&rf=cons_nb_hm) Language English (United States) - Language - Fully supported - English (United States) - Français (Canada) - Français (France) - Deutsch (Deutschland) - हिंदी (भारत) - Italiano (Italia) - Português (Brasil) - Español (España) - Español (México) [Watchlist](https://www.imdb.com/list/watchlist/?ref_=nv_usr_wl_all_0) [Sign In](https://www.imdb.com/registration/signin/?ref=nv_generic_lgin&u=%2Fvideo%2Fvi3070165273%2F) [Sign In](https://www.imdb.com/registration/signin?ref_=signup_cm_nc_ca_btn&u=%2Fvideo%2Fvi3070165273%2F) New Customer? [Create account](https://www.imdb.com/registration/signin?ref_=signup_cm_nc_ca&u=%2Fvideo%2Fvi3070165273%2F) EN - Fully supported - English (United States) - Français (Canada) - Français (France) - Deutsch (Deutschland) - हिंदी (भारत) - Italiano (Italia) - Português (Brasil) - Español (España) - Español (México) [Use app](https://slyb.app.link/vtz1COZnXAb?$canonical_url=https://m.imdb.com/video/vi3070165273/) [Home](https://www.imdb.com/?ref_=vp_close) Tap to unmute This video file cannot be played.(Error Code: 224003) ![Teri Garr, Gene Wilder, Marty Feldman, Madeline Kahn, and Peter Boyle in Frankenstein junior (1974)](https://m.media-amazon.com/images/M/MV5BNWQwMWNmZGEtOGEzMy00NGE1LTg2ZGUtYWFiNjA4MWVlYWJkXkEyXkFqcGc@._V1_QL75_UY133_CR0,0,90,133_.jpg) [Frankenstein junior (1974)Tous publics \\| Comedy](https://www.imdb.com/title/tt0072431/?ref_=vp_ov_t "Frankenstein junior") *** Young Frankenstein Home Video Trailer from 20th Century Fox Home Entertainment ![](https://sb.scorecardresearch.com/p?c1=2&c2=6034961&cj=1&cs_ucfr=) [Get the IMDb app](https://slyb.app.link/SKdyQ6A449) [Sign in for more access](https://www.imdb.com/registration/signin/?ref_=reg_ftr&u=%2Fvideo%2Fvi3070165273%2F)[Sign in for more access](https://www.imdb.com/registration/signin/?ref_=reg_ftr&u=%2Fvideo%2Fvi3070165273%2F) Follow IMDb on social Get the IMDb app For Android and iOS ![Get the IMDb app](https://m.media-amazon.com/images/G/01/IMDb/Mobile/DesktopQRCode-png.png) - [Help](https://help.imdb.com/imdb) - [Site Index](https://help.imdb.com/article/imdb/general-information/imdb-site-index/GNCX7BHNSPBTFALQ#so) - [IMDbPro](https://pro.imdb.com/?ref_=cons_tf_pro&rf=cons_tf_pro) - [Box Office Mojo](https://www.boxofficemojo.com/) - [License IMDb Data](https://developer.imdb.com/) - [Press Room](https://www.imdb.com/pressroom/?ref_=ft_pr) - [Advertising](https://advertising.amazon.com/resources/ad-specs/imdb/) - [Jobs](https://www.amazon.jobs/en/teams/imdb) - [Conditions of Use](https://www.imdb.com/conditions/?ref_=ft_cou) - [Privacy Policy](https://www.imdb.com/privacy/?ref_=ft_pvc) - [Your Ads Privacy Choices](https://www.imdb.com/privacy/redirect/?ref_=ft_redir) © 1990-2025 by IMDb.com, Inc. Back to top Video playback muted automatically, click unmute button for sound. Update browser settings to allow video playback with sound on this page in the future. Video playback muted automatically, click unmute button for sound. Update browser settings to allow video playback with sound on this page in the future.
Readable Markdown	null
Shard	125 (laksa)
Root Hash	15645940993429321725
Unparsed URL	com,imdb!www,/video/vi3070165273/ s443