🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 117 (from laksa080)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa117.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://memchik.ru/show/5d29951cb1c7e34fdf51f927\')), getAhrefsUnparsedNoserviceFromURL(\'https://memchik.ru/show/5d29951cb1c7e34fdf51f927\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/memchik.ru\/show\/5d29951cb1c7e34fdf51f927","crawl_time":1759908844,"first_indexed_time":1563061078,"http_code":200,"src_unparsed":"ru,memchik!\/show\/5d29951cb1c7e34fdf51f927 s443","src_root_hash":"4300723223983226317","history_drop_reason":null,"meta_title":"как тебе такое илон маск - Memchik.ru","meta_descriptions":[],"attrs_boilerpipe_text":"как тебе такое илон маск - Memchik.ru","attrs_markdown":"- [Создать мем](https:\/\/memchik.ru\/)\n\n![](https:\/\/memchik.ru\/images\/memes\/5d29951cb1c7e34fdf51f927.jpg)\n\n[Изменить текст](https:\/\/memchik.ru\/mem\/mask_kurit)\n\n[Создать новый мем](https:\/\/memchik.ru\/)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_monkey_puppet.jpg)](https:\/\/memchik.ru\/mem\/monkey_puppet)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_chto_proishodit.jpg)](https:\/\/memchik.ru\/mem\/chto_proishodit)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_kot_za_uglom.jpg)](https:\/\/memchik.ru\/mem\/kot_za_uglom)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_neverniy_paren.jpg)](https:\/\/memchik.ru\/mem\/neverniy_paren)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_mcconaughey_smoke.jpg)](https:\/\/memchik.ru\/mem\/mcconaughey_smoke)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_kloun_iz_kanalizacii.jpg)](https:\/\/memchik.ru\/mem\/kloun_iz_kanalizacii)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_kot_zochem.jpg)](https:\/\/memchik.ru\/mem\/kot_zochem)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_eto_golub.jpg)](https:\/\/memchik.ru\/mem\/eto_golub)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_ba_dum_tss.jpg)](https:\/\/memchik.ru\/mem\/ba_dum_tss)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_tak_blet.jpg)](https:\/\/memchik.ru\/mem\/tak_blet)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_na_menya_okazyvaetsya_davlenie.jpg)](https:\/\/memchik.ru\/mem\/na_menya_okazyvaetsya_davlenie)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_druzhko_show.jpg)](https:\/\/memchik.ru\/mem\/druzhko_show)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_agutin_golos.jpg)](https:\/\/memchik.ru\/mem\/agutin_golos)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_taet_led.jpg)](https:\/\/memchik.ru\/mem\/taet_led)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_meryl_streep.jpg)](https:\/\/memchik.ru\/mem\/meryl_streep)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_kot_hoba.jpg)](https:\/\/memchik.ru\/mem\/kot_hoba)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_ne_delay_ne_budet.jpg)](https:\/\/memchik.ru\/mem\/ne_delay_ne_budet)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_tut.jpg)](https:\/\/memchik.ru\/mem\/tut)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_diana_shurygina.jpg)](https:\/\/memchik.ru\/mem\/diana_shurygina)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_zhdun.jpg)](https:\/\/memchik.ru\/mem\/zhdun)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_vzhuh.jpg)](https:\/\/memchik.ru\/mem\/vzhuh)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_silniy_kot.jpg)](https:\/\/memchik.ru\/mem\/silniy_kot)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_sobaka_podozrevaka.jpg)](https:\/\/memchik.ru\/mem\/sobaka_podozrevaka)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_ya_v_etom_sharyu.jpg)](https:\/\/memchik.ru\/mem\/ya_v_etom_sharyu)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_oputi_niputyu.jpg)](https:\/\/memchik.ru\/mem\/oputi_niputyu)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_moe_lico_kogda.jpg)](https:\/\/memchik.ru\/mem\/moe_lico_kogda)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_ostanovochka.jpg)](https:\/\/memchik.ru\/mem\/ostanovochka)\n\n[![](https:\/\/memchik.ru\/images\/templates\/thumb_bleat.jpg)](https:\/\/memchik.ru\/mem\/bleat)\n\n1  [2](https:\/\/memchik.ru\/show\/5d29951cb1c7e34fdf51f927?page=2)   [3](https:\/\/memchik.ru\/show\/5d29951cb1c7e34fdf51f927?page=3)   [4](https:\/\/memchik.ru\/show\/5d29951cb1c7e34fdf51f927?page=4)   [5](https:\/\/memchik.ru\/show\/5d29951cb1c7e34fdf51f927?page=5)   [\\>](https:\/\/memchik.ru\/show\/5d29951cb1c7e34fdf51f927?page=2)   [\\>\\>](https:\/\/memchik.ru\/show\/5d29951cb1c7e34fdf51f927?page=5)\n\n- Мемогенератор Мемчик.Ру\n- Design: [HTML5 UP](http:\/\/html5up.net\/)\n\n![](https:\/\/mc.yandex.ru\/watch\/42326394)","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

🚫

NOT INDEXABLE

✅

CRAWLED

6 months ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	FAIL	`download_stamp > now() - 6 MONTH`	6.1 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://memchik.ru/show/5d29951cb1c7e34fdf51f927
Last Crawled	2025-10-08 07:34:04 (6 months ago)
First Indexed	2019-07-13 23:37:58 (6 years ago)
HTTP Status Code	200
Meta Title	как тебе такое илон маск - Memchik.ru
Meta Description	null
Meta Canonical	null
Boilerpipe Text	как тебе такое илон маск - Memchik.ru
Markdown	- [Создать мем](https://memchik.ru/) ![](https://memchik.ru/images/memes/5d29951cb1c7e34fdf51f927.jpg) [Изменить текст](https://memchik.ru/mem/mask_kurit) [Создать новый мем](https://memchik.ru/) [![](https://memchik.ru/images/templates/thumb_monkey_puppet.jpg)](https://memchik.ru/mem/monkey_puppet) [![](https://memchik.ru/images/templates/thumb_chto_proishodit.jpg)](https://memchik.ru/mem/chto_proishodit) [![](https://memchik.ru/images/templates/thumb_kot_za_uglom.jpg)](https://memchik.ru/mem/kot_za_uglom) [![](https://memchik.ru/images/templates/thumb_neverniy_paren.jpg)](https://memchik.ru/mem/neverniy_paren) [![](https://memchik.ru/images/templates/thumb_mcconaughey_smoke.jpg)](https://memchik.ru/mem/mcconaughey_smoke) [![](https://memchik.ru/images/templates/thumb_kloun_iz_kanalizacii.jpg)](https://memchik.ru/mem/kloun_iz_kanalizacii) [![](https://memchik.ru/images/templates/thumb_kot_zochem.jpg)](https://memchik.ru/mem/kot_zochem) [![](https://memchik.ru/images/templates/thumb_eto_golub.jpg)](https://memchik.ru/mem/eto_golub) [![](https://memchik.ru/images/templates/thumb_ba_dum_tss.jpg)](https://memchik.ru/mem/ba_dum_tss) [![](https://memchik.ru/images/templates/thumb_tak_blet.jpg)](https://memchik.ru/mem/tak_blet) [![](https://memchik.ru/images/templates/thumb_na_menya_okazyvaetsya_davlenie.jpg)](https://memchik.ru/mem/na_menya_okazyvaetsya_davlenie) [![](https://memchik.ru/images/templates/thumb_druzhko_show.jpg)](https://memchik.ru/mem/druzhko_show) [![](https://memchik.ru/images/templates/thumb_agutin_golos.jpg)](https://memchik.ru/mem/agutin_golos) [![](https://memchik.ru/images/templates/thumb_taet_led.jpg)](https://memchik.ru/mem/taet_led) [![](https://memchik.ru/images/templates/thumb_meryl_streep.jpg)](https://memchik.ru/mem/meryl_streep) [![](https://memchik.ru/images/templates/thumb_kot_hoba.jpg)](https://memchik.ru/mem/kot_hoba) [![](https://memchik.ru/images/templates/thumb_ne_delay_ne_budet.jpg)](https://memchik.ru/mem/ne_delay_ne_budet) [![](https://memchik.ru/images/templates/thumb_tut.jpg)](https://memchik.ru/mem/tut) [![](https://memchik.ru/images/templates/thumb_diana_shurygina.jpg)](https://memchik.ru/mem/diana_shurygina) [![](https://memchik.ru/images/templates/thumb_zhdun.jpg)](https://memchik.ru/mem/zhdun) [![](https://memchik.ru/images/templates/thumb_vzhuh.jpg)](https://memchik.ru/mem/vzhuh) [![](https://memchik.ru/images/templates/thumb_silniy_kot.jpg)](https://memchik.ru/mem/silniy_kot) [![](https://memchik.ru/images/templates/thumb_sobaka_podozrevaka.jpg)](https://memchik.ru/mem/sobaka_podozrevaka) [![](https://memchik.ru/images/templates/thumb_ya_v_etom_sharyu.jpg)](https://memchik.ru/mem/ya_v_etom_sharyu) [![](https://memchik.ru/images/templates/thumb_oputi_niputyu.jpg)](https://memchik.ru/mem/oputi_niputyu) [![](https://memchik.ru/images/templates/thumb_moe_lico_kogda.jpg)](https://memchik.ru/mem/moe_lico_kogda) [![](https://memchik.ru/images/templates/thumb_ostanovochka.jpg)](https://memchik.ru/mem/ostanovochka) [![](https://memchik.ru/images/templates/thumb_bleat.jpg)](https://memchik.ru/mem/bleat) 1 [2](https://memchik.ru/show/5d29951cb1c7e34fdf51f927?page=2) [3](https://memchik.ru/show/5d29951cb1c7e34fdf51f927?page=3) [4](https://memchik.ru/show/5d29951cb1c7e34fdf51f927?page=4) [5](https://memchik.ru/show/5d29951cb1c7e34fdf51f927?page=5) [\>](https://memchik.ru/show/5d29951cb1c7e34fdf51f927?page=2) [\>\>](https://memchik.ru/show/5d29951cb1c7e34fdf51f927?page=5) - Мемогенератор Мемчик.Ру - Design: [HTML5 UP](http://html5up.net/) ![](https://mc.yandex.ru/watch/42326394)
Readable Markdown	null
Shard	117 (laksa)
Root Hash	4300723223983226317
Unparsed URL	ru,memchik!/show/5d29951cb1c7e34fdf51f927 s443