🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 186 (from laksa131)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa186.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, meta_canonical AS meta_canonical, ml_categories_json AS ml_categories_json, ml_types_json AS ml_types_json, ml_intent_types_json AS ml_intent_types_json, meta_language AS meta_language, attrs_author AS attrs_author, ifNull(toUnixTimestamp(attrs_publish_time), 0) AS attrs_publish_time, ifNull(toUnixTimestamp(attrs_original_publish_time), 0) AS attrs_original_publish_time, ifNull(attrs_is_republished, 0) AS attrs_is_republished, ifNull(attrs_nr_words, 0) AS attrs_nr_words, ifNull(attrs_boilerpipe_nr_words, 0) AS attrs_boilerpipe_nr_words, ifNull(body_ext_links_number, 0) AS body_ext_links_number, ifNull(body_int_links_number, 0) AS body_int_links_number, ifNull(meta_nofollow, 0) AS meta_nofollow, ifNull(meta_noarchive, 0) AS meta_noarchive, ifNull(props_was_rendered, 0) AS props_was_rendered, ifNull(src_redirect, \'\') AS src_redirect, ifNull(download_time_msec, 0) AS download_time_msec, ifNull(download_ttfb_msec, 0) AS download_ttfb_msec, ifNull(download_size, 0) AS download_size FROM crawler3.page_info_local FINAL PREWHERE int_partition_id = 36 AND (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://fddi.fudan.edu.cn/73/49/c21253a684873/page.htm\')), getAhrefsUnparsedNoserviceFromURL(\'https://fddi.fudan.edu.cn/73/49/c21253a684873/page.htm\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/fddi.fudan.edu.cn\/73\/49\/c21253a684873\/page.htm","crawl_time":1748795142,"first_indexed_time":1729536661,"http_code":200,"src_unparsed":"cn,edu,fudan!fddi,\/73\/49\/c21253a684873\/page.htm s443","src_root_hash":"18414008490815227386","history_drop_reason":null,"meta_title":"美国观察｜拜登特朗普首次辩论：议题攻防、外交分歧与选举叙事","meta_descriptions":["复旦发展研究院","引言当地时间6月27日晚上九点，前总统特朗普和现总统拜登在CNN的主持下开展了2024年大选首次总统候选人辩论。在辩论中，两人就经济、边境安全、堕胎权、和国会暴动案等议题互相攻防，并在一系列外交议题上继续之前的分歧并互相攻击。在整场辩论中，双方都保持了较高的攻击性并努力建构自己的选举叙事：特朗普不断强调拜登政府政绩的糟糕和对自己的迫害，而拜登则持续强调特朗普的发言是谎言。辩论结束后，多方民调和评论人员普遍认为拜登表现不佳，民主党“换帅”的声音再次浮现。01特朗普进攻议题：通货膨胀、边境安全与年龄经济议题一直是历次总统辩论中占比最大的议题，本次辩论也不例外。而在美国通胀高企的背景下，“在野”的特朗普在经济话题上先天具有主动权。主持人的第一个问题就是关于拜登任内的通货膨胀。拜登对此的回应是他扭转了特朗普政府留下的低迷经济，创造了很多就业岗位，言下之意是，通货膨胀是就业蓬勃的一个副产品。但特朗普抓住了这一点进行攻击，他称 “在我任上我们有了美国历史上最好的经济水平……我留给了他一个几乎没有通胀的国家，而他毁了一切。”他进一步指责拜登所谓的创造就业岗位不过是疫情结束后人们重新回到了工作上，而新"],"meta_canonical":null,"ml_categories_json":"","ml_types_json":"","ml_intent_types_json":"","meta_language":null,"attrs_author":null,"attrs_publish_time":0,"attrs_original_publish_time":1729536661,"attrs_is_republished":0,"attrs_nr_words":"250","attrs_boilerpipe_nr_words":"61","body_ext_links_number":3,"body_int_links_number":164,"meta_nofollow":0,"meta_noarchive":0,"props_was_rendered":0,"src_redirect":"","download_time_msec":1201,"download_ttfb_msec":909,"download_size":19665}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍

LOCATION

Host 186 · Partition 36

laksa186

18414008490815227386

🚫

NOT INDEXABLE

✅

CRAWLED

1 year ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	FAIL	`download_stamp > now() - 6 MONTH`	12.2 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://fddi.fudan.edu.cn/73/49/c21253a684873/page.htm
Last Crawled	2025-06-01 16:25:42 (1 year ago)
First Indexed	2024-10-21 18:51:01 (1 year ago)
HTTP Status Code	200
Content
Meta Title	美国观察｜拜登特朗普首次辩论：议题攻防、外交分歧与选举叙事
Meta Description	复旦发展研究院, 引言当地时间6月27日晚上九点，前总统特朗普和现总统拜登在CNN的主持下开展了2024年大选首次总统候选人辩论。在辩论中，两人就经济、边境安全、堕胎权、和国会暴动案等议题互相攻防，并在一系列外交议题上继续之前的分歧并互相攻击。在整场辩论中，双方都保持了较高的攻击性并努力建构自己的选举叙事：特朗普不断强调拜登政府政绩的糟糕和对自己的迫害，而拜登则持续强调特朗普的发言是谎言。辩论结束后，多方民调和评论人员普遍认为拜登表现不佳，民主党“换帅”的声音再次浮现。01特朗普进攻议题：通货膨胀、边境安全与年龄经济议题一直是历次总统辩论中占比最大的议题，本次辩论也不例外。而在美国通胀高企的背景下，“在野”的特朗普在经济话题上先天具有主动权。主持人的第一个问题就是关于拜登任内的通货膨胀。拜登对此的回应是他扭转了特朗普政府留下的低迷经济，创造了很多就业岗位，言下之意是，通货膨胀是就业蓬勃的一个副产品。但特朗普抓住了这一点进行攻击，他称 “在我任上我们有了美国历史上最好的经济水平……我留给了他一个几乎没有通胀的国家，而他毁了一切。”他进一步指责拜登所谓的创造就业岗位不过是疫情结束后人们重新回到了工作上，而新
Meta Canonical	null
Boilerpipe Text	heavy column, fetched on demand
Markdown	heavy column, fetched on demand
Readable Markdown	heavy column, fetched on demand
ML Classification
ML Categories	null
ML Page Types	null
ML Intent Types	null
Content Metadata
Language	null
Author	null
Publish Time	not set
Original Publish Time	2024-10-21 18:51:01 (1 year ago)
Republished	No
Word Count (Total)	250
Word Count (Content)	61
Links
External Links	3
Internal Links	164
Technical SEO
Meta Nofollow	No
Meta Noarchive	No
JS Rendered	No
Redirect Target	null
Performance
Download Time (ms)	1,201
TTFB (ms)	909
Download Size (bytes)	19,665
Location
Host ID	186 (laksa186)
Partition ID	36
Root Hash	18414008490815227386
Unparsed URL	cn,edu,fudan!fddi,/73/49/c21253a684873/page.htm s443