Crawler Inspector

1. Shard Calculation

Query:

Response:

Calculated Shard: 144 (from laksa125)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa144.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://kr.usstocksignal.com/search/balancesheet/GOOGL\')), getAhrefsUnparsedNoserviceFromURL(\'https://kr.usstocksignal.com/search/balancesheet/GOOGL\'))) FORMAT JSONEachRow'

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	FAIL	`download_stamp > now() - 6 MONTH`	15 months ago
History drop	FAIL	`isNull(history_drop_reason)`	tooold
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Property	Value
URL	https://kr.usstocksignal.com/search/balancesheet/GOOGL
Last Crawled	2025-01-18 20:29:43 (1 year ago)
First Indexed	not set
HTTP Status Code	200
Meta Title	알파벳A(구글)(GOOGL)- 재무제표 \| US STOCK SIGNAL
Meta Description	US STOCK SIGNAL \| 수익은 길게 ~ 손실은 짧게! 매매신호로 투자하는 미국주식! 종목추천, 매매신호, 밸류에이션, 수급
Meta Canonical	null
Boilerpipe Text	20년 이상의 금융 빅데이터와 알고리즘 기술을 통해 종목의 매매신호를 신속하게 제시합니다. 매매신호는 매수-보유-매도-관망의 흐름으로 제시됩니다. 매매신호과 함께 스마트 스코어, 밸류에이션, 수급분석 점수로 우량주를 확인하세요.
Markdown	null
Readable Markdown	null
Shard	144 (laksa)
Root Hash	1623704372204027344
Unparsed URL	com,usstocksignal!kr,/search/balancesheet/GOOGL s443

🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

1. Shard Calculation

Query:

Response:

2. Crawled Status Check

Query:

Response:

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

Page Info Filters

Page Details