🕷ī¸ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 38 (from laksa037)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹī¸ Skipped - page is already crawled

đŸšĢ
NOT INDEXABLE
✅
CRAWLED
5 months ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusFAILdownload_http_code = 200HTTP 404
Age cutoffPASSdownload_stamp > now() - 6 MONTH5.1 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0

Page Details

PropertyValue
URLhttps://news.un.org/zh/story/2021/01/1076572
Last Crawled2025-09-26 11:55:37 (5 months ago)
HTTP Status Code404
Shard38 (laksa)
Root Hash8728136667988535038
Unparsed URLorg,un!news,/zh/story/2021/01/1076572 s443