đŸ•ˇī¸ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 39 (from laksa012)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

â„šī¸ Skipped - page is already crawled

📄
INDEXABLE
✅
CRAWLED
1 month ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH1.7 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://regnum.ru/news/3987988
Last Crawled2026-02-18 06:07:24 (1 month ago)
First Indexed2025-09-12 15:59:36 (6 months ago)
HTTP Status Code200
Meta TitleBrowser check...
Meta Descriptionnull
Meta Canonicalnull
Boilerpipe Text
An additional check of your browser is being performed . . . Confirm that you are not a robot
Markdown
An additional check of your browser is being performed... Confirm that you are not a robot
Readable Markdown
An additional check of your browser is being performed... Confirm that you are not a robot
Shard39 (laksa)
Root Hash15726956116345860439
Unparsed URLru,regnum!/news/3987988 s443