🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 149 (from laksa138)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍
LOCATION
Host 149 · Partition 57
laksa149
17641225878691611549
📄
INDEXABLE
CRAWLED
1 month ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH1.2 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://www.lego.com/en-us/product/scuderia-ferrari-hp-charles-leclerc-helmet-43014
Last Crawled2026-04-27 16:40:14 (1 month ago)
First Indexed2026-03-05 10:50:08 (3 months ago)
HTTP Status Code200
Content
Meta TitleScuderia Ferrari HP Charles Leclerc Helmet 43014 | LEGO® Editions | Buy online at the Official LEGO® Shop US
Meta DescriptionBuckle up and build a collectible LEGO® F1® helmet set
Meta Canonicalnull
Boilerpipe Text
heavy column, fetched on demand
Markdown
heavy column, fetched on demand
Readable Markdown
heavy column, fetched on demand
ML Classification
ML Categories
/Shopping
67.6%
/Shopping/Toys
64.8%
/Shopping/Toys/Building_Toys
58.0%
/Hobbies_and_Leisure
50.5%
/Hobbies_and_Leisure/Crafts
31.1%
/Hobbies_and_Leisure/Crafts/Other
16.7%
/Games
15.2%
Raw JSON
{
    "/Shopping": 676,
    "/Shopping/Toys": 648,
    "/Shopping/Toys/Building_Toys": 580,
    "/Hobbies_and_Leisure": 505,
    "/Hobbies_and_Leisure/Crafts": 311,
    "/Hobbies_and_Leisure/Crafts/Other": 167,
    "/Games": 152
}
ML Page Types
/Listing
97.7%
/Listing/Product
97.7%
Raw JSON
{
    "/Listing": 977,
    "/Listing/Product": 977
}
ML Intent Types
Transactional
96.5%
Commercial
12.0%
Raw JSON
{
    "Transactional": 965,
    "Commercial": 120
}
Content Metadata
Languageen
AuthorOle Kirk Kristiansen
Publish Timenot set
Original Publish Time2026-03-05 10:50:08 (3 months ago)
RepublishedNo
Word Count (Total)1,184
Word Count (Content)535
Links
External Links9
Internal Links207
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedYes
Redirect Targetnull
Performance
Download Time (ms)732
TTFB (ms)698
Download Size (bytes)64,312
Location
Host ID149 (laksa149)
Partition ID57
Root Hash17641225878691611549
Unparsed URLcom,lego!www,/en-us/product/scuderia-ferrari-hp-charles-leclerc-helmet-43014 s443