🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 77 (from laksa057)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍
LOCATION
Host 77 · Partition 80
laksa077
11503141317392996077
📄
INDEXABLE
CRAWLED
1 day ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH0 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://www.ark-invest.com/
Last Crawled2026-06-02 02:34:51 (1 day ago)
First Indexed2017-08-27 15:07:41 (8 years ago)
HTTP Status Code200
Content
Meta TitleARK Invest | We Believe Innovation Is Key to Growth
Meta DescriptionARK Invest focuses solely on disruptive innovation and offers investment solutions to investors seeking long-term growth in the public markets.
Meta Canonicalnull
Boilerpipe Text
heavy column, fetched on demand
Markdown
heavy column, fetched on demand
Readable Markdown
heavy column, fetched on demand
ML Classification
ML Categories
/Finance
99.6%
/Finance/Investing
99.5%
/Finance/Investing/Funds
79.3%
Raw JSON
{
    "/Finance": 996,
    "/Finance/Investing": 995,
    "/Finance/Investing/Funds": 793
}
ML Page Types
/Core_Page
79.5%
/Core_Page/Services_Page
75.5%
Raw JSON
{
    "/Core_Page": 795,
    "/Core_Page/Services_Page": 755
}
ML Intent Types
Commercial
68.7%
Informational
45.0%
Raw JSON
{
    "Commercial": 687,
    "Informational": 450
}
Content Metadata
Languageen
Authornull
Publish Timenot set
Original Publish Time2017-08-27 15:07:41 (8 years ago)
RepublishedNo
Word Count (Total)2,514
Word Count (Content)68
Links
External Links16
Internal Links181
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedYes
Redirect Targetnull
Performance
Download Time (ms)1,050
TTFB (ms)1,026
Download Size (bytes)19,984
Location
Host ID77 (laksa077)
Partition ID80
Root Hash11503141317392996077
Unparsed URLcom,ark-invest!www,/ s443