🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 181 (from laksa026)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍
LOCATION
Host 181 · Partition 41
laksa181
15170859634011428381
📄
INDEXABLE
CRAWLED
1 month ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH1.2 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://www.businessinsider.com/reference/why-cant-i-sleep
Last Crawled2026-04-27 16:55:53 (1 month ago)
First Indexed2025-10-13 17:13:45 (7 months ago)
HTTP Status Code200
Content
Meta TitleWhy Can’t I Sleep: 9 Causes and How to Cope - Business Insider
Meta DescriptionDoes getting the sleep you need to feel your best pose an ongoing challenge? Here are 9 possible reasons why, plus tips to fall asleep faster.
Meta Canonicalnull
Boilerpipe Text
heavy column, fetched on demand
Markdown
heavy column, fetched on demand
Readable Markdown
heavy column, fetched on demand
ML Classification
ML Categories
/Health
99.7%
/Health/Mental_Health
85.3%
/Health/Mental_Health/Anxiety_and_Stress
80.9%
Raw JSON
{
    "/Health": 997,
    "/Health/Mental_Health": 853,
    "/Health/Mental_Health/Anxiety_and_Stress": 809
}
ML Page Types
/Article
99.9%
/Article/How_to
82.3%
Raw JSON
{
    "/Article": 999,
    "/Article/How_to": 823
}
ML Intent Types
Informational
99.8%
Commercial
12.9%
Raw JSON
{
    "Informational": 998,
    "Commercial": 129
}
Content Metadata
Languageen-us
Authornull
Publish Timenot set
Original Publish Time2025-10-13 17:13:45 (7 months ago)
RepublishedNo
Word Count (Total)2,173
Word Count (Content)1,648
Links
External Links83
Internal Links174
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedNo
Redirect Targetnull
Performance
Download Time (ms)322
TTFB (ms)302
Download Size (bytes)63,549
Location
Host ID181 (laksa181)
Partition ID41
Root Hash15170859634011428381
Unparsed URLcom,businessinsider!www,/reference/why-cant-i-sleep s443