ℹ️ Skipped - page is already crawled
| Filter | Status | Condition | Details |
|---|---|---|---|
| HTTP status | PASS | download_http_code = 200 | HTTP 200 |
| Age cutoff | PASS | download_stamp > now() - 6 MONTH | 0.1 months ago (distributed domain, exempt) |
| History drop | PASS | isNull(history_drop_reason) | No drop reason |
| Spam/ban | PASS | fh_dont_index != 1 AND ml_spam_score = 0 | ml_spam_score=0 |
| Canonical | PASS | meta_canonical IS NULL OR = '' OR = src_unparsed | Not set |
| Property | Value | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| URL | https://en.wikipedia.org/wiki/Harvard_University | |||||||||
| Last Crawled | 2026-06-01 17:31:22 (1 day ago) | |||||||||
| First Indexed | 2013-08-08 17:50:23 (12 years ago) | |||||||||
| HTTP Status Code | 200 | |||||||||
| Content | ||||||||||
| Meta Title | Harvard University | |||||||||
| Meta Description | null | |||||||||
| Meta Canonical | null | |||||||||
| Boilerpipe Text | heavy column, fetched on demand | |||||||||
| Markdown | heavy column, fetched on demand | |||||||||
| Readable Markdown | heavy column, fetched on demand | |||||||||
| ML Classification | ||||||||||
| ML Categories |
Raw JSON{
"/Jobs_and_Education": 843,
"/Jobs_and_Education/Education": 842,
"/Jobs_and_Education/Education/Colleges_and_Universities": 840
} | |||||||||
| ML Page Types |
Raw JSON{
"/Article": 835,
"/Article/Wiki": 756
} | |||||||||
| ML Intent Types |
Raw JSON{
"Informational": 998
} | |||||||||
| Content Metadata | ||||||||||
| Language | null | |||||||||
| Author | null | |||||||||
| Publish Time | not set | |||||||||
| Original Publish Time | 2013-08-08 17:50:23 (12 years ago) | |||||||||
| Republished | No | |||||||||
| Word Count (Total) | 18,451 | |||||||||
| Word Count (Content) | 15,884 | |||||||||
| Links | ||||||||||
| External Links | 376 | |||||||||
| Internal Links | 1,336 | |||||||||
| Technical SEO | ||||||||||
| Meta Nofollow | No | |||||||||
| Meta Noarchive | No | |||||||||
| JS Rendered | No | |||||||||
| Redirect Target | null | |||||||||
| Performance | ||||||||||
| Download Time (ms) | 0 | |||||||||
| TTFB (ms) | 0 | |||||||||
| Download Size (bytes) | 1,094,899 | |||||||||
| Location | ||||||||||
| Host ID | 152 (laksa152) | |||||||||
| Partition ID | 74 | |||||||||
| Root Hash | 17790707453426894952 | |||||||||
| Unparsed URL | org,wikipedia!en,/wiki/Harvard_University s443 | |||||||||