🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 191 (from laksa005)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍
LOCATION
Host 191 · Partition 39
laksa191
12014677601273007991
📄
INDEXABLE
CRAWLED
20 days ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH0.7 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://www.niche.com/colleges/colgate-university/
Last Crawled2026-05-14 05:42:19 (20 days ago)
First Indexed2017-02-19 00:12:10 (9 years ago)
HTTP Status Code200
Content
Meta TitleColgate University - Niche
Meta DescriptionColgate University offers a unique college experience with academically rigorous programs and a strong sense of community. Students appreciate the small class sizes and engaging professors, which foster personal relationships and rich discussions. The university promotes a "work hard, play hard" culture, noted for its vibrant social scene, particularly through Greek life, though this can create a sense of exclusivity for those outside these circles. While there are numerous extracurricular activities and a solid alumni network that aids career opportunities, the campus is located in a very rural setting, which some find limiting. Additionally, concerns about the level of inclusion and diversity have been raised, particularly impacting students of color and those from lower socioeconomic backgrounds. Despite mixed feelings about campus life and challenges with dining options and housing conditions, many students feel grateful for their supportive environment and the opportunities provided at Colgate.
Meta Canonicalnull
Boilerpipe Text
heavy column, fetched on demand
Markdown
heavy column, fetched on demand
Readable Markdown
heavy column, fetched on demand
ML Classification
ML Categories
/Jobs_and_Education
98.8%
/Jobs_and_Education/Education
98.7%
/Jobs_and_Education/Education/Colleges_and_Universities
97.9%
Raw JSON
{
    "/Jobs_and_Education": 988,
    "/Jobs_and_Education/Education": 987,
    "/Jobs_and_Education/Education/Colleges_and_Universities": 979
}
ML Page Types
/Core_Page
88.2%
/Core_Page/About_Page
79.8%
Raw JSON
{
    "/Core_Page": 882,
    "/Core_Page/About_Page": 798
}
ML Intent Types
Informational
99.7%
Commercial
10.3%
Raw JSON
{
    "Informational": 997,
    "Commercial": 103
}
Content Metadata
Languageen
Authornull
Publish Time2025-11-18 00:00:00 (6 months ago)
Original Publish Time2017-02-19 00:12:10 (9 years ago)
RepublishedYes
Word Count (Total)3,994
Word Count (Content)1,642
Links
External Links17
Internal Links141
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedYes
Redirect Targetnull
Performance
Download Time (ms)279
TTFB (ms)247
Download Size (bytes)93,560
Location
Host ID191 (laksa191)
Partition ID39
Root Hash12014677601273007991
Unparsed URLcom,niche!www,/colleges/colgate-university/ s443