🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 164 (from laksa040)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍
LOCATION
Host 164 · Partition 45
laksa164
4213140586709049164
📄
INDEXABLE
CRAWLED
1 month ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH1.2 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://steemit.com/programming/@kurtrohlandt/my-favourite-gif-memes-about-programming
Last Crawled2026-04-28 03:06:59 (1 month ago)
First Indexed2016-11-21 00:34:03 (9 years ago)
HTTP Status Code200
Content
Meta TitleMy favourite gif memes about programming — Steemit
Meta DescriptionHey Everyone! While I was putting together my last post of my favourite programming memes of the week I did a… by kurtrohlandt
Meta Canonicalnull
Boilerpipe Text
heavy column, fetched on demand
Markdown
heavy column, fetched on demand
Readable Markdown
heavy column, fetched on demand
ML Classification
ML Categoriesnull
ML Page Typesnull
ML Intent Typesnull
Content Metadata
Languageen
Authornull
Publish Timenot set
Original Publish Time2016-11-21 00:34:03 (9 years ago)
RepublishedNo
Word Count (Total)471
Word Count (Content)252
Links
External Links32
Internal Links44
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedNo
Redirect Targetnull
Performance
Download Time (ms)412
TTFB (ms)411
Download Size (bytes)28,330
Location
Host ID164 (laksa164)
Partition ID45
Root Hash4213140586709049164
Unparsed URLcom,steemit!/programming/@kurtrohlandt/my-favourite-gif-memes-about-programming s443