🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 17 (from laksa109)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍
LOCATION
Host 17 · Partition 79
laksa017
11594120116312315817
📄
INDEXABLE
CRAWLED
1 day ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH0 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://consumer.georgia.gov/
Last Crawled2026-06-02 11:22:39 (1 day ago)
First Indexed2017-09-02 04:49:50 (8 years ago)
HTTP Status Code200
Content
Meta TitleGeorgia Attorney General's Consumer Protection Division
Meta DescriptionThe Georgia Attorney General's Consumer Protection Division is the consumer protection agency for the State of Georgia. We help protect consumers from un
Meta Canonicalnull
Boilerpipe Text
heavy column, fetched on demand
Markdown
heavy column, fetched on demand
Readable Markdown
heavy column, fetched on demand
ML Classification
ML Categories
/Law_and_Government
99.2%
/Law_and_Government/Legal
99.0%
/Law_and_Government/Legal/Legal_Services
92.4%
Raw JSON
{
    "/Law_and_Government": 992,
    "/Law_and_Government/Legal": 990,
    "/Law_and_Government/Legal/Legal_Services": 924
}
ML Page Types
/Core_Page
99.0%
/Core_Page/About_Page
62.5%
Raw JSON
{
    "/Core_Page": 990,
    "/Core_Page/About_Page": 625
}
ML Intent Types
Informational
97.1%
Navigational
32.3%
Raw JSON
{
    "Informational": 971,
    "Navigational": 323
}
Content Metadata
Languageen
Authornull
Publish Timenot set
Original Publish Time2017-09-02 04:49:50 (8 years ago)
RepublishedNo
Word Count (Total)749
Word Count (Content)96
Links
External Links3
Internal Links57
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedNo
Redirect Targetnull
Performance
Download Time (ms)159
TTFB (ms)158
Download Size (bytes)28,316
Location
Host ID17 (laksa017)
Partition ID79
Root Hash11594120116312315817
Unparsed URLgov,georgia!consumer,/ s443