🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 104 (from laksa171)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📍
LOCATION
Host 104 · Partition 73
laksa104
9440933396064374704
📄
INDEXABLE
CRAWLED
1 month ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH1.2 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://oag.ca.gov/consumers/general/cars
Last Crawled2026-04-27 16:20:43 (1 month ago)
First Indexed2015-08-30 20:07:37 (10 years ago)
HTTP Status Code200
Content
Meta TitleBuying and Maintaining a Car | State of California - Department of Justice - Office of the Attorney General
Meta DescriptionBuying and Maintaining a Car Buying a car – whether new or used – is one of the biggest purchases we make. It is important to take your time in deciding which car to buy and not be pressured by anyone who simply wants your money or your signature on a contract. Once you decide on the vehicle that best fits your needs and budget, shop around for the best price, know the
Meta Canonicalnull
Boilerpipe Text
heavy column, fetched on demand
Markdown
heavy column, fetched on demand
Readable Markdown
heavy column, fetched on demand
ML Classification
ML Categories
/Autos_and_Vehicles
94.4%
/Autos_and_Vehicles/Vehicle_Shopping
93.8%
/Autos_and_Vehicles/Vehicle_Shopping/Used_Vehicles
59.2%
Raw JSON
{
    "/Autos_and_Vehicles": 944,
    "/Autos_and_Vehicles/Vehicle_Shopping": 938,
    "/Autos_and_Vehicles/Vehicle_Shopping/Used_Vehicles": 592
}
ML Page Types
/Article
65.0%
/Article/How_to
57.7%
Raw JSON
{
    "/Article": 650,
    "/Article/How_to": 577
}
ML Intent Types
Informational
87.6%
Commercial
34.0%
Raw JSON
{
    "Informational": 876,
    "Commercial": 340
}
Content Metadata
Languageen
Authornull
Publish Time2012-02-10 22:22:09 (14 years ago)
Original Publish Time2012-02-10 22:22:09 (14 years ago)
RepublishedNo
Word Count (Total)2,467
Word Count (Content)1,799
Links
External Links28
Internal Links122
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedNo
Redirect Targetnull
Performance
Download Time (ms)650
TTFB (ms)649
Download Size (bytes)22,627
Location
Host ID104 (laksa104)
Partition ID73
Root Hash9440933396064374704
Unparsed URLgov,ca!oag,/consumers/general/cars s443