🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 188 (from laksa045)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄
INDEXABLE
CRAWLED
4 hours ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH0 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://yep.com/
Last Crawled2026-04-09 17:55:15 (4 hours ago)
First Indexed2017-07-02 11:41:54 (8 years ago)
HTTP Status Code200
Meta TitleYep – the private, revenue-sharing search engine
Meta DescriptionWhen you search with Yep, you’re putting actual dollars in the pockets of your favorite content creators.
Meta Canonicalnull
Boilerpipe Text
is a new search engine that enables best search for AI agents. About Yep Set Yep as default YepBot We’re hiring Terms and policies Settings
Markdown
[Chat](https://yep.com/chat/) [Chat](https://yep.com/chat/) [Try our search API & MCP →](https://platform.yep.com/) is a new search engine that enables best search for AI agents. [About Yep](https://yep.com/about) [Set Yep as default](https://yep.com/set-yep-as-default) [YepBot](https://yep.com/yepbot) [We’re hiring](https://yep.com/jobs) [Terms and policies](https://yep.com/policies) [Settings](https://yep.com/settings)
Readable Markdown
is a new search engine that enables best search for AI agents. [About Yep](https://yep.com/about) [Set Yep as default](https://yep.com/set-yep-as-default) [YepBot](https://yep.com/yepbot) [We’re hiring](https://yep.com/jobs) [Terms and policies](https://yep.com/policies) [Settings](https://yep.com/settings)
Shard188 (laksa)
Root Hash14007390596759188988
Unparsed URLcom,yep!/ s443