🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 86 (from laksa188)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

Query:
Response:
📄
INDEXABLE
NOT CRAWLED
🚫
ROBOTS BLOCKED
👁️
SEEN

Page Info Filters

FilterStatusConditionDetails
HTTP statusN/Adownload_http_code = 200Not crawled
Age cutoffN/Adownload_stamp > now() - 6 MONTHNot crawled
History dropN/AisNull(history_drop_reason)Not crawled
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalN/Ameta_canonical IS NULL OR = '' OR = src_unparsedNot crawled

Page Details

PropertyValue
URLhttps://gufo.me/dict/bse/%D0%9F%D1%80%D0%B5%D1%86%D0%B5%D1%81%D1%81%D0%B8%D1%8F
Shard86 (laksa)
Root Hash6331011102449452486
Unparsed URLme,gufo!/dict/bse/%D0%9F%D1%80%D0%B5%D1%86%D0%B5%D1%81%D1%81%D0%B8%D1%8F s443