Crawler Inspector

1. Shard Calculation

Query:

Response:

Calculated Shard: 89 (from laksa070)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa089.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://forum.lowyat.net/topic/5169199\')), getAhrefsUnparsedNoserviceFromURL(\'https://forum.lowyat.net/topic/5169199\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/forum.lowyat.net\/topic\/5169199","crawl_time":1754607763,"first_indexed_time":1626478672,"http_code":200,"src_unparsed":"net,lowyat!forum,\/topic\/5169199 s443","src_root_hash":"12159148548690057489","history_drop_reason":null,"meta_title":"Xiaomi TV: any review?","meta_descriptions":[],"attrs_boilerpipe_text":"QUOTE(parmasean @ May 6 2022, 10:28 AM) (IMG: https:\/\/pictr.com\/images\/2022\/05\/06\/BJx9u6.md.jpg ) Sorry but i was referring to the E55 one instead. Guess they now have Android TV built in, which is great!  :thumbs: Just curious, which one are you using now? Can i ask for your feedback? I just recently ordered a Xiaomi 4S after making comparisons haha I am using a Mi P1 55, which with the Prism+ Q55 was the only one in my budget range. But since it was on sale at the time, and priced RM300 lower than the Prism, I chose the Mi P1. Honestly it's decent. The OS is quite ok. Not fast, but not too slow either. And never having issues with streaming, altho I am using a Realtek Gigabit USB adapter (limited to 450Mbps+ due to USB 2.0) instead of the built in ethernet (only 100Mbps) and Wifi. HDR is decent, altho HDR contents are limited to only what I got from Disney+.  Is it compareable to other, established brand names? Nah, Samsung, Sony and LG beats this TV hands down. But for the price, I am happy with what I am paying This post has been edited by  linkinstreet : May 6 2022, 10:46 AM","attrs_markdown":null,"attrs_readable_markdown":null,"meta_canonical":"net,lowyat!forum,\/topic\/5169199\/all s443"}

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	FAIL	`download_stamp > now() - 6 MONTH`	8.3 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	FAIL	`meta_canonical IS NULL OR = '' OR = src_unparsed`	net,lowyat!forum,/topic/5169199/all s443

Property	Value
URL	https://forum.lowyat.net/topic/5169199
Last Crawled	2025-08-07 23:02:43 (8 months ago)
First Indexed	2021-07-16 23:37:52 (4 years ago)
HTTP Status Code	200
Meta Title	Xiaomi TV: any review?
Meta Description	null
Meta Canonical	net,lowyat!forum,/topic/5169199/all s443
Boilerpipe Text	QUOTE(parmasean @ May 6 2022, 10:28 AM) (IMG: https://pictr.com/images/2022/05/06/BJx9u6.md.jpg ) Sorry but i was referring to the E55 one instead. Guess they now have Android TV built in, which is great! :thumbs: Just curious, which one are you using now? Can i ask for your feedback? I just recently ordered a Xiaomi 4S after making comparisons haha I am using a Mi P1 55, which with the Prism+ Q55 was the only one in my budget range. But since it was on sale at the time, and priced RM300 lower than the Prism, I chose the Mi P1. Honestly it's decent. The OS is quite ok. Not fast, but not too slow either. And never having issues with streaming, altho I am using a Realtek Gigabit USB adapter (limited to 450Mbps+ due to USB 2.0) instead of the built in ethernet (only 100Mbps) and Wifi. HDR is decent, altho HDR contents are limited to only what I got from Disney+. Is it compareable to other, established brand names? Nah, Samsung, Sony and LG beats this TV hands down. But for the price, I am happy with what I am paying This post has been edited by linkinstreet : May 6 2022, 10:46 AM
Markdown	null
Readable Markdown	null
Shard	89 (laksa)
Root Hash	12159148548690057489
Unparsed URL	net,lowyat!forum,/topic/5169199 s443

🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

1. Shard Calculation

Query:

Response:

2. Crawled Status Check

Query:

Response:

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

Page Info Filters

Page Details