🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 122 (from laksa009)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa122.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://baseballbatbros.com/collections/all\')), getAhrefsUnparsedNoserviceFromURL(\'https://baseballbatbros.com/collections/all\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/baseballbatbros.com\/collections\/all","crawl_time":1775784873,"first_indexed_time":1628597687,"http_code":200,"src_unparsed":"com,baseballbatbros!\/collections\/all s443","src_root_hash":"15620118832858163722","history_drop_reason":null,"meta_title":"Products – The Baseball Bat Bros","meta_descriptions":[],"attrs_boilerpipe_text":"Skip to content\nHome\nProducts\n$19.99\n$19.99\n$19.99\n$19.99\n$19.99\n$19.99","attrs_markdown":"[Skip to content](https:\/\/baseballbatbros.com\/collections\/all#MainContent)\n\n[Log in](https:\/\/baseballbatbros.com\/customer_authentication\/redirect?locale=en&region_country=US)  [Sign up](https:\/\/shopify.com\/36268802092\/account?locale=en)\n\n[Cart (0)](https:\/\/baseballbatbros.com\/cart)\n***\n[![The Baseball Bat Bros](https:\/\/baseballbatbros.com\/cdn\/shop\/files\/IMG_0563_150x150.JPG?v=1615924438)](https:\/\/baseballbatbros.com\/)\n\n[![The Baseball Bat Bros](https:\/\/baseballbatbros.com\/cdn\/shop\/files\/IMG_0563_250x.JPG?v=1615924438)](https:\/\/baseballbatbros.com\/)\n\n***\nMenu\n\n- [Bat Bros Merch](https:\/\/www.baseballism.com\/collections\/baseballism-x-the-baseball-bat-bros)\n- [BBCOR Bat Bro Scales (Full List)](https:\/\/baseballbatbros.com\/pages\/bbcorrankings)\n- [BBB YouTube Channel](https:\/\/www.youtube.com\/channel\/UCUC_sJGtV-oKdTw1s3oazwQ)\n- [Fastpitch Softball Bat Rankings](https:\/\/www.thesoftballchic.com\/)\n- [FTC Affiliate Disclosure](https:\/\/baseballbatbros.com\/pages\/ftc-affiliate-disclosure)\n- [Log in](https:\/\/baseballbatbros.com\/customer_authentication\/redirect?locale=en&region_country=US)\n- [Sign up](https:\/\/shopify.com\/36268802092\/account?locale=en)\n\n- [Facebook](https:\/\/www.facebook.com\/The-Baseball-Bat-Bros-110068463841025 \"The Baseball Bat Bros on Facebook\")\n- [Twitter](https:\/\/twitter.com\/baseballbatbros \"The Baseball Bat Bros on Twitter\")\n- [Instagram](https:\/\/www.instagram.com\/baseballbatbros\/ \"The Baseball Bat Bros on Instagram\")\n- [YouTube](https:\/\/www.youtube.com\/channel\/UCUC_sJGtV-oKdTw1s3oazwQ \"The Baseball Bat Bros on YouTube\")\n***\n\n***\n[Home](https:\/\/baseballbatbros.com\/ \"Back to the frontpage\")  1  ›  Products 2\n\n# Products\n[Example Product Title](https:\/\/baseballbatbros.com\/admin\/products)\n\n\\$19.99\n\n[Example Product Title](https:\/\/baseballbatbros.com\/admin\/products)\n\n\\$19.99\n\n[Example Product Title](https:\/\/baseballbatbros.com\/admin\/products)\n\n\\$19.99\n\n[Example Product Title](https:\/\/baseballbatbros.com\/admin\/products)\n\n\\$19.99\n\n[Example Product Title](https:\/\/baseballbatbros.com\/admin\/products)\n\n\\$19.99\n\n[Example Product Title](https:\/\/baseballbatbros.com\/admin\/products)\n\n\\$19.99\n***\nCopyright © 2026, [The Baseball Bat Bros](https:\/\/baseballbatbros.com\/). [Powered by Shopify](https:\/\/www.shopify.com\/?utm_campaign=poweredby&utm_medium=shopify&utm_source=onlinestore)\n\nPayment icons\n\n- Choosing a selection results in a full page refresh.\n- Press the space key then arrow keys to make a selection.","attrs_readable_markdown":"[Skip to content](https:\/\/baseballbatbros.com\/collections\/all#MainContent)\n\n***\n[Home](https:\/\/baseballbatbros.com\/ \"Back to the frontpage\")      Products\n\n\\$19.99\n\n\\$19.99\n\n\\$19.99\n\n\\$19.99\n\n\\$19.99\n\n\\$19.99\n***","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

2 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.1 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://baseballbatbros.com/collections/all
Last Crawled	2026-04-10 01:34:33 (2 days ago)
First Indexed	2021-08-10 12:14:47 (4 years ago)
HTTP Status Code	200
Meta Title	Products – The Baseball Bat Bros
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Skip to content Home Products $19.99 $19.99 $19.99 $19.99 $19.99 $19.99
Markdown	[Skip to content](https://baseballbatbros.com/collections/all#MainContent) [Log in](https://baseballbatbros.com/customer_authentication/redirect?locale=en&region_country=US) [Sign up](https://shopify.com/36268802092/account?locale=en) [Cart (0)](https://baseballbatbros.com/cart) * [![The Baseball Bat Bros](https://baseballbatbros.com/cdn/shop/files/IMG_0563_150x150.JPG?v=1615924438)](https://baseballbatbros.com/) [![The Baseball Bat Bros](https://baseballbatbros.com/cdn/shop/files/IMG_0563_250x.JPG?v=1615924438)](https://baseballbatbros.com/) * Menu - [Bat Bros Merch](https://www.baseballism.com/collections/baseballism-x-the-baseball-bat-bros) - [BBCOR Bat Bro Scales (Full List)](https://baseballbatbros.com/pages/bbcorrankings) - [BBB YouTube Channel](https://www.youtube.com/channel/UCUC_sJGtV-oKdTw1s3oazwQ) - [Fastpitch Softball Bat Rankings](https://www.thesoftballchic.com/) - [FTC Affiliate Disclosure](https://baseballbatbros.com/pages/ftc-affiliate-disclosure) - [Log in](https://baseballbatbros.com/customer_authentication/redirect?locale=en&region_country=US) - [Sign up](https://shopify.com/36268802092/account?locale=en) - [Facebook](https://www.facebook.com/The-Baseball-Bat-Bros-110068463841025 "The Baseball Bat Bros on Facebook") - [Twitter](https://twitter.com/baseballbatbros "The Baseball Bat Bros on Twitter") - [Instagram](https://www.instagram.com/baseballbatbros/ "The Baseball Bat Bros on Instagram") - [YouTube](https://www.youtube.com/channel/UCUC_sJGtV-oKdTw1s3oazwQ "The Baseball Bat Bros on YouTube") * * [Home](https://baseballbatbros.com/ "Back to the frontpage") 1 › Products 2 # Products [Example Product Title](https://baseballbatbros.com/admin/products) \$19.99 [Example Product Title](https://baseballbatbros.com/admin/products) \$19.99 [Example Product Title](https://baseballbatbros.com/admin/products) \$19.99 [Example Product Title](https://baseballbatbros.com/admin/products) \$19.99 [Example Product Title](https://baseballbatbros.com/admin/products) \$19.99 [Example Product Title](https://baseballbatbros.com/admin/products) \$19.99 *** Copyright © 2026, [The Baseball Bat Bros](https://baseballbatbros.com/). [Powered by Shopify](https://www.shopify.com/?utm_campaign=poweredby&utm_medium=shopify&utm_source=onlinestore) Payment icons - Choosing a selection results in a full page refresh. - Press the space key then arrow keys to make a selection.
Readable Markdown	[Skip to content](https://baseballbatbros.com/collections/all#MainContent) * [Home](https://baseballbatbros.com/ "Back to the frontpage") Products \$19.99 \$19.99 \$19.99 \$19.99 \$19.99 \$19.99 *
Shard	122 (laksa)
Root Hash	15620118832858163722
Unparsed URL	com,baseballbatbros!/collections/all s443