🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 51 (from laksa118)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa051.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.youtube.com/channel/UCenAJLKHnIU9UKDp1FV9tTA\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.youtube.com/channel/UCenAJLKHnIU9UKDp1FV9tTA\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.youtube.com\/channel\/UCenAJLKHnIU9UKDp1FV9tTA","crawl_time":1764494889,"first_indexed_time":0,"http_code":200,"src_unparsed":"com,youtube!www,\/channel\/UCenAJLKHnIU9UKDp1FV9tTA s443","src_root_hash":"3907445400264388851","history_drop_reason":null,"meta_title":"James Bay - YouTube","meta_descriptions":["The deluxe version of my new album ‘Changes All The Time’ is out now! ♥️ https:\/\/jamesbay.lnk.to\/CATTDeluxe"],"attrs_boilerpipe_text":"I’m very happy to announce that my fourth album ‘Changes All The Time’ will be out on 20th September! \n\nI really felt some true musical freedom making this music. With the help of my co producer Gabe Simon, I found the courage to make what I wanted to make in ways I never have before.\n\nI’m also going on tour again next February! I haven’t toured the UK or Ireland since the end of 2022, I’m so excited to get back out there. I also can’t wait for my first UK arena headline show at Wembley arena 🤯 That’s a big dream come true!\n\nIf you pre-order any format of ‘Changes All The Time’ from my official UK webstore by 4pm BST on Tuesday 23rd July you’ll receive an exclusive ticket pre-sale code. Pre-sale starts 10am BST on Wednesday 24th July. If you miss out on pre-sale then general sale will start at 10am BST on Friday 26th July. \n\nAnd last but not least, my new single ‘Up All Night’ with The Lumineers and Noah Kahan is out NOW! Very grateful to all those guys for joining me on this one. I love this song and I’m so glad it’s finally out in the world ♥️ I’m very happy to announce that my fourth album ‘Changes All The Time’ will be out on 20th September! \n\nI really felt some true musical freedom making this music. With the help of my co producer Gabe Simon, I found the courage to make what I wanted to make in ways I never have before.\n\nI’m also going on tour again next February! I haven’t toured the UK or Ireland since the end of 2022, I’m so excited to get back out there. I also can’t wait for my first UK arena headline show at Wembley arena 🤯 That’s a big dream come true!\n\nIf you pre-order any format of ‘Changes All The Time’ from my official UK webstore by 4pm BST on Tuesday 23rd July you’ll receive an exclusive ticket pre-sale code. Pre-sale starts 10am BST on Wednesday 24th July. If you miss out on pre-sale then general sale will start at 10am BST on Friday 26th July. \n\nAnd last but not least, my new single ‘Up All Night’ with The Lumineers and Noah Kahan is out NOW! Very grateful to all those guys for joining me on this one. I love this song and I’m so glad it’s finally out in the world ♥️","attrs_markdown":null,"attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

4 months ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	4.5 months ago (distributed domain, exempt)
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.youtube.com/channel/UCenAJLKHnIU9UKDp1FV9tTA
Last Crawled	2025-11-30 09:28:09 (4 months ago)
First Indexed	not set
HTTP Status Code	200
Meta Title	James Bay - YouTube
Meta Description	The deluxe version of my new album ‘Changes All The Time’ is out now! ♥️ https://jamesbay.lnk.to/CATTDeluxe
Meta Canonical	null
Boilerpipe Text	I’m very happy to announce that my fourth album ‘Changes All The Time’ will be out on 20th September! I really felt some true musical freedom making this music. With the help of my co producer Gabe Simon, I found the courage to make what I wanted to make in ways I never have before. I’m also going on tour again next February! I haven’t toured the UK or Ireland since the end of 2022, I’m so excited to get back out there. I also can’t wait for my first UK arena headline show at Wembley arena 🤯 That’s a big dream come true! If you pre-order any format of ‘Changes All The Time’ from my official UK webstore by 4pm BST on Tuesday 23rd July you’ll receive an exclusive ticket pre-sale code. Pre-sale starts 10am BST on Wednesday 24th July. If you miss out on pre-sale then general sale will start at 10am BST on Friday 26th July. And last but not least, my new single ‘Up All Night’ with The Lumineers and Noah Kahan is out NOW! Very grateful to all those guys for joining me on this one. I love this song and I’m so glad it’s finally out in the world ♥️ I’m very happy to announce that my fourth album ‘Changes All The Time’ will be out on 20th September! I really felt some true musical freedom making this music. With the help of my co producer Gabe Simon, I found the courage to make what I wanted to make in ways I never have before. I’m also going on tour again next February! I haven’t toured the UK or Ireland since the end of 2022, I’m so excited to get back out there. I also can’t wait for my first UK arena headline show at Wembley arena 🤯 That’s a big dream come true! If you pre-order any format of ‘Changes All The Time’ from my official UK webstore by 4pm BST on Tuesday 23rd July you’ll receive an exclusive ticket pre-sale code. Pre-sale starts 10am BST on Wednesday 24th July. If you miss out on pre-sale then general sale will start at 10am BST on Friday 26th July. And last but not least, my new single ‘Up All Night’ with The Lumineers and Noah Kahan is out NOW! Very grateful to all those guys for joining me on this one. I love this song and I’m so glad it’s finally out in the world ♥️
Markdown	null
Readable Markdown	null
Shard	51 (laksa)
Root Hash	3907445400264388851
Unparsed URL	com,youtube!www,/channel/UCenAJLKHnIU9UKDp1FV9tTA s443