🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 113 (from laksa073)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa113.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.twitch.tv/realbeyza\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.twitch.tv/realbeyza\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.twitch.tv\/realbeyza","crawl_time":1775264780,"first_indexed_time":1624307458,"http_code":200,"src_unparsed":"tv,twitch!www,\/realbeyza s443","src_root_hash":"13515069266937314713","history_drop_reason":null,"meta_title":"realbeyza - Twitch","meta_descriptions":[],"attrs_boilerpipe_text":"Sound Alerts","attrs_markdown":"Skip to...\n\nAlt\n\nP\n\n[Browse](https:\/\/www.twitch.tv\/directory)\n\nLog In\n\nSign Up\n\n[![theburntpeanut](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/058ee082-68f4-417b-8f8b-8c3ad42468ac-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/theburntpeanut)\n\n[![](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/645d98a0-a2eb-48a3-b687-cfbc55243e4a-profile_image-70x70.png) ![](https:\/\/static-cdn.jtvnw.net\/twilight-static-assets\/avatar-light-mode-hype-train-icon.svg)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/jynxzi)\n\n[![summit1g](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/99aa4739-21d6-40af-86ae-4b4d3457fce4-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/summit1g)\n\n[![maximum](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/c67f5670-2877-4d51-b42a-38c8cf20fe31-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/maximum)\n\n[![TeamLiquid and TeamLiquidBR](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/15393ff4-1f49-49fb-9451-346be48475a5-profile_image-70x70.png) ![TeamLiquidBR](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/63f24d7e-bf71-4a10-b34a-02c675b0f619-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/teamliquid)\n\n[![hasanabi](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/0347a9aa-e396-49a5-b0f1-31261704bab8-profile_image-70x70.jpeg)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/hasanabi)\n\n[![marvelrivals is broadcasting a Co-Stream](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/ab8ad319-35ca-45ef-9c71-beb4888b69df-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/marvelrivals)\n\n[![nickmercs](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/b04e20be-6c0b-4379-b163-7f9a928e03f0-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/nickmercs)\n\n[![supertf](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/supertf-profile_image-4a7fae211a68ae1f-70x70.jpeg)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/supertf)\n\n[![moonmoon](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/3973e918fe7cc8c8-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/moonmoon)\n\n[![novaa](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/ac02dd40-0034-4ac6-a4b9-371bf5a44c3e-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/novaa)\n\n[![slyxtic](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/98e6711e-5cbc-4cf6-97ac-85605fe19316-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/slyxtic)\n\n[![swag\\_](https:\/\/static-cdn.jtvnw.net\/jtv_user_pictures\/3d0d31b5-3700-4f59-bb03-7bdc5641b1dc-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https:\/\/www.twitch.tv\/swag_)\n\n###### Sound Alerts\nIntended for certain audiences\n\nVolume\n\nVolume\n\n#### Stream Chat\nPress Escape or Shift + Tab at any point within chat messages to exit.\n\n**Connecting to Chat**\n\nSend a message\n\n\n\nChat","attrs_readable_markdown":"Sound Alerts","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

5 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.2 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.twitch.tv/realbeyza
Last Crawled	2026-04-04 01:06:20 (5 days ago)
First Indexed	2021-06-21 20:30:58 (4 years ago)
HTTP Status Code	200
Meta Title	realbeyza - Twitch
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Sound Alerts
Markdown	Skip to... Alt P [Browse](https://www.twitch.tv/directory) Log In Sign Up [![theburntpeanut](https://static-cdn.jtvnw.net/jtv_user_pictures/058ee082-68f4-417b-8f8b-8c3ad42468ac-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/theburntpeanut) [![](https://static-cdn.jtvnw.net/jtv_user_pictures/645d98a0-a2eb-48a3-b687-cfbc55243e4a-profile_image-70x70.png) ![](https://static-cdn.jtvnw.net/twilight-static-assets/avatar-light-mode-hype-train-icon.svg)Use the Right Arrow Key to show more information.](https://www.twitch.tv/jynxzi) [![summit1g](https://static-cdn.jtvnw.net/jtv_user_pictures/99aa4739-21d6-40af-86ae-4b4d3457fce4-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/summit1g) [![maximum](https://static-cdn.jtvnw.net/jtv_user_pictures/c67f5670-2877-4d51-b42a-38c8cf20fe31-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/maximum) [![TeamLiquid and TeamLiquidBR](https://static-cdn.jtvnw.net/jtv_user_pictures/15393ff4-1f49-49fb-9451-346be48475a5-profile_image-70x70.png) ![TeamLiquidBR](https://static-cdn.jtvnw.net/jtv_user_pictures/63f24d7e-bf71-4a10-b34a-02c675b0f619-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/teamliquid) [![hasanabi](https://static-cdn.jtvnw.net/jtv_user_pictures/0347a9aa-e396-49a5-b0f1-31261704bab8-profile_image-70x70.jpeg)Use the Right Arrow Key to show more information.](https://www.twitch.tv/hasanabi) [![marvelrivals is broadcasting a Co-Stream](https://static-cdn.jtvnw.net/jtv_user_pictures/ab8ad319-35ca-45ef-9c71-beb4888b69df-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/marvelrivals) [![nickmercs](https://static-cdn.jtvnw.net/jtv_user_pictures/b04e20be-6c0b-4379-b163-7f9a928e03f0-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/nickmercs) [![supertf](https://static-cdn.jtvnw.net/jtv_user_pictures/supertf-profile_image-4a7fae211a68ae1f-70x70.jpeg)Use the Right Arrow Key to show more information.](https://www.twitch.tv/supertf) [![moonmoon](https://static-cdn.jtvnw.net/jtv_user_pictures/3973e918fe7cc8c8-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/moonmoon) [![novaa](https://static-cdn.jtvnw.net/jtv_user_pictures/ac02dd40-0034-4ac6-a4b9-371bf5a44c3e-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/novaa) [![slyxtic](https://static-cdn.jtvnw.net/jtv_user_pictures/98e6711e-5cbc-4cf6-97ac-85605fe19316-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/slyxtic) [![swag\_](https://static-cdn.jtvnw.net/jtv_user_pictures/3d0d31b5-3700-4f59-bb03-7bdc5641b1dc-profile_image-70x70.png)Use the Right Arrow Key to show more information.](https://www.twitch.tv/swag_) ###### Sound Alerts Intended for certain audiences Volume Volume #### Stream Chat Press Escape or Shift + Tab at any point within chat messages to exit. Connecting to Chat Send a message Chat
Readable Markdown	Sound Alerts
Shard	113 (laksa)
Root Hash	13515069266937314713
Unparsed URL	tv,twitch!www,/realbeyza s443