🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 98 (from laksa126)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa098.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://portal.ncblcmhc.org/\')), getAhrefsUnparsedNoserviceFromURL(\'https://portal.ncblcmhc.org/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/portal.ncblcmhc.org\/","crawl_time":1775540320,"first_indexed_time":1579064114,"http_code":200,"src_unparsed":"org,ncblcmhc!portal,\/ s443","src_root_hash":"16721643796022950098","history_drop_reason":null,"meta_title":"Counselor Gateway","meta_descriptions":[],"attrs_boilerpipe_text":"Registration is FREE.  There is no cost to register to use the Gateway.  You must use the Gateway to submit all applications and requests regarding your license.\nThe Gateway provides Counselors a single, secure portal to manage licenses and certifications.\n                        It grants access to printable documents, change of address, online applications and many more features. \n                        The Counselor Gateway is used to submit all license and certificate applications including Advanced Practice and Expanded Roles.\nOnce you register, your Counselor Gateway gives you access to:\nInitial applications\nEndorsement applications\nCBC Registrations\nRenewal applications\nName changes\nAddress changes\nView information on all of your Counseling licenses\nTo access your Counselor Gateway, you must register. You will need to create a username and password to access your information and applications.\nGeneral requirements for all applications:\nPopup blockers disabled or temporarily allow popups for this application\nBrowser set to accept cookies\nJavaScript-enabled\nInternet Explorer 9 or greater, Firefox, or Chrome\nCompatibility with Apple computers is NOT guaranteed\nPrinter along with Adobe Reader","attrs_markdown":null,"attrs_readable_markdown":"Registration is FREE. There is no cost to register to use the Gateway. You must use the Gateway to submit all applications and requests regarding your license.\n\nThe Gateway provides Counselors a single, secure portal to manage licenses and certifications. It grants access to printable documents, change of address, online applications and many more features. The Counselor Gateway is used to submit all license and certificate applications including Advanced Practice and Expanded Roles.\n\nOnce you register, your Counselor Gateway gives you access to:\n\n- Initial applications\n- Endorsement applications\n- CBC Registrations\n- Renewal applications\n- Name changes\n- Address changes\n- View information on all of your Counseling licenses\n\nTo access your Counselor Gateway, you must register. You will need to create a username and password to access your information and applications.\n\nGeneral requirements for all applications:\n\n- Popup blockers disabled or temporarily allow popups for this application\n- Browser set to accept cookies\n- JavaScript-enabled\n- Internet Explorer 9 or greater, Firefox, or Chrome\n- Compatibility with Apple computers is NOT guaranteed\n- Printer along with Adobe Reader","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

3 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.1 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://portal.ncblcmhc.org/
Last Crawled	2026-04-07 05:38:40 (3 days ago)
First Indexed	2020-01-15 04:55:14 (6 years ago)
HTTP Status Code	200
Meta Title	Counselor Gateway
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Registration is FREE. There is no cost to register to use the Gateway. You must use the Gateway to submit all applications and requests regarding your license. The Gateway provides Counselors a single, secure portal to manage licenses and certifications. It grants access to printable documents, change of address, online applications and many more features. The Counselor Gateway is used to submit all license and certificate applications including Advanced Practice and Expanded Roles. Once you register, your Counselor Gateway gives you access to: Initial applications Endorsement applications CBC Registrations Renewal applications Name changes Address changes View information on all of your Counseling licenses To access your Counselor Gateway, you must register. You will need to create a username and password to access your information and applications. General requirements for all applications: Popup blockers disabled or temporarily allow popups for this application Browser set to accept cookies JavaScript-enabled Internet Explorer 9 or greater, Firefox, or Chrome Compatibility with Apple computers is NOT guaranteed Printer along with Adobe Reader
Markdown	null
Readable Markdown	Registration is FREE. There is no cost to register to use the Gateway. You must use the Gateway to submit all applications and requests regarding your license. The Gateway provides Counselors a single, secure portal to manage licenses and certifications. It grants access to printable documents, change of address, online applications and many more features. The Counselor Gateway is used to submit all license and certificate applications including Advanced Practice and Expanded Roles. Once you register, your Counselor Gateway gives you access to: - Initial applications - Endorsement applications - CBC Registrations - Renewal applications - Name changes - Address changes - View information on all of your Counseling licenses To access your Counselor Gateway, you must register. You will need to create a username and password to access your information and applications. General requirements for all applications: - Popup blockers disabled or temporarily allow popups for this application - Browser set to accept cookies - JavaScript-enabled - Internet Explorer 9 or greater, Firefox, or Chrome - Compatibility with Apple computers is NOT guaranteed - Printer along with Adobe Reader
Shard	98 (laksa)
Root Hash	16721643796022950098
Unparsed URL	org,ncblcmhc!portal,/ s443